2024-04-15T00:09:38.315 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-15T00:09:38.316 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/traceless/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_ffsb traceless/50pc} --verbose --name teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi --archive /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656634 --owner scheduled_teuthology@teuthology -- /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656634/orig.config.yaml 2024-04-15T00:09:38.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T00:09:38.493 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656634 branch: squid description: fs/traceless/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_ffsb traceless/50pc} email: ceph-qa@ceph.com first_in_suite: false job_id: '7656634' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds inject traceless reply probability: 0.5 mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 filestore flush min: 0 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - SLOW_OPS - slow request sha1: a9a752df26c63acad72e1b3569fd79a515ca0765 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a9a752df26c63acad72e1b3569fd79a515ca0765 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: a9a752df26c63acad72e1b3569fd79a515ca0765 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 seed: 840 sha1: a9a752df26c63acad72e1b3569fd79a515ca0765 sleep_before_teardown: 0 subset: 427/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: a9a752df26c63acad72e1b3569fd79a515ca0765 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi031.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNn/78zpNCO1u7aePEvFteOWbNZakRUONk4VBVixpEo1uoDb94JpfpsnF22EsVb3bXpizehxZKpiHaVAf1Ws0ws= smithi050.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLWOzY9VzwV1Diat2zO7DNPgVuGriryQsfJfgWGy09MvJqO0dpFD8H69w3WY7BZREN5LA/YhK/MaW5QfYGq4bvQ= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - check-counter: counters: mds: - mds.dir_split - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-14_21:24:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-15T00:09:38.493 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa; will attempt to use it 2024-04-15T00:09:38.494 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa/tasks 2024-04-15T00:09:38.494 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-15T00:09:38.495 INFO:teuthology.task.internal:Checking packages... 2024-04-15T00:09:38.519 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a9a752df26c63acad72e1b3569fd79a515ca0765' 2024-04-15T00:09:38.519 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-15T00:09:38.519 INFO:teuthology.packaging:ref: None 2024-04-15T00:09:38.519 INFO:teuthology.packaging:tag: None 2024-04-15T00:09:38.519 INFO:teuthology.packaging:branch: squid 2024-04-15T00:09:38.519 INFO:teuthology.packaging:sha1: a9a752df26c63acad72e1b3569fd79a515ca0765 2024-04-15T00:09:38.520 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-04-15T00:09:38.795 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2114.ga9a752df 2024-04-15T00:09:38.796 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-15T00:09:38.910 INFO:teuthology.task.internal:no buildpackages task found 2024-04-15T00:09:38.910 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-15T00:09:38.919 INFO:teuthology.task.internal:Saving configuration 2024-04-15T00:09:38.936 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-15T00:09:38.943 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-15T00:09:38.967 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656634', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-15 00:05:02.313498', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNn/78zpNCO1u7aePEvFteOWbNZakRUONk4VBVixpEo1uoDb94JpfpsnF22EsVb3bXpizehxZKpiHaVAf1Ws0ws='} 2024-04-15T00:09:38.990 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656634', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-15 00:05:02.312230', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLWOzY9VzwV1Diat2zO7DNPgVuGriryQsfJfgWGy09MvJqO0dpFD8H69w3WY7BZREN5LA/YhK/MaW5QfYGq4bvQ='} 2024-04-15T00:09:38.990 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-15T00:09:39.003 INFO:teuthology.task.internal:roles: ubuntu@smithi031.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-15T00:09:39.003 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-15T00:09:39.003 INFO:teuthology.run_tasks:Running task console_log... 2024-04-15T00:09:39.076 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f614c9f93a0>, signals=[15]) 2024-04-15T00:09:39.077 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-15T00:09:39.108 INFO:teuthology.task.internal:Opening connections... 2024-04-15T00:09:39.109 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi031.front.sepia.ceph.com 2024-04-15T00:09:39.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:09:39.215 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi050.front.sepia.ceph.com 2024-04-15T00:09:39.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:09:39.317 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-15T00:09:39.367 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2024-04-15T00:09:39.385 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2024-04-15T00:09:39.386 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2024-04-15T00:09:39.443 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Stream" 2024-04-15T00:09:39.444 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="9" 2024-04-15T00:09:39.444 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos" 2024-04-15T00:09:39.444 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora" 2024-04-15T00:09:39.444 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="9" 2024-04-15T00:09:39.444 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el9" 2024-04-15T00:09:39.444 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-15T00:09:39.444 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2024-04-15T00:09:39.444 INFO:teuthology.orchestra.run.smithi031.stdout:LOGO="fedora-logo-icon" 2024-04-15T00:09:39.444 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-15T00:09:39.444 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://centos.org/" 2024-04-15T00:09:39.444 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T00:09:39.444 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-15T00:09:39.444 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T00:09:39.445 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2024-04-15T00:09:39.465 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2024-04-15T00:09:39.483 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2024-04-15T00:09:39.483 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2024-04-15T00:09:39.542 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream" 2024-04-15T00:09:39.542 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="9" 2024-04-15T00:09:39.542 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos" 2024-04-15T00:09:39.542 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora" 2024-04-15T00:09:39.542 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="9" 2024-04-15T00:09:39.542 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el9" 2024-04-15T00:09:39.542 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-15T00:09:39.542 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2024-04-15T00:09:39.542 INFO:teuthology.orchestra.run.smithi050.stdout:LOGO="fedora-logo-icon" 2024-04-15T00:09:39.542 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-15T00:09:39.542 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/" 2024-04-15T00:09:39.543 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T00:09:39.543 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-15T00:09:39.543 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T00:09:39.543 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2024-04-15T00:09:39.565 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-15T00:09:39.581 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-15T00:09:39.595 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-15T00:09:39.595 DEBUG:teuthology.orchestra.run.smithi031:> test '!' -e /home/ubuntu/cephtest 2024-04-15T00:09:39.598 DEBUG:teuthology.orchestra.run.smithi050:> test '!' -e /home/ubuntu/cephtest 2024-04-15T00:09:39.615 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-15T00:09:39.628 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-15T00:09:39.628 DEBUG:teuthology.orchestra.run.smithi031:> test -z $(ls -A /var/lib/ceph) 2024-04-15T00:09:39.654 DEBUG:teuthology.orchestra.run.smithi050:> test -z $(ls -A /var/lib/ceph) 2024-04-15T00:09:39.685 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-15T00:09:39.738 INFO:teuthology.run_tasks:Running task kernel... 2024-04-15T00:09:39.787 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-15T00:09:39.788 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-15T00:09:39.788 DEBUG:teuthology.orchestra.run.smithi031:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-15T00:09:39.788 DEBUG:teuthology.orchestra.run.smithi050:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-15T00:09:39.805 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T00:09:39.805 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2024-04-15T00:09:39.806 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T00:09:39.806 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2024-04-15T00:09:39.862 INFO:teuthology.orchestra.run.smithi050.stdout:5.14.0-361.el9.x86_64 2024-04-15T00:09:39.863 INFO:teuthology.task.kernel:Running kernel on smithi050: 5.14.0-361.el9.x86_64 2024-04-15T00:09:39.863 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum install -y kernel 2024-04-15T00:09:39.864 INFO:teuthology.orchestra.run.smithi031.stdout:5.14.0-361.el9.x86_64 2024-04-15T00:09:39.864 INFO:teuthology.task.kernel:Running kernel on smithi031: 5.14.0-361.el9.x86_64 2024-04-15T00:09:39.864 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum install -y kernel 2024-04-15T00:09:41.957 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-9 - AppStream 17 MB/s | 8.1 MB 00:00 2024-04-15T00:09:42.243 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS-9 - AppStream 11 MB/s | 8.1 MB 00:00 2024-04-15T00:09:43.632 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-9 - BaseOS 8.5 MB/s | 2.5 MB 00:00 2024-04-15T00:09:43.909 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS-9 - BaseOS 8.4 MB/s | 2.5 MB 00:00 2024-04-15T00:09:44.806 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-04-15T00:09:45.051 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-04-15T00:09:46.816 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-04-15T00:09:47.050 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-04-15T00:09:51.168 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - CRB 9.1 MB/s | 6.2 MB 00:00 2024-04-15T00:09:52.859 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 16 kB 00:00 2024-04-15T00:09:53.617 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - CRB 2.2 MB/s | 6.2 MB 00:02 2024-04-15T00:09:55.343 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 16 kB 00:00 2024-04-15T00:09:56.747 INFO:teuthology.orchestra.run.smithi031.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-04-15T00:10:02.044 INFO:teuthology.orchestra.run.smithi031.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-04-15T00:10:04.375 INFO:teuthology.orchestra.run.smithi031.stderr:Modular dependency problems: 2024-04-15T00:10:04.375 INFO:teuthology.orchestra.run.smithi031.stderr: 2024-04-15T00:10:04.375 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 1: conflicting requests 2024-04-15T00:10:04.376 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.376 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 2: conflicting requests 2024-04-15T00:10:04.376 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.376 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 3: conflicting requests 2024-04-15T00:10:04.376 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.376 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 4: conflicting requests 2024-04-15T00:10:04.376 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.376 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 5: conflicting requests 2024-04-15T00:10:04.376 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.376 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 6: conflicting requests 2024-04-15T00:10:04.376 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.376 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 7: conflicting requests 2024-04-15T00:10:04.376 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.376 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 8: conflicting requests 2024-04-15T00:10:04.376 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.377 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 9: conflicting requests 2024-04-15T00:10:04.377 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.377 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 10: conflicting requests 2024-04-15T00:10:04.377 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.377 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 11: conflicting requests 2024-04-15T00:10:04.377 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.377 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 12: conflicting requests 2024-04-15T00:10:04.377 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.377 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 13: conflicting requests 2024-04-15T00:10:04.377 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.377 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 14: conflicting requests 2024-04-15T00:10:04.377 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.377 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 15: conflicting requests 2024-04-15T00:10:04.377 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.377 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 16: conflicting requests 2024-04-15T00:10:04.378 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.378 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 17: conflicting requests 2024-04-15T00:10:04.378 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.378 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 18: conflicting requests 2024-04-15T00:10:04.378 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.378 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 19: conflicting requests 2024-04-15T00:10:04.378 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.378 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 20: conflicting requests 2024-04-15T00:10:04.378 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.378 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 21: conflicting requests 2024-04-15T00:10:04.378 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.378 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 22: conflicting requests 2024-04-15T00:10:04.378 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.379 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 23: conflicting requests 2024-04-15T00:10:04.379 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.379 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 24: conflicting requests 2024-04-15T00:10:04.379 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.379 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 25: conflicting requests 2024-04-15T00:10:04.379 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.379 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 26: conflicting requests 2024-04-15T00:10:04.379 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.379 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 27: conflicting requests 2024-04-15T00:10:04.379 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.379 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 28: conflicting requests 2024-04-15T00:10:04.379 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.379 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 29: conflicting requests 2024-04-15T00:10:04.379 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.379 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 30: conflicting requests 2024-04-15T00:10:04.379 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.380 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 31: conflicting requests 2024-04-15T00:10:04.380 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.380 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 32: conflicting requests 2024-04-15T00:10:04.380 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.380 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 33: conflicting requests 2024-04-15T00:10:04.380 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.380 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 34: conflicting requests 2024-04-15T00:10:04.380 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.380 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 35: conflicting requests 2024-04-15T00:10:04.380 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.380 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 36: conflicting requests 2024-04-15T00:10:04.380 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.380 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 37: conflicting requests 2024-04-15T00:10:04.380 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.380 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.381 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.381 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 38: cannot install the best candidate for the job 2024-04-15T00:10:04.381 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.381 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.381 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.381 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.381 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 39: conflicting requests 2024-04-15T00:10:04.381 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.381 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.381 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.381 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.381 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.381 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.381 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 40: cannot install the best candidate for the job 2024-04-15T00:10:04.381 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.382 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.382 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.382 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.382 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 41: cannot install the best candidate for the job 2024-04-15T00:10:04.382 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.382 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.382 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.382 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.382 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 42: cannot install the best candidate for the job 2024-04-15T00:10:04.382 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.382 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.382 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.382 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.382 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 43: cannot install the best candidate for the job 2024-04-15T00:10:04.383 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.383 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.383 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.383 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.383 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 44: cannot install the best candidate for the job 2024-04-15T00:10:04.383 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.383 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.383 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.383 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.383 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 45: cannot install the best candidate for the job 2024-04-15T00:10:04.383 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.383 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.383 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.383 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-15T00:10:04.743 INFO:teuthology.orchestra.run.smithi031.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-15T00:10:04.743 INFO:teuthology.orchestra.run.smithi031.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-15T00:10:04.848 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-15T00:10:04.859 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-15T00:10:04.859 INFO:teuthology.orchestra.run.smithi031.stdout: Package Architecture Version Repository Size 2024-04-15T00:10:04.859 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-15T00:10:04.859 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-04-15T00:10:04.859 INFO:teuthology.orchestra.run.smithi031.stdout: kernel x86_64 5.14.0-435.el9 baseos 214 k 2024-04-15T00:10:04.859 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-04-15T00:10:04.859 INFO:teuthology.orchestra.run.smithi031.stdout: kernel-core x86_64 5.14.0-435.el9 baseos 15 M 2024-04-15T00:10:04.859 INFO:teuthology.orchestra.run.smithi031.stdout: kernel-modules x86_64 5.14.0-435.el9 baseos 34 M 2024-04-15T00:10:04.859 INFO:teuthology.orchestra.run.smithi031.stdout: kernel-modules-core x86_64 5.14.0-435.el9 baseos 28 M 2024-04-15T00:10:04.859 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:10:04.859 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-04-15T00:10:04.859 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-15T00:10:04.859 INFO:teuthology.orchestra.run.smithi031.stdout:Install 4 Packages 2024-04-15T00:10:04.860 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:10:04.860 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 77 M 2024-04-15T00:10:04.860 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 123 M 2024-04-15T00:10:04.860 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-04-15T00:10:05.412 INFO:teuthology.orchestra.run.smithi031.stdout:(1/4): kernel-5.14.0-435.el9.x86_64.rpm 817 kB/s | 214 kB 00:00 2024-04-15T00:10:06.653 INFO:teuthology.orchestra.run.smithi031.stdout:(2/4): kernel-core-5.14.0-435.el9.x86_64.rpm 10 MB/s | 15 MB 00:01 2024-04-15T00:10:06.962 INFO:teuthology.orchestra.run.smithi031.stdout:(3/4): kernel-modules-5.14.0-435.el9.x86_64.rpm 19 MB/s | 34 MB 00:01 2024-04-15T00:10:07.237 INFO:teuthology.orchestra.run.smithi031.stdout:(4/4): kernel-modules-core-5.14.0-435.el9.x86_6 15 MB/s | 28 MB 00:01 2024-04-15T00:10:07.240 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-04-15T00:10:07.240 INFO:teuthology.orchestra.run.smithi031.stdout:Total 32 MB/s | 77 MB 00:02 2024-04-15T00:10:07.942 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-04-15T00:10:08.359 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-04-15T00:10:08.359 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-04-15T00:10:09.402 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-04-15T00:10:09.402 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-04-15T00:10:09.433 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 1.3 MB/s | 21 MB 00:16 2024-04-15T00:10:11.988 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-04-15T00:10:12.621 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : kernel-modules-core-5.14.0-435.el9.x86_64 1/4 2024-04-15T00:10:12.705 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-15T00:10:14.675 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 49 kB/s | 1.7 kB 00:00 2024-04-15T00:10:15.602 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-15T00:10:15.738 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-15T00:10:17.022 INFO:teuthology.orchestra.run.smithi050.stderr:Modular dependency problems: 2024-04-15T00:10:17.022 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-04-15T00:10:17.022 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 1: conflicting requests 2024-04-15T00:10:17.022 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.022 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 2: conflicting requests 2024-04-15T00:10:17.022 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.023 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 3: conflicting requests 2024-04-15T00:10:17.023 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.023 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 4: conflicting requests 2024-04-15T00:10:17.023 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.023 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 5: conflicting requests 2024-04-15T00:10:17.023 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.023 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 6: conflicting requests 2024-04-15T00:10:17.023 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.023 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 7: conflicting requests 2024-04-15T00:10:17.023 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.023 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 8: conflicting requests 2024-04-15T00:10:17.024 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.024 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 9: conflicting requests 2024-04-15T00:10:17.024 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.024 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 10: conflicting requests 2024-04-15T00:10:17.024 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.024 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 11: conflicting requests 2024-04-15T00:10:17.024 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.024 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 12: conflicting requests 2024-04-15T00:10:17.024 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.024 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 13: conflicting requests 2024-04-15T00:10:17.024 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.024 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 14: conflicting requests 2024-04-15T00:10:17.024 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.024 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 15: conflicting requests 2024-04-15T00:10:17.024 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.025 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 16: conflicting requests 2024-04-15T00:10:17.025 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.025 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 17: conflicting requests 2024-04-15T00:10:17.025 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.025 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 18: conflicting requests 2024-04-15T00:10:17.025 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.025 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 19: conflicting requests 2024-04-15T00:10:17.025 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.025 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 20: conflicting requests 2024-04-15T00:10:17.025 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.025 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 21: conflicting requests 2024-04-15T00:10:17.025 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.025 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 22: conflicting requests 2024-04-15T00:10:17.025 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.026 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 23: conflicting requests 2024-04-15T00:10:17.026 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.026 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 24: conflicting requests 2024-04-15T00:10:17.026 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.026 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 25: conflicting requests 2024-04-15T00:10:17.026 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.026 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 26: conflicting requests 2024-04-15T00:10:17.026 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.026 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 27: conflicting requests 2024-04-15T00:10:17.026 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.026 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 28: conflicting requests 2024-04-15T00:10:17.026 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.026 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 29: conflicting requests 2024-04-15T00:10:17.026 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.026 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 30: conflicting requests 2024-04-15T00:10:17.027 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.027 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 31: conflicting requests 2024-04-15T00:10:17.027 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.027 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 32: conflicting requests 2024-04-15T00:10:17.027 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.027 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 33: conflicting requests 2024-04-15T00:10:17.027 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.027 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 34: conflicting requests 2024-04-15T00:10:17.027 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.027 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 35: conflicting requests 2024-04-15T00:10:17.027 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.027 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 36: conflicting requests 2024-04-15T00:10:17.027 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.027 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 37: conflicting requests 2024-04-15T00:10:17.027 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.028 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.028 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.028 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 38: cannot install the best candidate for the job 2024-04-15T00:10:17.028 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.028 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.028 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.028 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.028 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 39: conflicting requests 2024-04-15T00:10:17.028 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.028 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.028 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.028 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.028 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.028 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.028 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 40: cannot install the best candidate for the job 2024-04-15T00:10:17.029 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.029 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.029 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.029 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.029 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 41: cannot install the best candidate for the job 2024-04-15T00:10:17.029 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.029 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.029 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.029 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.029 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 42: cannot install the best candidate for the job 2024-04-15T00:10:17.029 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.029 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.029 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.029 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.029 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 43: cannot install the best candidate for the job 2024-04-15T00:10:17.030 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.030 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.030 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.030 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.030 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 44: cannot install the best candidate for the job 2024-04-15T00:10:17.030 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.030 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.030 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.030 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.030 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 45: cannot install the best candidate for the job 2024-04-15T00:10:17.030 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.030 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.030 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.030 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-15T00:10:17.391 INFO:teuthology.orchestra.run.smithi050.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-15T00:10:17.391 INFO:teuthology.orchestra.run.smithi050.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-15T00:10:17.505 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-04-15T00:10:17.511 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-04-15T00:10:17.512 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2024-04-15T00:10:17.512 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-04-15T00:10:17.512 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2024-04-15T00:10:17.512 INFO:teuthology.orchestra.run.smithi050.stdout: kernel x86_64 5.14.0-435.el9 baseos 214 k 2024-04-15T00:10:17.512 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2024-04-15T00:10:17.512 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-core x86_64 5.14.0-435.el9 baseos 15 M 2024-04-15T00:10:17.512 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules x86_64 5.14.0-435.el9 baseos 34 M 2024-04-15T00:10:17.512 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules-core x86_64 5.14.0-435.el9 baseos 28 M 2024-04-15T00:10:17.512 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:10:17.512 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-04-15T00:10:17.512 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-04-15T00:10:17.512 INFO:teuthology.orchestra.run.smithi050.stdout:Install 4 Packages 2024-04-15T00:10:17.512 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:10:17.513 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 77 M 2024-04-15T00:10:17.513 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 123 M 2024-04-15T00:10:17.513 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2024-04-15T00:10:17.893 INFO:teuthology.orchestra.run.smithi050.stdout:(1/4): kernel-5.14.0-435.el9.x86_64.rpm 804 kB/s | 214 kB 00:00 2024-04-15T00:10:19.469 INFO:teuthology.orchestra.run.smithi050.stdout:(2/4): kernel-core-5.14.0-435.el9.x86_64.rpm 8.2 MB/s | 15 MB 00:01 2024-04-15T00:10:20.152 INFO:teuthology.orchestra.run.smithi050.stdout:(3/4): kernel-modules-core-5.14.0-435.el9.x86_6 12 MB/s | 28 MB 00:02 2024-04-15T00:10:20.478 INFO:teuthology.orchestra.run.smithi050.stdout:(4/4): kernel-modules-5.14.0-435.el9.x86_64.rpm 12 MB/s | 34 MB 00:02 2024-04-15T00:10:20.478 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-04-15T00:10:20.478 INFO:teuthology.orchestra.run.smithi050.stdout:Total 26 MB/s | 77 MB 00:02 2024-04-15T00:10:20.816 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-15T00:10:20.856 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : kernel-5.14.0-435.el9.x86_64 4/4 2024-04-15T00:10:21.176 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2024-04-15T00:10:21.593 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2024-04-15T00:10:21.594 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2024-04-15T00:10:22.654 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2024-04-15T00:10:22.654 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2024-04-15T00:10:25.267 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2024-04-15T00:10:25.879 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-modules-core-5.14.0-435.el9.x86_64 1/4 2024-04-15T00:10:25.951 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-15T00:10:25.970 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-15T00:10:28.865 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-15T00:10:29.008 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-15T00:10:34.081 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-15T00:10:34.126 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-5.14.0-435.el9.x86_64 4/4 2024-04-15T00:10:39.223 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-15T00:10:56.854 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 4/4 2024-04-15T00:10:56.854 INFO:teuthology.orchestra.run.smithi031.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-15T00:10:56.854 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:10:56.901 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 4/4 2024-04-15T00:10:57.231 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: kernel-5.14.0-435.el9.x86_64 4/4 2024-04-15T00:10:57.231 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : kernel-5.14.0-435.el9.x86_64 1/4 2024-04-15T00:10:57.231 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-15T00:10:57.231 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-15T00:10:57.676 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-15T00:10:57.676 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:10:57.676 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-04-15T00:10:57.676 INFO:teuthology.orchestra.run.smithi031.stdout: kernel-5.14.0-435.el9.x86_64 2024-04-15T00:10:57.677 INFO:teuthology.orchestra.run.smithi031.stdout: kernel-core-5.14.0-435.el9.x86_64 2024-04-15T00:10:57.677 INFO:teuthology.orchestra.run.smithi031.stdout: kernel-modules-5.14.0-435.el9.x86_64 2024-04-15T00:10:57.677 INFO:teuthology.orchestra.run.smithi031.stdout: kernel-modules-core-5.14.0-435.el9.x86_64 2024-04-15T00:10:57.677 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:10:57.677 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-15T00:10:58.025 DEBUG:teuthology.orchestra.run.smithi031:> rpm -q kernel | sort -rV | head -n 1 2024-04-15T00:10:58.170 INFO:teuthology.orchestra.run.smithi031.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-15T00:10:58.171 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-15T00:10:58.171 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-435.el9.x86_64 2024-04-15T00:10:58.171 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-15T00:10:58.171 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-15T00:10:58.171 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-15T00:10:58.171 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi031.front.sepia.ceph.com, path=None, version=distro) 2024-04-15T00:10:58.171 DEBUG:teuthology.orchestra.run.smithi031:> rpm -q kernel | sort -rV | head -n 1 2024-04-15T00:10:58.255 INFO:teuthology.orchestra.run.smithi031.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-15T00:10:58.256 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-15T00:10:58.256 DEBUG:teuthology.orchestra.run.smithi031:> sudo rpm -qi grub2-tools 2024-04-15T00:10:58.294 INFO:teuthology.orchestra.run.smithi031.stdout:Name : grub2-tools 2024-04-15T00:10:58.294 INFO:teuthology.orchestra.run.smithi031.stdout:Epoch : 1 2024-04-15T00:10:58.295 INFO:teuthology.orchestra.run.smithi031.stdout:Version : 2.06 2024-04-15T00:10:58.295 INFO:teuthology.orchestra.run.smithi031.stdout:Release : 68.el9 2024-04-15T00:10:58.295 INFO:teuthology.orchestra.run.smithi031.stdout:Architecture: x86_64 2024-04-15T00:10:58.295 INFO:teuthology.orchestra.run.smithi031.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-15T00:10:58.295 INFO:teuthology.orchestra.run.smithi031.stdout:Group : Unspecified 2024-04-15T00:10:58.295 INFO:teuthology.orchestra.run.smithi031.stdout:Size : 8264254 2024-04-15T00:10:58.295 INFO:teuthology.orchestra.run.smithi031.stdout:License : GPLv3+ 2024-04-15T00:10:58.295 INFO:teuthology.orchestra.run.smithi031.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-15T00:10:58.295 INFO:teuthology.orchestra.run.smithi031.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-15T00:10:58.295 INFO:teuthology.orchestra.run.smithi031.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-15T00:10:58.295 INFO:teuthology.orchestra.run.smithi031.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-15T00:10:58.295 INFO:teuthology.orchestra.run.smithi031.stdout:Packager : builder@centos.org 2024-04-15T00:10:58.295 INFO:teuthology.orchestra.run.smithi031.stdout:Vendor : CentOS 2024-04-15T00:10:58.295 INFO:teuthology.orchestra.run.smithi031.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-15T00:10:58.295 INFO:teuthology.orchestra.run.smithi031.stdout:Summary : Support tools for GRUB. 2024-04-15T00:10:58.296 INFO:teuthology.orchestra.run.smithi031.stdout:Description : 2024-04-15T00:10:58.296 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:10:58.296 INFO:teuthology.orchestra.run.smithi031.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-15T00:10:58.296 INFO:teuthology.orchestra.run.smithi031.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-15T00:10:58.296 INFO:teuthology.orchestra.run.smithi031.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-15T00:10:58.296 INFO:teuthology.orchestra.run.smithi031.stdout:hardware devices. 2024-04-15T00:10:58.296 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:10:58.296 INFO:teuthology.orchestra.run.smithi031.stdout:This subpackage provides tools for support of all platforms. 2024-04-15T00:10:58.297 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-15T00:10:58.297 INFO:teuthology.task.kernel:Updating grub on smithi031 to boot 5.14.0-435.el9.x86_64 2024-04-15T00:10:58.297 DEBUG:teuthology.orchestra.run.smithi031:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-15T00:10:58.899 INFO:teuthology.orchestra.run.smithi031.stderr:Generating grub configuration file ... 2024-04-15T00:11:00.309 INFO:teuthology.orchestra.run.smithi031.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-15T00:11:00.345 INFO:teuthology.orchestra.run.smithi031.stderr:done 2024-04-15T00:11:00.348 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2024-04-15T00:11:00.363 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.VAUtnKhynM 2024-04-15T00:11:00.364 DEBUG:teuthology.orchestra.run.smithi031:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.VAUtnKhynM 2024-04-15T00:11:00.436 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.VAUtnKhynM 2024-04-15T00:11:00.581 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.VAUtnKhynM is 6KB 2024-04-15T00:11:00.630 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.VAUtnKhynM 2024-04-15T00:11:00.645 DEBUG:teuthology.orchestra.run.smithi031:> sudo /bin/ls /boot/loader/entries || true 2024-04-15T00:11:00.713 INFO:teuthology.orchestra.run.smithi031.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-15T00:11:00.713 INFO:teuthology.orchestra.run.smithi031.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-15T00:11:00.713 INFO:teuthology.orchestra.run.smithi031.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-15T00:11:00.713 INFO:teuthology.orchestra.run.smithi031.stdout:15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64.conf 2024-04-15T00:11:00.714 DEBUG:teuthology.orchestra.run.smithi031:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64 2024-04-15T00:11:00.874 DEBUG:teuthology.orchestra.run.smithi031:> sudo shutdown -r now 2024-04-15T00:11:09.828 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 4/4 2024-04-15T00:11:09.828 INFO:teuthology.orchestra.run.smithi050.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-15T00:11:09.828 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:11:09.875 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 4/4 2024-04-15T00:11:10.249 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-5.14.0-435.el9.x86_64 4/4 2024-04-15T00:11:10.249 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-5.14.0-435.el9.x86_64 1/4 2024-04-15T00:11:10.249 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-15T00:11:10.249 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-15T00:11:10.682 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-15T00:11:10.682 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:11:10.683 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2024-04-15T00:11:10.683 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-5.14.0-435.el9.x86_64 2024-04-15T00:11:10.683 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-core-5.14.0-435.el9.x86_64 2024-04-15T00:11:10.683 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules-5.14.0-435.el9.x86_64 2024-04-15T00:11:10.683 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules-core-5.14.0-435.el9.x86_64 2024-04-15T00:11:10.683 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:11:10.683 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-04-15T00:11:11.005 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q kernel | sort -rV | head -n 1 2024-04-15T00:11:11.102 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-15T00:11:11.102 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-15T00:11:11.102 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-435.el9.x86_64 2024-04-15T00:11:11.102 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-15T00:11:11.102 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-15T00:11:11.102 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-15T00:11:11.102 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi050.front.sepia.ceph.com, path=None, version=distro) 2024-04-15T00:11:11.102 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q kernel | sort -rV | head -n 1 2024-04-15T00:11:11.187 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-15T00:11:11.187 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-15T00:11:11.187 DEBUG:teuthology.orchestra.run.smithi050:> sudo rpm -qi grub2-tools 2024-04-15T00:11:11.224 INFO:teuthology.orchestra.run.smithi050.stdout:Name : grub2-tools 2024-04-15T00:11:11.224 INFO:teuthology.orchestra.run.smithi050.stdout:Epoch : 1 2024-04-15T00:11:11.224 INFO:teuthology.orchestra.run.smithi050.stdout:Version : 2.06 2024-04-15T00:11:11.224 INFO:teuthology.orchestra.run.smithi050.stdout:Release : 68.el9 2024-04-15T00:11:11.224 INFO:teuthology.orchestra.run.smithi050.stdout:Architecture: x86_64 2024-04-15T00:11:11.224 INFO:teuthology.orchestra.run.smithi050.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-15T00:11:11.224 INFO:teuthology.orchestra.run.smithi050.stdout:Group : Unspecified 2024-04-15T00:11:11.225 INFO:teuthology.orchestra.run.smithi050.stdout:Size : 8264254 2024-04-15T00:11:11.225 INFO:teuthology.orchestra.run.smithi050.stdout:License : GPLv3+ 2024-04-15T00:11:11.225 INFO:teuthology.orchestra.run.smithi050.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-15T00:11:11.225 INFO:teuthology.orchestra.run.smithi050.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-15T00:11:11.225 INFO:teuthology.orchestra.run.smithi050.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-15T00:11:11.225 INFO:teuthology.orchestra.run.smithi050.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-15T00:11:11.225 INFO:teuthology.orchestra.run.smithi050.stdout:Packager : builder@centos.org 2024-04-15T00:11:11.225 INFO:teuthology.orchestra.run.smithi050.stdout:Vendor : CentOS 2024-04-15T00:11:11.225 INFO:teuthology.orchestra.run.smithi050.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-15T00:11:11.225 INFO:teuthology.orchestra.run.smithi050.stdout:Summary : Support tools for GRUB. 2024-04-15T00:11:11.225 INFO:teuthology.orchestra.run.smithi050.stdout:Description : 2024-04-15T00:11:11.225 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:11:11.225 INFO:teuthology.orchestra.run.smithi050.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-15T00:11:11.225 INFO:teuthology.orchestra.run.smithi050.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-15T00:11:11.226 INFO:teuthology.orchestra.run.smithi050.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-15T00:11:11.226 INFO:teuthology.orchestra.run.smithi050.stdout:hardware devices. 2024-04-15T00:11:11.226 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:11:11.226 INFO:teuthology.orchestra.run.smithi050.stdout:This subpackage provides tools for support of all platforms. 2024-04-15T00:11:11.227 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-15T00:11:11.227 INFO:teuthology.task.kernel:Updating grub on smithi050 to boot 5.14.0-435.el9.x86_64 2024-04-15T00:11:11.227 DEBUG:teuthology.orchestra.run.smithi050:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-15T00:11:11.981 INFO:teuthology.orchestra.run.smithi050.stderr:Generating grub configuration file ... 2024-04-15T00:11:13.351 INFO:teuthology.orchestra.run.smithi050.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-15T00:11:13.395 INFO:teuthology.orchestra.run.smithi050.stderr:done 2024-04-15T00:11:13.397 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2024-04-15T00:11:13.412 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.9TDEEz4naN 2024-04-15T00:11:13.412 DEBUG:teuthology.orchestra.run.smithi050:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.9TDEEz4naN 2024-04-15T00:11:13.484 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.9TDEEz4naN 2024-04-15T00:11:13.625 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.9TDEEz4naN is 6KB 2024-04-15T00:11:13.674 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.9TDEEz4naN 2024-04-15T00:11:13.689 DEBUG:teuthology.orchestra.run.smithi050:> sudo /bin/ls /boot/loader/entries || true 2024-04-15T00:11:13.757 INFO:teuthology.orchestra.run.smithi050.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-15T00:11:13.757 INFO:teuthology.orchestra.run.smithi050.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-15T00:11:13.757 INFO:teuthology.orchestra.run.smithi050.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-15T00:11:13.757 INFO:teuthology.orchestra.run.smithi050.stdout:15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64.conf 2024-04-15T00:11:13.758 DEBUG:teuthology.orchestra.run.smithi050:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64 2024-04-15T00:11:14.049 DEBUG:teuthology.orchestra.run.smithi050:> sudo shutdown -r now 2024-04-15T00:11:30.893 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-15T00:11:30.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-04-15T00:11:30.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:11:44.056 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-15T00:11:44.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-04-15T00:11:44.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:12:02.462 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.50 2024-04-15T00:12:11.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-04-15T00:12:11.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:12:30.915 DEBUG:teuthology.orchestra.remote:timed out 2024-04-15T00:12:39.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-04-15T00:12:39.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:12:40.335 DEBUG:teuthology.orchestra.run.smithi031:> true 2024-04-15T00:12:40.700 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-04-15T00:12:40.700 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-435.el9.x86_64"... 2024-04-15T00:12:40.700 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2024-04-15T00:12:40.715 INFO:teuthology.orchestra.run.smithi031.stdout:5.14.0-435.el9.x86_64 2024-04-15T00:12:40.715 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-435.el9.x86_64 vs 5.14.0-435.el9.x86_64 2024-04-15T00:12:40.716 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-15T00:12:40.716 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-15T00:12:41.717 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-15T00:12:41.717 DEBUG:teuthology.orchestra.run.smithi031:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-15T00:12:41.807 INFO:teuthology.orchestra.run.smithi031.stdout:ttyS1 2024-04-15T00:12:41.841 DEBUG:teuthology.parallel:result is None 2024-04-15T00:13:11.474 DEBUG:teuthology.orchestra.remote:timed out 2024-04-15T00:13:23.475 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-04-15T00:13:23.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:13:23.800 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-04-15T00:13:24.197 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-04-15T00:13:24.197 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-435.el9.x86_64"... 2024-04-15T00:13:24.198 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2024-04-15T00:13:24.213 INFO:teuthology.orchestra.run.smithi050.stdout:5.14.0-435.el9.x86_64 2024-04-15T00:13:24.213 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-435.el9.x86_64 vs 5.14.0-435.el9.x86_64 2024-04-15T00:13:24.213 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-15T00:13:24.213 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-15T00:13:25.214 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-15T00:13:25.215 DEBUG:teuthology.orchestra.run.smithi050:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-15T00:13:25.308 INFO:teuthology.orchestra.run.smithi050.stdout:ttyS1 2024-04-15T00:13:25.343 DEBUG:teuthology.parallel:result is None 2024-04-15T00:13:25.344 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-15T00:13:25.352 INFO:teuthology.task.internal:Creating test directory... 2024-04-15T00:13:25.352 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-15T00:13:25.354 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-15T00:13:25.371 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-15T00:13:25.377 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-15T00:13:25.439 INFO:teuthology.task.internal:Creating archive directory... 2024-04-15T00:13:25.439 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-15T00:13:25.442 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-15T00:13:25.475 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-15T00:13:25.481 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-15T00:13:25.482 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-15T00:13:25.510 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-15T00:13:25.549 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-15T00:13:25.551 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-15T00:13:25.563 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-15T00:13:25.565 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-15T00:13:25.567 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-15T00:13:25.574 INFO:teuthology.task.internal:Configuring sudo... 2024-04-15T00:13:25.574 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-15T00:13:25.607 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-15T00:13:25.637 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-15T00:13:25.646 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-15T00:13:25.646 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-15T00:13:25.677 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-15T00:13:25.692 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-15T00:13:25.773 DEBUG:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-15T00:13:25.825 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-15T00:13:25.908 DEBUG:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-15T00:13:25.950 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-15T00:13:25.950 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-15T00:13:26.017 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-15T00:13:26.062 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-15T00:13:26.110 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-15T00:13:26.199 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-15T00:13:26.236 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-15T00:13:26.237 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-15T00:13:26.305 DEBUG:teuthology.orchestra.run.smithi031:> sudo service rsyslog restart 2024-04-15T00:13:26.308 DEBUG:teuthology.orchestra.run.smithi050:> sudo service rsyslog restart 2024-04-15T00:13:26.346 INFO:teuthology.orchestra.run.smithi031.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-15T00:13:26.397 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-15T00:13:26.908 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-15T00:13:26.915 INFO:teuthology.task.internal:Starting timer... 2024-04-15T00:13:26.915 INFO:teuthology.run_tasks:Running task pcp... 2024-04-15T00:13:26.924 INFO:teuthology.run_tasks:Running task selinux... 2024-04-15T00:13:26.932 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-15T00:13:26.932 DEBUG:teuthology.orchestra.run.smithi031:> sudo service auditd rotate 2024-04-15T00:13:26.996 INFO:teuthology.orchestra.run.smithi031.stdout:Rotating logs: 2024-04-15T00:13:26.999 DEBUG:teuthology.orchestra.run.smithi050:> sudo service auditd rotate 2024-04-15T00:13:27.062 INFO:teuthology.orchestra.run.smithi050.stdout:Rotating logs: 2024-04-15T00:13:27.064 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-15T00:13:27.064 DEBUG:teuthology.orchestra.run.smithi031:> /usr/sbin/getenforce 2024-04-15T00:13:27.095 INFO:teuthology.orchestra.run.smithi031.stdout:Permissive 2024-04-15T00:13:27.095 DEBUG:teuthology.orchestra.run.smithi050:> /usr/sbin/getenforce 2024-04-15T00:13:27.126 INFO:teuthology.orchestra.run.smithi050.stdout:Permissive 2024-04-15T00:13:27.126 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi031.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi050.front.sepia.ceph.com': 'permissive'} 2024-04-15T00:13:27.126 DEBUG:teuthology.orchestra.run.smithi031:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-15T00:13:27.166 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T00:13:27.167 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-15T00:13:27.195 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T00:13:27.195 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-15T00:13:27.195 DEBUG:teuthology.orchestra.run.smithi031:> sudo /usr/sbin/setenforce permissive 2024-04-15T00:13:27.238 DEBUG:teuthology.orchestra.run.smithi050:> sudo /usr/sbin/setenforce permissive 2024-04-15T00:13:27.270 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-15T00:13:27.279 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-15T00:13:27.297 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-15T00:13:27.299 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi031.front.sepia.ceph.com,smithi050.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-15T00:18:01.594 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi031.front.sepia.ceph.com'), Remote(name='ubuntu@smithi050.front.sepia.ceph.com')] 2024-04-15T00:18:01.596 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-04-15T00:18:01.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:18:01.691 DEBUG:teuthology.orchestra.run.smithi031:> true 2024-04-15T00:18:01.770 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-04-15T00:18:01.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-04-15T00:18:01.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T00:18:01.865 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-04-15T00:18:01.943 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-04-15T00:18:01.943 INFO:teuthology.run_tasks:Running task clock... 2024-04-15T00:18:01.955 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-15T00:18:01.956 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-15T00:18:01.956 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-15T00:18:01.959 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-15T00:18:01.959 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-15T00:18:01.988 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-15T00:18:02.005 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-15T00:18:02.016 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-15T00:18:02.034 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-15T00:18:02.035 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: ntpd: command not found 2024-04-15T00:18:02.049 INFO:teuthology.orchestra.run.smithi031.stdout:506 Cannot talk to daemon 2024-04-15T00:18:02.064 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: ntpd: command not found 2024-04-15T00:18:02.066 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-15T00:18:02.078 INFO:teuthology.orchestra.run.smithi050.stdout:506 Cannot talk to daemon 2024-04-15T00:18:02.083 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-15T00:18:02.095 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-15T00:18:02.112 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-15T00:18:02.136 INFO:teuthology.orchestra.run.smithi031.stderr:bash: line 1: ntpq: command not found 2024-04-15T00:18:02.139 INFO:teuthology.orchestra.run.smithi031.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-15T00:18:02.139 INFO:teuthology.orchestra.run.smithi031.stdout:=============================================================================== 2024-04-15T00:18:02.140 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T00:18:02.140 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T00:18:02.140 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T00:18:02.140 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T00:18:02.169 INFO:teuthology.orchestra.run.smithi050.stderr:bash: line 1: ntpq: command not found 2024-04-15T00:18:02.173 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-15T00:18:02.173 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2024-04-15T00:18:02.173 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T00:18:02.173 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T00:18:02.173 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T00:18:02.173 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T00:18:02.174 INFO:teuthology.run_tasks:Running task install... 2024-04-15T00:18:02.183 DEBUG:teuthology.task.install:project ceph 2024-04-15T00:18:02.183 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765'}} 2024-04-15T00:18:02.183 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765'} 2024-04-15T00:18:02.183 INFO:teuthology.task.install:Using flavor: default 2024-04-15T00:18:02.189 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-15T00:18:02.189 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-15T00:18:02.190 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765', 'tag': None, 'wait_for_package': False} 2024-04-15T00:18:02.190 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 2024-04-15T00:18:02.192 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765', 'tag': None, 'wait_for_package': False} 2024-04-15T00:18:02.193 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 2024-04-15T00:18:02.349 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/ 2024-04-15T00:18:02.349 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2114.ga9a752df 2024-04-15T00:18:02.428 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/ 2024-04-15T00:18:02.428 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2114.ga9a752df 2024-04-15T00:18:02.533 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-15T00:18:02.533 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-15T00:18:02.533 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-15T00:18:02.542 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-15T00:18:02.542 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-15T00:18:02.542 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-15T00:18:02.563 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-15T00:18:02.563 DEBUG:teuthology.orchestra.run.smithi050:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a9a752df26c63acad72e1b3569fd79a515ca0765/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-15T00:18:02.570 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-15T00:18:02.571 DEBUG:teuthology.orchestra.run.smithi031:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a9a752df26c63acad72e1b3569fd79a515ca0765/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-15T00:18:02.631 DEBUG:teuthology.orchestra.run.smithi050:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-15T00:18:02.639 DEBUG:teuthology.orchestra.run.smithi031:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-15T00:18:02.712 DEBUG:teuthology.orchestra.run.smithi050:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-15T00:18:02.718 DEBUG:teuthology.orchestra.run.smithi031:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-15T00:18:02.779 INFO:teuthology.orchestra.run.smithi050.stdout:check_obsoletes = 1 2024-04-15T00:18:02.781 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum clean all 2024-04-15T00:18:02.784 INFO:teuthology.orchestra.run.smithi031.stdout:check_obsoletes = 1 2024-04-15T00:18:02.786 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum clean all 2024-04-15T00:18:03.031 INFO:teuthology.orchestra.run.smithi031.stdout:74 files removed 2024-04-15T00:18:03.038 INFO:teuthology.orchestra.run.smithi050.stdout:74 files removed 2024-04-15T00:18:03.058 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-15T00:18:03.066 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-15T00:18:03.751 INFO:teuthology.orchestra.run.smithi050.stdout:ceph packages for x86_64 220 kB/s | 83 kB 00:00 2024-04-15T00:18:03.754 INFO:teuthology.orchestra.run.smithi031.stdout:ceph packages for x86_64 212 kB/s | 83 kB 00:00 2024-04-15T00:18:04.118 INFO:teuthology.orchestra.run.smithi050.stdout:ceph noarch packages 36 kB/s | 11 kB 00:00 2024-04-15T00:18:04.121 INFO:teuthology.orchestra.run.smithi031.stdout:ceph noarch packages 36 kB/s | 11 kB 00:00 2024-04-15T00:18:04.513 INFO:teuthology.orchestra.run.smithi031.stdout:ceph source packages 5.4 kB/s | 1.9 kB 00:00 2024-04-15T00:18:04.543 INFO:teuthology.orchestra.run.smithi050.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-04-15T00:18:04.974 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS-9 - AppStream 19 MB/s | 8.1 MB 00:00 2024-04-15T00:18:05.021 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-9 - AppStream 19 MB/s | 8.1 MB 00:00 2024-04-15T00:18:06.650 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS-9 - BaseOS 8.6 MB/s | 2.5 MB 00:00 2024-04-15T00:18:06.704 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-9 - BaseOS 8.4 MB/s | 2.5 MB 00:00 2024-04-15T00:18:07.737 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-04-15T00:18:08.307 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - BaseOS 6.9 MB/s | 8.0 MB 00:01 2024-04-15T00:18:11.383 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - AppStream 9.8 MB/s | 19 MB 00:01 2024-04-15T00:18:15.246 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - AppStream 3.0 MB/s | 19 MB 00:06 2024-04-15T00:18:15.517 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.2 MB 00:00 2024-04-15T00:18:17.176 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 16 kB 00:00 2024-04-15T00:18:18.205 INFO:teuthology.orchestra.run.smithi031.stdout:Extra Packages for Enterprise Linux 24 MB/s | 21 MB 00:00 2024-04-15T00:18:19.530 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-15T00:18:21.123 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 16 kB 00:00 2024-04-15T00:18:22.786 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-04-15T00:18:23.489 INFO:teuthology.orchestra.run.smithi031.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-04-15T00:18:26.195 INFO:teuthology.orchestra.run.smithi031.stderr:Modular dependency problems: 2024-04-15T00:18:26.196 INFO:teuthology.orchestra.run.smithi031.stderr: 2024-04-15T00:18:26.196 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 1: conflicting requests 2024-04-15T00:18:26.196 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.196 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 2: conflicting requests 2024-04-15T00:18:26.196 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.196 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 3: conflicting requests 2024-04-15T00:18:26.196 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.196 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 4: conflicting requests 2024-04-15T00:18:26.196 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.196 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 5: conflicting requests 2024-04-15T00:18:26.196 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.197 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 6: conflicting requests 2024-04-15T00:18:26.197 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.197 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 7: conflicting requests 2024-04-15T00:18:26.197 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.197 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 8: conflicting requests 2024-04-15T00:18:26.197 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.197 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 9: conflicting requests 2024-04-15T00:18:26.197 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.197 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 10: conflicting requests 2024-04-15T00:18:26.197 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.197 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 11: conflicting requests 2024-04-15T00:18:26.197 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.197 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 12: conflicting requests 2024-04-15T00:18:26.198 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.198 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 13: conflicting requests 2024-04-15T00:18:26.198 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.198 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 14: conflicting requests 2024-04-15T00:18:26.198 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.198 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 15: conflicting requests 2024-04-15T00:18:26.198 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.198 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 16: conflicting requests 2024-04-15T00:18:26.198 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.198 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 17: conflicting requests 2024-04-15T00:18:26.198 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.198 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 18: conflicting requests 2024-04-15T00:18:26.199 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.199 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 19: conflicting requests 2024-04-15T00:18:26.199 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.199 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 20: conflicting requests 2024-04-15T00:18:26.199 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.199 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 21: conflicting requests 2024-04-15T00:18:26.199 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.199 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 22: conflicting requests 2024-04-15T00:18:26.199 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.199 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 23: conflicting requests 2024-04-15T00:18:26.199 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.199 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 24: conflicting requests 2024-04-15T00:18:26.199 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.199 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 25: conflicting requests 2024-04-15T00:18:26.200 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.200 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 26: conflicting requests 2024-04-15T00:18:26.200 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.200 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 27: conflicting requests 2024-04-15T00:18:26.200 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.200 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 28: conflicting requests 2024-04-15T00:18:26.200 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.200 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 29: conflicting requests 2024-04-15T00:18:26.200 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.200 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 30: conflicting requests 2024-04-15T00:18:26.200 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.200 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 31: conflicting requests 2024-04-15T00:18:26.200 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.200 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 32: conflicting requests 2024-04-15T00:18:26.201 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.201 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 33: conflicting requests 2024-04-15T00:18:26.201 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.201 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 34: conflicting requests 2024-04-15T00:18:26.201 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.201 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 35: conflicting requests 2024-04-15T00:18:26.201 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.201 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 36: conflicting requests 2024-04-15T00:18:26.201 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.201 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 37: conflicting requests 2024-04-15T00:18:26.201 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.201 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.201 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.201 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 38: cannot install the best candidate for the job 2024-04-15T00:18:26.202 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.202 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.202 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.202 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.202 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 39: conflicting requests 2024-04-15T00:18:26.202 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.202 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.202 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.202 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.202 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.202 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.202 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 40: cannot install the best candidate for the job 2024-04-15T00:18:26.202 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.202 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.203 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.203 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.203 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 41: cannot install the best candidate for the job 2024-04-15T00:18:26.203 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.203 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.203 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.203 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.203 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 42: cannot install the best candidate for the job 2024-04-15T00:18:26.203 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.203 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.203 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.204 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.204 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 43: cannot install the best candidate for the job 2024-04-15T00:18:26.204 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.204 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.204 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.204 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.205 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 44: cannot install the best candidate for the job 2024-04-15T00:18:26.205 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.205 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.205 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.205 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.205 INFO:teuthology.orchestra.run.smithi031.stderr: Problem 45: cannot install the best candidate for the job 2024-04-15T00:18:26.205 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.206 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.206 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.206 INFO:teuthology.orchestra.run.smithi031.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-15T00:18:26.683 INFO:teuthology.orchestra.run.smithi031.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-15T00:18:26.684 INFO:teuthology.orchestra.run.smithi031.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-15T00:18:26.697 INFO:teuthology.orchestra.run.smithi031.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-15T00:18:26.698 INFO:teuthology.orchestra.run.smithi031.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-15T00:18:26.699 INFO:teuthology.orchestra.run.smithi031.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-15T00:18:26.700 INFO:teuthology.orchestra.run.smithi031.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-15T00:18:26.702 INFO:teuthology.orchestra.run.smithi031.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-15T00:18:26.705 INFO:teuthology.orchestra.run.smithi031.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-15T00:18:26.706 INFO:teuthology.orchestra.run.smithi031.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-15T00:18:26.806 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-15T00:18:26.829 INFO:teuthology.orchestra.run.smithi031.stdout:========================================================================================= 2024-04-15T00:18:26.829 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2024-04-15T00:18:26.829 INFO:teuthology.orchestra.run.smithi031.stdout:========================================================================================= 2024-04-15T00:18:26.830 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-04-15T00:18:26.830 INFO:teuthology.orchestra.run.smithi031.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-15T00:18:26.830 INFO:teuthology.orchestra.run.smithi031.stdout: ceph x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 6.6 k 2024-04-15T00:18:26.830 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 5.3 M 2024-04-15T00:18:26.830 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-fuse x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 891 k 2024-04-15T00:18:26.830 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 145 k 2024-04-15T00:18:26.830 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 1.5 M 2024-04-15T00:18:26.830 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 139 k 2024-04-15T00:18:26.830 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 3.5 M 2024-04-15T00:18:26.830 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 7.4 M 2024-04-15T00:18:26.830 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-rook noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 49 k 2024-04-15T00:18:26.830 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-radosgw x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 9.9 M 2024-04-15T00:18:26.830 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-test x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 48 M 2024-04-15T00:18:26.831 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-volume noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 264 k 2024-04-15T00:18:26.831 INFO:teuthology.orchestra.run.smithi031.stdout: cephadm noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 749 k 2024-04-15T00:18:26.831 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-mirror x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 222 k 2024-04-15T00:18:26.831 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-shell x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 27 k 2024-04-15T00:18:26.831 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-top noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 18 k 2024-04-15T00:18:26.831 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-15T00:18:26.831 INFO:teuthology.orchestra.run.smithi031.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-15T00:18:26.831 INFO:teuthology.orchestra.run.smithi031.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 18 k 2024-04-15T00:18:26.831 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs-devel x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 32 k 2024-04-15T00:18:26.831 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs2 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 746 k 2024-04-15T00:18:26.831 INFO:teuthology.orchestra.run.smithi031.stdout: librados-devel x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 127 k 2024-04-15T00:18:26.831 INFO:teuthology.orchestra.run.smithi031.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-15T00:18:26.831 INFO:teuthology.orchestra.run.smithi031.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-15T00:18:26.831 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-15T00:18:26.832 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-15T00:18:26.832 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-15T00:18:26.832 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-15T00:18:26.832 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cephfs x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 162 k 2024-04-15T00:18:26.832 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 320 k 2024-04-15T00:18:26.832 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rbd x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 298 k 2024-04-15T00:18:26.832 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rgw x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 99 k 2024-04-15T00:18:26.832 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-fuse x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 85 k 2024-04-15T00:18:26.832 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-mirror x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 3.1 M 2024-04-15T00:18:26.832 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-nbd x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 171 k 2024-04-15T00:18:26.833 INFO:teuthology.orchestra.run.smithi031.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-15T00:18:26.833 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrading: 2024-04-15T00:18:26.833 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager x86_64 1:1.47.4-1.el9 baseos 2.3 M 2024-04-15T00:18:26.833 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-libnm x86_64 1:1.47.4-1.el9 baseos 1.8 M 2024-04-15T00:18:26.833 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-team x86_64 1:1.47.4-1.el9 baseos 42 k 2024-04-15T00:18:26.833 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-tui x86_64 1:1.47.4-1.el9 baseos 249 k 2024-04-15T00:18:26.834 INFO:teuthology.orchestra.run.smithi031.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-15T00:18:26.834 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-15T00:18:26.834 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-15T00:18:26.835 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-15T00:18:26.835 INFO:teuthology.orchestra.run.smithi031.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-15T00:18:26.835 INFO:teuthology.orchestra.run.smithi031.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-15T00:18:26.835 INFO:teuthology.orchestra.run.smithi031.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-15T00:18:26.835 INFO:teuthology.orchestra.run.smithi031.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-15T00:18:26.835 INFO:teuthology.orchestra.run.smithi031.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-15T00:18:26.836 INFO:teuthology.orchestra.run.smithi031.stdout: librados2 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 3.4 M 2024-04-15T00:18:26.836 INFO:teuthology.orchestra.run.smithi031.stdout: librbd1 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 3.1 M 2024-04-15T00:18:26.836 INFO:teuthology.orchestra.run.smithi031.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-15T00:18:26.836 INFO:teuthology.orchestra.run.smithi031.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-15T00:18:26.836 INFO:teuthology.orchestra.run.smithi031.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-15T00:18:26.836 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-15T00:18:26.837 INFO:teuthology.orchestra.run.smithi031.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-15T00:18:26.837 INFO:teuthology.orchestra.run.smithi031.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-15T00:18:26.837 INFO:teuthology.orchestra.run.smithi031.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-15T00:18:26.837 INFO:teuthology.orchestra.run.smithi031.stdout: xfsdump x86_64 3.1.12-4.el9 baseos 323 k 2024-04-15T00:18:26.837 INFO:teuthology.orchestra.run.smithi031.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-15T00:18:26.837 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-04-15T00:18:26.837 INFO:teuthology.orchestra.run.smithi031.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-15T00:18:26.837 INFO:teuthology.orchestra.run.smithi031.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-15T00:18:26.838 INFO:teuthology.orchestra.run.smithi031.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-15T00:18:26.838 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-common x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 21 M 2024-04-15T00:18:26.838 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 32 k 2024-04-15T00:18:26.838 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mds x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 2.4 M 2024-04-15T00:18:26.838 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 248 k 2024-04-15T00:18:26.838 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mon x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 4.7 M 2024-04-15T00:18:26.839 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-osd x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 17 M 2024-04-15T00:18:26.839 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 15 k 2024-04-15T00:18:26.839 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-selinux x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 25 k 2024-04-15T00:18:26.839 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-15T00:18:26.839 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-15T00:18:26.839 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-15T00:18:26.839 INFO:teuthology.orchestra.run.smithi031.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-15T00:18:26.840 INFO:teuthology.orchestra.run.smithi031.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-15T00:18:26.840 INFO:teuthology.orchestra.run.smithi031.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-15T00:18:26.840 INFO:teuthology.orchestra.run.smithi031.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-15T00:18:26.840 INFO:teuthology.orchestra.run.smithi031.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-15T00:18:26.840 INFO:teuthology.orchestra.run.smithi031.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-15T00:18:26.840 INFO:teuthology.orchestra.run.smithi031.stdout: libcephsqlite x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 164 k 2024-04-15T00:18:26.841 INFO:teuthology.orchestra.run.smithi031.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-15T00:18:26.841 INFO:teuthology.orchestra.run.smithi031.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-15T00:18:26.841 INFO:teuthology.orchestra.run.smithi031.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-15T00:18:26.841 INFO:teuthology.orchestra.run.smithi031.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-15T00:18:26.841 INFO:teuthology.orchestra.run.smithi031.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-15T00:18:26.841 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 501 k 2024-04-15T00:18:26.842 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-15T00:18:26.842 INFO:teuthology.orchestra.run.smithi031.stdout: librgw2 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 5.2 M 2024-04-15T00:18:26.842 INFO:teuthology.orchestra.run.smithi031.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-15T00:18:26.842 INFO:teuthology.orchestra.run.smithi031.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-15T00:18:26.842 INFO:teuthology.orchestra.run.smithi031.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-15T00:18:26.842 INFO:teuthology.orchestra.run.smithi031.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-15T00:18:26.843 INFO:teuthology.orchestra.run.smithi031.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-15T00:18:26.843 INFO:teuthology.orchestra.run.smithi031.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-15T00:18:26.843 INFO:teuthology.orchestra.run.smithi031.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-04-15T00:18:26.843 INFO:teuthology.orchestra.run.smithi031.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-15T00:18:26.843 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-15T00:18:26.843 INFO:teuthology.orchestra.run.smithi031.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-15T00:18:26.844 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-15T00:18:26.844 INFO:teuthology.orchestra.run.smithi031.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-15T00:18:26.844 INFO:teuthology.orchestra.run.smithi031.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-15T00:18:26.844 INFO:teuthology.orchestra.run.smithi031.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-15T00:18:26.844 INFO:teuthology.orchestra.run.smithi031.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-15T00:18:26.844 INFO:teuthology.orchestra.run.smithi031.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-15T00:18:26.845 INFO:teuthology.orchestra.run.smithi031.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-15T00:18:26.845 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-15T00:18:26.845 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 45 k 2024-04-15T00:18:26.845 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-common x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 131 k 2024-04-15T00:18:26.845 INFO:teuthology.orchestra.run.smithi031.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-15T00:18:26.845 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-15T00:18:26.845 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-15T00:18:26.846 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-15T00:18:26.846 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-15T00:18:26.846 INFO:teuthology.orchestra.run.smithi031.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-15T00:18:26.846 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-15T00:18:26.846 INFO:teuthology.orchestra.run.smithi031.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-15T00:18:26.846 INFO:teuthology.orchestra.run.smithi031.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-15T00:18:26.847 INFO:teuthology.orchestra.run.smithi031.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-15T00:18:26.847 INFO:teuthology.orchestra.run.smithi031.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-15T00:18:26.847 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-15T00:18:26.847 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-15T00:18:26.847 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-15T00:18:26.847 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-15T00:18:26.848 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-15T00:18:26.848 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-15T00:18:26.848 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-15T00:18:26.848 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-15T00:18:26.848 INFO:teuthology.orchestra.run.smithi031.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-15T00:18:26.848 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-15T00:18:26.848 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-15T00:18:26.849 INFO:teuthology.orchestra.run.smithi031.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-15T00:18:26.849 INFO:teuthology.orchestra.run.smithi031.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-15T00:18:26.849 INFO:teuthology.orchestra.run.smithi031.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-15T00:18:26.849 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-15T00:18:26.849 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-15T00:18:26.849 INFO:teuthology.orchestra.run.smithi031.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-15T00:18:26.850 INFO:teuthology.orchestra.run.smithi031.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-15T00:18:26.850 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-15T00:18:26.850 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-15T00:18:26.850 INFO:teuthology.orchestra.run.smithi031.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-15T00:18:26.850 INFO:teuthology.orchestra.run.smithi031.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-15T00:18:26.850 INFO:teuthology.orchestra.run.smithi031.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-15T00:18:26.851 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-15T00:18:26.851 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-15T00:18:26.851 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-15T00:18:26.851 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-15T00:18:26.851 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-15T00:18:26.851 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-15T00:18:26.852 INFO:teuthology.orchestra.run.smithi031.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-15T00:18:26.852 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-15T00:18:26.852 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-15T00:18:26.852 INFO:teuthology.orchestra.run.smithi031.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-15T00:18:26.852 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-15T00:18:26.852 INFO:teuthology.orchestra.run.smithi031.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-15T00:18:26.852 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-15T00:18:26.853 INFO:teuthology.orchestra.run.smithi031.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-15T00:18:26.853 INFO:teuthology.orchestra.run.smithi031.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-15T00:18:26.853 INFO:teuthology.orchestra.run.smithi031.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-15T00:18:26.853 INFO:teuthology.orchestra.run.smithi031.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-15T00:18:26.853 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-15T00:18:26.854 INFO:teuthology.orchestra.run.smithi031.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-15T00:18:26.854 INFO:teuthology.orchestra.run.smithi031.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-15T00:18:26.854 INFO:teuthology.orchestra.run.smithi031.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-15T00:18:26.854 INFO:teuthology.orchestra.run.smithi031.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-15T00:18:26.854 INFO:teuthology.orchestra.run.smithi031.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-15T00:18:26.854 INFO:teuthology.orchestra.run.smithi031.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-15T00:18:26.854 INFO:teuthology.orchestra.run.smithi031.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-15T00:18:26.855 INFO:teuthology.orchestra.run.smithi031.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-15T00:18:26.855 INFO:teuthology.orchestra.run.smithi031.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-15T00:18:26.855 INFO:teuthology.orchestra.run.smithi031.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-15T00:18:26.855 INFO:teuthology.orchestra.run.smithi031.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2024-04-15T00:18:26.855 INFO:teuthology.orchestra.run.smithi031.stdout:Installing weak dependencies: 2024-04-15T00:18:26.855 INFO:teuthology.orchestra.run.smithi031.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-15T00:18:26.856 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:18:26.856 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-04-15T00:18:26.856 INFO:teuthology.orchestra.run.smithi031.stdout:========================================================================================= 2024-04-15T00:18:26.856 INFO:teuthology.orchestra.run.smithi031.stdout:Install 150 Packages 2024-04-15T00:18:26.856 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrade 24 Packages 2024-04-15T00:18:26.856 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:18:26.857 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 228 M 2024-04-15T00:18:26.857 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-04-15T00:18:27.521 INFO:teuthology.orchestra.run.smithi031.stdout:(1/174): ceph-19.0.0-2114.ga9a752df.el7.x86_64. 41 kB/s | 6.6 kB 00:00 2024-04-15T00:18:27.722 INFO:teuthology.orchestra.run.smithi031.stdout:(2/174): ceph-fuse-19.0.0-2114.ga9a752df.el7.x8 4.4 MB/s | 891 kB 00:00 2024-04-15T00:18:27.763 INFO:teuthology.orchestra.run.smithi031.stdout:(3/174): ceph-immutable-object-cache-19.0.0-211 3.4 MB/s | 145 kB 00:00 2024-04-15T00:18:28.066 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-04-15T00:18:28.130 INFO:teuthology.orchestra.run.smithi031.stdout:(4/174): ceph-mds-19.0.0-2114.ga9a752df.el7.x86 6.4 MB/s | 2.4 MB 00:00 2024-04-15T00:18:28.206 INFO:teuthology.orchestra.run.smithi031.stdout:(5/174): ceph-base-19.0.0-2114.ga9a752df.el7.x8 6.3 MB/s | 5.3 MB 00:00 2024-04-15T00:18:28.339 INFO:teuthology.orchestra.run.smithi031.stdout:(6/174): ceph-mgr-19.0.0-2114.ga9a752df.el7.x86 7.2 MB/s | 1.5 MB 00:00 2024-04-15T00:18:28.656 INFO:teuthology.orchestra.run.smithi031.stdout:(7/174): ceph-mon-19.0.0-2114.ga9a752df.el7.x86 10 MB/s | 4.7 MB 00:00 2024-04-15T00:18:29.556 INFO:teuthology.orchestra.run.smithi031.stdout:(8/174): ceph-radosgw-19.0.0-2114.ga9a752df.el7 11 MB/s | 9.9 MB 00:00 2024-04-15T00:18:29.640 INFO:teuthology.orchestra.run.smithi031.stdout:(9/174): ceph-selinux-19.0.0-2114.ga9a752df.el7 302 kB/s | 25 kB 00:00 2024-04-15T00:18:29.865 INFO:teuthology.orchestra.run.smithi031.stdout:(10/174): ceph-common-19.0.0-2114.ga9a752df.el7 8.3 MB/s | 21 MB 00:02 2024-04-15T00:18:29.965 INFO:teuthology.orchestra.run.smithi031.stdout:(11/174): cephfs-mirror-19.0.0-2114.ga9a752df.e 2.2 MB/s | 222 kB 00:00 2024-04-15T00:18:30.049 INFO:teuthology.orchestra.run.smithi031.stdout:(12/174): cephfs-shell-19.0.0-2114.ga9a752df.el 325 kB/s | 27 kB 00:00 2024-04-15T00:18:30.141 INFO:teuthology.orchestra.run.smithi031.stdout:(13/174): libcephfs-devel-19.0.0-2114.ga9a752df 346 kB/s | 32 kB 00:00 2024-04-15T00:18:30.258 INFO:teuthology.orchestra.run.smithi031.stdout:(14/174): libcephfs2-19.0.0-2114.ga9a752df.el7. 6.2 MB/s | 746 kB 00:00 2024-04-15T00:18:30.350 INFO:teuthology.orchestra.run.smithi031.stdout:(15/174): libcephsqlite-19.0.0-2114.ga9a752df.e 1.7 MB/s | 164 kB 00:00 2024-04-15T00:18:30.441 INFO:teuthology.orchestra.run.smithi031.stdout:(16/174): librados-devel-19.0.0-2114.ga9a752df. 1.4 MB/s | 127 kB 00:00 2024-04-15T00:18:30.600 INFO:teuthology.orchestra.run.smithi031.stdout:(17/174): ceph-osd-19.0.0-2114.ga9a752df.el7.x8 7.4 MB/s | 17 MB 00:02 2024-04-15T00:18:30.634 INFO:teuthology.orchestra.run.smithi031.stdout:(18/174): libradosstriper1-19.0.0-2114.ga9a752d 2.5 MB/s | 501 kB 00:00 2024-04-15T00:18:30.700 INFO:teuthology.orchestra.run.smithi031.stdout:(19/174): python3-ceph-argparse-19.0.0-2114.ga9 677 kB/s | 45 kB 00:00 2024-04-15T00:18:30.770 INFO:teuthology.orchestra.run.smithi050.stderr:Modular dependency problems: 2024-04-15T00:18:30.771 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-04-15T00:18:30.771 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 1: conflicting requests 2024-04-15T00:18:30.771 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.771 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 2: conflicting requests 2024-04-15T00:18:30.771 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.771 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 3: conflicting requests 2024-04-15T00:18:30.771 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.771 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 4: conflicting requests 2024-04-15T00:18:30.771 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.771 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 5: conflicting requests 2024-04-15T00:18:30.771 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.772 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 6: conflicting requests 2024-04-15T00:18:30.772 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.772 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 7: conflicting requests 2024-04-15T00:18:30.772 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.772 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 8: conflicting requests 2024-04-15T00:18:30.772 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.772 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 9: conflicting requests 2024-04-15T00:18:30.772 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.772 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 10: conflicting requests 2024-04-15T00:18:30.772 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.772 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 11: conflicting requests 2024-04-15T00:18:30.772 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.772 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 12: conflicting requests 2024-04-15T00:18:30.772 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.772 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 13: conflicting requests 2024-04-15T00:18:30.773 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.773 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 14: conflicting requests 2024-04-15T00:18:30.773 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.773 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 15: conflicting requests 2024-04-15T00:18:30.773 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.773 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 16: conflicting requests 2024-04-15T00:18:30.773 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.773 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 17: conflicting requests 2024-04-15T00:18:30.773 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.773 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 18: conflicting requests 2024-04-15T00:18:30.773 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.773 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 19: conflicting requests 2024-04-15T00:18:30.773 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.773 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 20: conflicting requests 2024-04-15T00:18:30.774 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.774 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 21: conflicting requests 2024-04-15T00:18:30.774 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.774 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 22: conflicting requests 2024-04-15T00:18:30.774 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.774 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 23: conflicting requests 2024-04-15T00:18:30.774 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.774 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 24: conflicting requests 2024-04-15T00:18:30.774 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.774 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 25: conflicting requests 2024-04-15T00:18:30.774 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.774 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 26: conflicting requests 2024-04-15T00:18:30.774 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.774 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 27: conflicting requests 2024-04-15T00:18:30.775 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.775 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 28: conflicting requests 2024-04-15T00:18:30.775 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.775 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 29: conflicting requests 2024-04-15T00:18:30.775 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.775 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 30: conflicting requests 2024-04-15T00:18:30.775 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.775 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 31: conflicting requests 2024-04-15T00:18:30.775 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.775 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 32: conflicting requests 2024-04-15T00:18:30.775 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.775 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 33: conflicting requests 2024-04-15T00:18:30.776 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.776 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 34: conflicting requests 2024-04-15T00:18:30.776 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.776 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 35: conflicting requests 2024-04-15T00:18:30.776 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.776 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 36: conflicting requests 2024-04-15T00:18:30.776 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.776 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 37: conflicting requests 2024-04-15T00:18:30.776 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.776 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.776 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.776 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 38: cannot install the best candidate for the job 2024-04-15T00:18:30.776 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.776 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.777 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.777 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.777 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 39: conflicting requests 2024-04-15T00:18:30.777 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.777 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.777 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.777 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.777 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.777 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.777 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 40: cannot install the best candidate for the job 2024-04-15T00:18:30.777 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.777 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.777 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.777 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.778 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 41: cannot install the best candidate for the job 2024-04-15T00:18:30.778 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.778 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.778 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.778 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.778 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 42: cannot install the best candidate for the job 2024-04-15T00:18:30.778 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.778 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.778 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.778 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.778 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 43: cannot install the best candidate for the job 2024-04-15T00:18:30.778 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.778 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.778 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.779 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.779 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 44: cannot install the best candidate for the job 2024-04-15T00:18:30.779 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.779 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.779 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.779 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.779 INFO:teuthology.orchestra.run.smithi050.stderr: Problem 45: cannot install the best candidate for the job 2024-04-15T00:18:30.779 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.779 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.779 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.779 INFO:teuthology.orchestra.run.smithi050.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-15T00:18:30.793 INFO:teuthology.orchestra.run.smithi031.stdout:(20/174): python3-ceph-common-19.0.0-2114.ga9a7 1.4 MB/s | 131 kB 00:00 2024-04-15T00:18:30.885 INFO:teuthology.orchestra.run.smithi031.stdout:(21/174): python3-cephfs-19.0.0-2114.ga9a752df. 1.7 MB/s | 162 kB 00:00 2024-04-15T00:18:30.985 INFO:teuthology.orchestra.run.smithi031.stdout:(22/174): python3-rados-19.0.0-2114.ga9a752df.e 3.1 MB/s | 320 kB 00:00 2024-04-15T00:18:31.093 INFO:teuthology.orchestra.run.smithi031.stdout:(23/174): python3-rbd-19.0.0-2114.ga9a752df.el7 2.7 MB/s | 298 kB 00:00 2024-04-15T00:18:31.227 INFO:teuthology.orchestra.run.smithi031.stdout:(24/174): librgw2-19.0.0-2114.ga9a752df.el7.x86 8.2 MB/s | 5.2 MB 00:00 2024-04-15T00:18:31.232 INFO:teuthology.orchestra.run.smithi050.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-15T00:18:31.233 INFO:teuthology.orchestra.run.smithi050.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-15T00:18:31.248 INFO:teuthology.orchestra.run.smithi050.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-15T00:18:31.249 INFO:teuthology.orchestra.run.smithi050.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-15T00:18:31.250 INFO:teuthology.orchestra.run.smithi050.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-15T00:18:31.251 INFO:teuthology.orchestra.run.smithi050.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-15T00:18:31.253 INFO:teuthology.orchestra.run.smithi050.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-15T00:18:31.256 INFO:teuthology.orchestra.run.smithi050.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-15T00:18:31.257 INFO:teuthology.orchestra.run.smithi050.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-15T00:18:31.261 INFO:teuthology.orchestra.run.smithi031.stdout:(25/174): python3-rgw-19.0.0-2114.ga9a752df.el7 593 kB/s | 99 kB 00:00 2024-04-15T00:18:31.286 INFO:teuthology.orchestra.run.smithi031.stdout:(26/174): rbd-fuse-19.0.0-2114.ga9a752df.el7.x8 1.4 MB/s | 85 kB 00:00 2024-04-15T00:18:31.356 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-04-15T00:18:31.376 INFO:teuthology.orchestra.run.smithi050.stdout:========================================================================================= 2024-04-15T00:18:31.376 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2024-04-15T00:18:31.376 INFO:teuthology.orchestra.run.smithi050.stdout:========================================================================================= 2024-04-15T00:18:31.376 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2024-04-15T00:18:31.376 INFO:teuthology.orchestra.run.smithi050.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-15T00:18:31.376 INFO:teuthology.orchestra.run.smithi050.stdout: ceph x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 6.6 k 2024-04-15T00:18:31.376 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 5.3 M 2024-04-15T00:18:31.376 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 891 k 2024-04-15T00:18:31.376 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 145 k 2024-04-15T00:18:31.376 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 1.5 M 2024-04-15T00:18:31.376 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 139 k 2024-04-15T00:18:31.377 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 3.5 M 2024-04-15T00:18:31.377 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 7.4 M 2024-04-15T00:18:31.377 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 49 k 2024-04-15T00:18:31.377 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 9.9 M 2024-04-15T00:18:31.377 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 48 M 2024-04-15T00:18:31.377 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 264 k 2024-04-15T00:18:31.377 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 749 k 2024-04-15T00:18:31.377 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-mirror x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 222 k 2024-04-15T00:18:31.377 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-shell x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 27 k 2024-04-15T00:18:31.377 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-top noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 18 k 2024-04-15T00:18:31.377 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-15T00:18:31.377 INFO:teuthology.orchestra.run.smithi050.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-15T00:18:31.377 INFO:teuthology.orchestra.run.smithi050.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 18 k 2024-04-15T00:18:31.377 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 32 k 2024-04-15T00:18:31.378 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 746 k 2024-04-15T00:18:31.378 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 127 k 2024-04-15T00:18:31.378 INFO:teuthology.orchestra.run.smithi050.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-15T00:18:31.378 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-15T00:18:31.378 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-15T00:18:31.378 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-15T00:18:31.378 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-15T00:18:31.378 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-15T00:18:31.378 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 162 k 2024-04-15T00:18:31.378 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 320 k 2024-04-15T00:18:31.378 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 298 k 2024-04-15T00:18:31.378 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 99 k 2024-04-15T00:18:31.378 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 85 k 2024-04-15T00:18:31.379 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 3.1 M 2024-04-15T00:18:31.379 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 171 k 2024-04-15T00:18:31.379 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-15T00:18:31.379 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrading: 2024-04-15T00:18:31.379 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager x86_64 1:1.47.4-1.el9 baseos 2.3 M 2024-04-15T00:18:31.379 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-libnm x86_64 1:1.47.4-1.el9 baseos 1.8 M 2024-04-15T00:18:31.379 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-team x86_64 1:1.47.4-1.el9 baseos 42 k 2024-04-15T00:18:31.379 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-tui x86_64 1:1.47.4-1.el9 baseos 249 k 2024-04-15T00:18:31.379 INFO:teuthology.orchestra.run.smithi050.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-15T00:18:31.379 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-15T00:18:31.380 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-15T00:18:31.380 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-15T00:18:31.380 INFO:teuthology.orchestra.run.smithi050.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-15T00:18:31.380 INFO:teuthology.orchestra.run.smithi050.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-15T00:18:31.381 INFO:teuthology.orchestra.run.smithi050.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-15T00:18:31.381 INFO:teuthology.orchestra.run.smithi050.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-15T00:18:31.381 INFO:teuthology.orchestra.run.smithi050.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-15T00:18:31.381 INFO:teuthology.orchestra.run.smithi050.stdout: librados2 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 3.4 M 2024-04-15T00:18:31.381 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 3.1 M 2024-04-15T00:18:31.381 INFO:teuthology.orchestra.run.smithi050.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-15T00:18:31.381 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-15T00:18:31.381 INFO:teuthology.orchestra.run.smithi050.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-15T00:18:31.381 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-15T00:18:31.381 INFO:teuthology.orchestra.run.smithi050.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-15T00:18:31.381 INFO:teuthology.orchestra.run.smithi050.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-15T00:18:31.382 INFO:teuthology.orchestra.run.smithi050.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-15T00:18:31.382 INFO:teuthology.orchestra.run.smithi050.stdout: xfsdump x86_64 3.1.12-4.el9 baseos 323 k 2024-04-15T00:18:31.382 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-15T00:18:31.382 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2024-04-15T00:18:31.382 INFO:teuthology.orchestra.run.smithi050.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-15T00:18:31.382 INFO:teuthology.orchestra.run.smithi050.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-15T00:18:31.382 INFO:teuthology.orchestra.run.smithi050.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-15T00:18:31.382 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 21 M 2024-04-15T00:18:31.382 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 32 k 2024-04-15T00:18:31.382 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 2.4 M 2024-04-15T00:18:31.383 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 248 k 2024-04-15T00:18:31.383 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 4.7 M 2024-04-15T00:18:31.383 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 17 M 2024-04-15T00:18:31.383 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 15 k 2024-04-15T00:18:31.383 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 25 k 2024-04-15T00:18:31.383 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-15T00:18:31.383 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-15T00:18:31.383 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-15T00:18:31.384 INFO:teuthology.orchestra.run.smithi050.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-15T00:18:31.384 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-15T00:18:31.384 INFO:teuthology.orchestra.run.smithi050.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-15T00:18:31.384 INFO:teuthology.orchestra.run.smithi050.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-15T00:18:31.384 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-15T00:18:31.384 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-15T00:18:31.384 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 164 k 2024-04-15T00:18:31.384 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-15T00:18:31.384 INFO:teuthology.orchestra.run.smithi050.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-15T00:18:31.385 INFO:teuthology.orchestra.run.smithi050.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-15T00:18:31.385 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-15T00:18:31.385 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-15T00:18:31.385 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 501 k 2024-04-15T00:18:31.385 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-15T00:18:31.385 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 5.2 M 2024-04-15T00:18:31.385 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-15T00:18:31.385 INFO:teuthology.orchestra.run.smithi050.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-15T00:18:31.385 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-15T00:18:31.385 INFO:teuthology.orchestra.run.smithi050.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-15T00:18:31.385 INFO:teuthology.orchestra.run.smithi050.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-15T00:18:31.386 INFO:teuthology.orchestra.run.smithi050.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-15T00:18:31.386 INFO:teuthology.orchestra.run.smithi050.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-04-15T00:18:31.386 INFO:teuthology.orchestra.run.smithi050.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-15T00:18:31.386 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-15T00:18:31.386 INFO:teuthology.orchestra.run.smithi050.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-15T00:18:31.386 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-15T00:18:31.386 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-15T00:18:31.386 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-15T00:18:31.386 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-15T00:18:31.386 INFO:teuthology.orchestra.run.smithi050.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-15T00:18:31.386 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-15T00:18:31.386 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-15T00:18:31.386 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-15T00:18:31.386 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 45 k 2024-04-15T00:18:31.387 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 131 k 2024-04-15T00:18:31.387 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-15T00:18:31.387 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-15T00:18:31.387 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-15T00:18:31.387 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-15T00:18:31.387 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-15T00:18:31.387 INFO:teuthology.orchestra.run.smithi050.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-15T00:18:31.387 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-15T00:18:31.387 INFO:teuthology.orchestra.run.smithi050.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-15T00:18:31.387 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-15T00:18:31.387 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-15T00:18:31.387 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-15T00:18:31.387 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-15T00:18:31.387 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-15T00:18:31.388 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-15T00:18:31.388 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-15T00:18:31.388 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-15T00:18:31.388 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-15T00:18:31.388 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-15T00:18:31.388 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-15T00:18:31.388 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-15T00:18:31.388 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-15T00:18:31.388 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-15T00:18:31.388 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-15T00:18:31.388 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-15T00:18:31.388 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-15T00:18:31.388 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-15T00:18:31.388 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-15T00:18:31.388 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-15T00:18:31.389 INFO:teuthology.orchestra.run.smithi050.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-15T00:18:31.389 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-15T00:18:31.389 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-15T00:18:31.389 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-15T00:18:31.389 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-15T00:18:31.389 INFO:teuthology.orchestra.run.smithi050.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-15T00:18:31.389 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-15T00:18:31.389 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-15T00:18:31.389 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-15T00:18:31.389 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-15T00:18:31.389 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-15T00:18:31.389 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-15T00:18:31.389 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-15T00:18:31.389 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-15T00:18:31.390 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-15T00:18:31.390 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-15T00:18:31.390 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-15T00:18:31.390 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-15T00:18:31.390 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-15T00:18:31.390 INFO:teuthology.orchestra.run.smithi050.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-15T00:18:31.390 INFO:teuthology.orchestra.run.smithi050.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-15T00:18:31.391 INFO:teuthology.orchestra.run.smithi050.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-15T00:18:31.391 INFO:teuthology.orchestra.run.smithi050.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-15T00:18:31.391 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-15T00:18:31.391 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-15T00:18:31.391 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-15T00:18:31.391 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-15T00:18:31.391 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-15T00:18:31.391 INFO:teuthology.orchestra.run.smithi050.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-15T00:18:31.391 INFO:teuthology.orchestra.run.smithi050.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-15T00:18:31.391 INFO:teuthology.orchestra.run.smithi050.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-15T00:18:31.391 INFO:teuthology.orchestra.run.smithi050.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-15T00:18:31.391 INFO:teuthology.orchestra.run.smithi050.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-15T00:18:31.392 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-15T00:18:31.392 INFO:teuthology.orchestra.run.smithi050.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2024-04-15T00:18:31.392 INFO:teuthology.orchestra.run.smithi050.stdout:Installing weak dependencies: 2024-04-15T00:18:31.392 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-15T00:18:31.392 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:18:31.392 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-04-15T00:18:31.392 INFO:teuthology.orchestra.run.smithi050.stdout:========================================================================================= 2024-04-15T00:18:31.392 INFO:teuthology.orchestra.run.smithi050.stdout:Install 150 Packages 2024-04-15T00:18:31.392 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrade 24 Packages 2024-04-15T00:18:31.392 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:18:31.393 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 228 M 2024-04-15T00:18:31.393 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2024-04-15T00:18:31.496 INFO:teuthology.orchestra.run.smithi031.stdout:(27/174): rbd-nbd-19.0.0-2114.ga9a752df.el7.x86 821 kB/s | 171 kB 00:00 2024-04-15T00:18:31.570 INFO:teuthology.orchestra.run.smithi031.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2114.g 424 kB/s | 32 kB 00:00 2024-04-15T00:18:31.629 INFO:teuthology.orchestra.run.smithi031.stdout:(29/174): rbd-mirror-19.0.0-2114.ga9a752df.el7. 8.4 MB/s | 3.1 MB 00:00 2024-04-15T00:18:31.654 INFO:teuthology.orchestra.run.smithi031.stdout:(30/174): ceph-mgr-cephadm-19.0.0-2114.ga9a752d 1.6 MB/s | 139 kB 00:00 2024-04-15T00:18:32.021 INFO:teuthology.orchestra.run.smithi031.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2114.ga9a75 9.0 MB/s | 3.5 MB 00:00 2024-04-15T00:18:32.096 INFO:teuthology.orchestra.run.smithi031.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2114.ga9 3.2 MB/s | 248 kB 00:00 2024-04-15T00:18:32.171 INFO:teuthology.orchestra.run.smithi031.stdout:(33/174): ceph-mgr-rook-19.0.0-2114.ga9a752df.e 658 kB/s | 49 kB 00:00 2024-04-15T00:18:32.238 INFO:teuthology.orchestra.run.smithi031.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2114.ga 230 kB/s | 15 kB 00:00 2024-04-15T00:18:32.322 INFO:teuthology.orchestra.run.smithi031.stdout:(35/174): ceph-volume-19.0.0-2114.ga9a752df.el7 3.1 MB/s | 264 kB 00:00 2024-04-15T00:18:32.430 INFO:teuthology.orchestra.run.smithi031.stdout:(36/174): cephadm-19.0.0-2114.ga9a752df.el7.noa 6.8 MB/s | 749 kB 00:00 2024-04-15T00:18:32.518 INFO:teuthology.orchestra.run.smithi050.stdout:(1/174): ceph-19.0.0-2114.ga9a752df.el7.x86_64. 24 kB/s | 6.6 kB 00:00 2024-04-15T00:18:32.848 INFO:teuthology.orchestra.run.smithi031.stdout:(37/174): ceph-test-19.0.0-2114.ga9a752df.el7.x 15 MB/s | 48 MB 00:03 2024-04-15T00:18:32.873 INFO:teuthology.orchestra.run.smithi031.stdout:(38/174): cephfs-top-19.0.0-2114.ga9a752df.el7. 41 kB/s | 18 kB 00:00 2024-04-15T00:18:32.980 INFO:teuthology.orchestra.run.smithi031.stdout:(39/174): ceph-mgr-diskprediction-local-19.0.0- 5.6 MB/s | 7.4 MB 00:01 2024-04-15T00:18:33.065 INFO:teuthology.orchestra.run.smithi031.stdout:(40/174): libaio-devel-0.3.112-1.el8.x86_64.rpm 81 kB/s | 18 kB 00:00 2024-04-15T00:18:33.166 INFO:teuthology.orchestra.run.smithi031.stdout:(41/174): fuse-2.9.9-15.el9.x86_64.rpm 275 kB/s | 80 kB 00:00 2024-04-15T00:18:33.224 INFO:teuthology.orchestra.run.smithi031.stdout:(42/174): jq-1.6-16.el9.x86_64.rpm 870 kB/s | 187 kB 00:00 2024-04-15T00:18:33.301 INFO:teuthology.orchestra.run.smithi031.stdout:(43/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.4 MB/s | 195 kB 00:00 2024-04-15T00:18:33.325 INFO:teuthology.orchestra.run.smithi031.stdout:(44/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.1 MB/s | 218 kB 00:00 2024-04-15T00:18:33.367 INFO:teuthology.orchestra.run.smithi031.stdout:(45/174): libgfortran-11.4.1-3.el9.x86_64.rpm 2.6 MB/s | 803 kB 00:00 2024-04-15T00:18:33.392 INFO:teuthology.orchestra.run.smithi031.stdout:(46/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-04-15T00:18:33.425 INFO:teuthology.orchestra.run.smithi031.stdout:(47/174): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-04-15T00:18:33.459 INFO:teuthology.orchestra.run.smithi031.stdout:(48/174): python3-cryptography-36.0.1-4.el9.x86 9.2 MB/s | 1.2 MB 00:00 2024-04-15T00:18:33.484 INFO:teuthology.orchestra.run.smithi031.stdout:(49/174): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-04-15T00:18:33.509 INFO:teuthology.orchestra.run.smithi031.stdout:(50/174): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-04-15T00:18:33.535 INFO:teuthology.orchestra.run.smithi031.stdout:(51/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-04-15T00:18:33.543 INFO:teuthology.orchestra.run.smithi050.stdout:(2/174): ceph-common-19.0.0-2114.ga9a752df.el7. 16 MB/s | 21 MB 00:01 2024-04-15T00:18:33.585 INFO:teuthology.orchestra.run.smithi050.stdout:(3/174): ceph-fuse-19.0.0-2114.ga9a752df.el7.x8 835 kB/s | 891 kB 00:01 2024-04-15T00:18:33.610 INFO:teuthology.orchestra.run.smithi050.stdout:(4/174): ceph-immutable-object-cache-19.0.0-211 2.1 MB/s | 145 kB 00:00 2024-04-15T00:18:33.711 INFO:teuthology.orchestra.run.smithi050.stdout:(5/174): ceph-mgr-19.0.0-2114.ga9a752df.el7.x86 15 MB/s | 1.5 MB 00:00 2024-04-15T00:18:33.952 INFO:teuthology.orchestra.run.smithi031.stdout:(52/174): boost-program-options-1.75.0-8.el9.x8 256 kB/s | 107 kB 00:00 2024-04-15T00:18:33.977 INFO:teuthology.orchestra.run.smithi050.stdout:(6/174): ceph-mon-19.0.0-2114.ga9a752df.el7.x86 18 MB/s | 4.7 MB 00:00 2024-04-15T00:18:34.211 INFO:teuthology.orchestra.run.smithi031.stdout:(53/174): elfutils-libelf-devel-0.190-2.el9.x86 83 kB/s | 21 kB 00:00 2024-04-15T00:18:34.319 INFO:teuthology.orchestra.run.smithi031.stdout:(54/174): automake-1.16.2-8.el9.noarch.rpm 825 kB/s | 689 kB 00:00 2024-04-15T00:18:34.587 INFO:teuthology.orchestra.run.smithi031.stdout:(55/174): flexiblas-3.0.4-8.el9.x86_64.rpm 123 kB/s | 33 kB 00:00 2024-04-15T00:18:34.853 INFO:teuthology.orchestra.run.smithi050.stdout:(7/174): ceph-osd-19.0.0-2114.ga9a752df.el7.x86 19 MB/s | 17 MB 00:00 2024-04-15T00:18:34.903 INFO:teuthology.orchestra.run.smithi050.stdout:(8/174): ceph-mds-19.0.0-2114.ga9a752df.el7.x86 1.8 MB/s | 2.4 MB 00:01 2024-04-15T00:18:34.970 INFO:teuthology.orchestra.run.smithi050.stdout:(9/174): ceph-base-19.0.0-2114.ga9a752df.el7.x8 2.0 MB/s | 5.3 MB 00:02 2024-04-15T00:18:35.012 INFO:teuthology.orchestra.run.smithi050.stdout:(10/174): ceph-selinux-19.0.0-2114.ga9a752df.el 231 kB/s | 25 kB 00:00 2024-04-15T00:18:35.136 INFO:teuthology.orchestra.run.smithi031.stdout:(56/174): flex-2.6.4-9.el9.x86_64.rpm 339 kB/s | 313 kB 00:00 2024-04-15T00:18:35.204 INFO:teuthology.orchestra.run.smithi050.stdout:(11/174): cephfs-mirror-19.0.0-2114.ga9a752df.e 1.1 MB/s | 222 kB 00:00 2024-04-15T00:18:35.355 INFO:teuthology.orchestra.run.smithi050.stdout:(12/174): ceph-radosgw-19.0.0-2114.ga9a752df.el 20 MB/s | 9.9 MB 00:00 2024-04-15T00:18:35.362 INFO:teuthology.orchestra.run.smithi031.stdout:(57/174): bison-3.7.4-5.el9.x86_64.rpm 509 kB/s | 943 kB 00:01 2024-04-15T00:18:35.388 INFO:teuthology.orchestra.run.smithi050.stdout:(13/174): cephfs-shell-19.0.0-2114.ga9a752df.el 147 kB/s | 27 kB 00:00 2024-04-15T00:18:35.404 INFO:teuthology.orchestra.run.smithi031.stdout:(58/174): flexiblas-openblas-openmp-3.0.4-8.el9 68 kB/s | 18 kB 00:00 2024-04-15T00:18:35.413 INFO:teuthology.orchestra.run.smithi050.stdout:(14/174): libcephfs-devel-19.0.0-2114.ga9a752df 542 kB/s | 32 kB 00:00 2024-04-15T00:18:35.455 INFO:teuthology.orchestra.run.smithi050.stdout:(15/174): libcephsqlite-19.0.0-2114.ga9a752df.e 3.9 MB/s | 164 kB 00:00 2024-04-15T00:18:35.505 INFO:teuthology.orchestra.run.smithi050.stdout:(16/174): librados-devel-19.0.0-2114.ga9a752df. 2.5 MB/s | 127 kB 00:00 2024-04-15T00:18:35.581 INFO:teuthology.orchestra.run.smithi050.stdout:(17/174): libcephfs2-19.0.0-2114.ga9a752df.el7. 3.8 MB/s | 746 kB 00:00 2024-04-15T00:18:35.606 INFO:teuthology.orchestra.run.smithi050.stdout:(18/174): libradosstriper1-19.0.0-2114.ga9a752d 4.9 MB/s | 501 kB 00:00 2024-04-15T00:18:35.648 INFO:teuthology.orchestra.run.smithi050.stdout:(19/174): python3-ceph-argparse-19.0.0-2114.ga9 1.1 MB/s | 45 kB 00:00 2024-04-15T00:18:35.690 INFO:teuthology.orchestra.run.smithi050.stdout:(20/174): python3-ceph-common-19.0.0-2114.ga9a7 3.1 MB/s | 131 kB 00:00 2024-04-15T00:18:35.745 INFO:teuthology.orchestra.run.smithi031.stdout:(59/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 132 kB/s | 45 kB 00:00 2024-04-15T00:18:35.748 INFO:teuthology.orchestra.run.smithi050.stdout:(21/174): python3-cephfs-19.0.0-2114.ga9a752df. 2.7 MB/s | 162 kB 00:00 2024-04-15T00:18:35.816 INFO:teuthology.orchestra.run.smithi050.stdout:(22/174): python3-rados-19.0.0-2114.ga9a752df.e 4.7 MB/s | 320 kB 00:00 2024-04-15T00:18:35.882 INFO:teuthology.orchestra.run.smithi050.stdout:(23/174): python3-rbd-19.0.0-2114.ga9a752df.el7 4.4 MB/s | 298 kB 00:00 2024-04-15T00:18:35.941 INFO:teuthology.orchestra.run.smithi050.stdout:(24/174): python3-rgw-19.0.0-2114.ga9a752df.el7 1.7 MB/s | 99 kB 00:00 2024-04-15T00:18:36.013 INFO:teuthology.orchestra.run.smithi031.stdout:(60/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 246 kB/s | 160 kB 00:00 2024-04-15T00:18:36.016 INFO:teuthology.orchestra.run.smithi050.stdout:(25/174): rbd-fuse-19.0.0-2114.ga9a752df.el7.x8 1.1 MB/s | 85 kB 00:00 2024-04-15T00:18:36.308 INFO:teuthology.orchestra.run.smithi050.stdout:(26/174): rbd-mirror-19.0.0-2114.ga9a752df.el7. 11 MB/s | 3.1 MB 00:00 2024-04-15T00:18:36.367 INFO:teuthology.orchestra.run.smithi050.stdout:(27/174): rbd-nbd-19.0.0-2114.ga9a752df.el7.x86 2.9 MB/s | 171 kB 00:00 2024-04-15T00:18:36.434 INFO:teuthology.orchestra.run.smithi050.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2114.g 476 kB/s | 32 kB 00:00 2024-04-15T00:18:36.493 INFO:teuthology.orchestra.run.smithi050.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2114.ga9a752d 2.3 MB/s | 139 kB 00:00 2024-04-15T00:18:36.568 INFO:teuthology.orchestra.run.smithi050.stdout:(30/174): librgw2-19.0.0-2114.ga9a752df.el7.x86 5.2 MB/s | 5.2 MB 00:00 2024-04-15T00:18:36.760 INFO:teuthology.orchestra.run.smithi050.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2114.ga9a75 13 MB/s | 3.5 MB 00:00 2024-04-15T00:18:36.827 INFO:teuthology.orchestra.run.smithi050.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2114.ga9 3.7 MB/s | 248 kB 00:00 2024-04-15T00:18:36.877 INFO:teuthology.orchestra.run.smithi050.stdout:(33/174): ceph-mgr-rook-19.0.0-2114.ga9a752df.e 987 kB/s | 49 kB 00:00 2024-04-15T00:18:36.928 INFO:teuthology.orchestra.run.smithi050.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2114.ga 307 kB/s | 15 kB 00:00 2024-04-15T00:18:37.003 INFO:teuthology.orchestra.run.smithi050.stdout:(35/174): ceph-volume-19.0.0-2114.ga9a752df.el7 3.4 MB/s | 264 kB 00:00 2024-04-15T00:18:37.095 INFO:teuthology.orchestra.run.smithi050.stdout:(36/174): cephadm-19.0.0-2114.ga9a752df.el7.noa 8.0 MB/s | 749 kB 00:00 2024-04-15T00:18:37.096 INFO:teuthology.orchestra.run.smithi031.stdout:(61/174): librdkafka-1.6.1-102.el9.x86_64.rpm 491 kB/s | 662 kB 00:01 2024-04-15T00:18:37.145 INFO:teuthology.orchestra.run.smithi050.stdout:(37/174): cephfs-top-19.0.0-2114.ga9a752df.el7. 362 kB/s | 18 kB 00:00 2024-04-15T00:18:37.229 INFO:teuthology.orchestra.run.smithi050.stdout:(38/174): libaio-devel-0.3.112-1.el8.x86_64.rpm 211 kB/s | 18 kB 00:00 2024-04-15T00:18:37.279 INFO:teuthology.orchestra.run.smithi031.stdout:(62/174): libtool-2.4.6-45.el9.x86_64.rpm 460 kB/s | 582 kB 00:01 2024-04-15T00:18:37.371 INFO:teuthology.orchestra.run.smithi050.stdout:(39/174): fuse-2.9.9-15.el9.x86_64.rpm 567 kB/s | 80 kB 00:00 2024-04-15T00:18:37.371 INFO:teuthology.orchestra.run.smithi031.stdout:(63/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 92 kB/s | 25 kB 00:00 2024-04-15T00:18:37.455 INFO:teuthology.orchestra.run.smithi050.stdout:(40/174): jq-1.6-16.el9.x86_64.rpm 2.2 MB/s | 187 kB 00:00 2024-04-15T00:18:37.597 INFO:teuthology.orchestra.run.smithi050.stdout:(41/174): libgfortran-11.4.1-3.el9.x86_64.rpm 5.5 MB/s | 803 kB 00:00 2024-04-15T00:18:37.630 INFO:teuthology.orchestra.run.smithi031.stdout:(64/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 135 kB/s | 47 kB 00:00 2024-04-15T00:18:37.655 INFO:teuthology.orchestra.run.smithi050.stdout:(42/174): libquadmath-11.4.1-3.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2024-04-15T00:18:37.739 INFO:teuthology.orchestra.run.smithi050.stdout:(43/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.6 MB/s | 218 kB 00:00 2024-04-15T00:18:37.841 INFO:teuthology.orchestra.run.smithi050.stdout:(44/174): ceph-mgr-diskprediction-local-19.0.0- 5.9 MB/s | 7.4 MB 00:01 2024-04-15T00:18:37.948 INFO:teuthology.orchestra.run.smithi050.stdout:(45/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-04-15T00:18:37.990 INFO:teuthology.orchestra.run.smithi050.stdout:(46/174): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-04-15T00:18:37.996 INFO:teuthology.orchestra.run.smithi031.stdout:(65/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 898 kB/s | 3.0 MB 00:03 2024-04-15T00:18:38.032 INFO:teuthology.orchestra.run.smithi050.stdout:(47/174): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-04-15T00:18:38.082 INFO:teuthology.orchestra.run.smithi050.stdout:(48/174): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-15T00:18:38.124 INFO:teuthology.orchestra.run.smithi050.stdout:(49/174): python3-cryptography-36.0.1-4.el9.x86 4.2 MB/s | 1.2 MB 00:00 2024-04-15T00:18:38.175 INFO:teuthology.orchestra.run.smithi050.stdout:(50/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-04-15T00:18:38.272 INFO:teuthology.orchestra.run.smithi031.stdout:(66/174): openblas-0.3.21-2.el9.x86_64.rpm 128 kB/s | 35 kB 00:00 2024-04-15T00:18:38.297 INFO:teuthology.orchestra.run.smithi031.stdout:(67/174): lua-5.4.4-4.el9.x86_64.rpm 282 kB/s | 188 kB 00:00 2024-04-15T00:18:38.381 INFO:teuthology.orchestra.run.smithi031.stdout:(68/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 290 kB/s | 292 kB 00:01 2024-04-15T00:18:38.926 INFO:teuthology.orchestra.run.smithi050.stdout:(51/174): ceph-test-19.0.0-2114.ga9a752df.el7.x 12 MB/s | 48 MB 00:03 2024-04-15T00:18:39.342 INFO:teuthology.orchestra.run.smithi050.stdout:(52/174): boost-program-options-1.75.0-8.el9.x8 258 kB/s | 107 kB 00:00 2024-04-15T00:18:39.450 INFO:teuthology.orchestra.run.smithi050.stdout:(53/174): elfutils-libelf-devel-0.190-2.el9.x86 198 kB/s | 21 kB 00:00 2024-04-15T00:18:39.509 INFO:teuthology.orchestra.run.smithi050.stdout:(54/174): automake-1.16.2-8.el9.noarch.rpm 497 kB/s | 689 kB 00:01 2024-04-15T00:18:39.593 INFO:teuthology.orchestra.run.smithi050.stdout:(55/174): bison-3.7.4-5.el9.x86_64.rpm 665 kB/s | 943 kB 00:01 2024-04-15T00:18:39.619 INFO:teuthology.orchestra.run.smithi050.stdout:(56/174): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-04-15T00:18:39.726 INFO:teuthology.orchestra.run.smithi050.stdout:(57/174): flexiblas-openblas-openmp-3.0.4-8.el9 168 kB/s | 18 kB 00:00 2024-04-15T00:18:39.802 INFO:teuthology.orchestra.run.smithi050.stdout:(58/174): flex-2.6.4-9.el9.x86_64.rpm 893 kB/s | 313 kB 00:00 2024-04-15T00:18:39.836 INFO:teuthology.orchestra.run.smithi050.stdout:(59/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-04-15T00:18:39.919 INFO:teuthology.orchestra.run.smithi050.stdout:(60/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 9.2 MB/s | 3.0 MB 00:00 2024-04-15T00:18:39.936 INFO:teuthology.orchestra.run.smithi050.stdout:(61/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 338 kB/s | 45 kB 00:00 2024-04-15T00:18:40.028 INFO:teuthology.orchestra.run.smithi050.stdout:(62/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 277 kB/s | 25 kB 00:00 2024-04-15T00:18:40.111 INFO:teuthology.orchestra.run.smithi050.stdout:(63/174): librdkafka-1.6.1-102.el9.x86_64.rpm 2.3 MB/s | 662 kB 00:00 2024-04-15T00:18:40.137 INFO:teuthology.orchestra.run.smithi050.stdout:(64/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 436 kB/s | 47 kB 00:00 2024-04-15T00:18:40.221 INFO:teuthology.orchestra.run.smithi050.stdout:(65/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-04-15T00:18:40.246 INFO:teuthology.orchestra.run.smithi050.stdout:(66/174): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-04-15T00:18:40.321 INFO:teuthology.orchestra.run.smithi050.stdout:(67/174): openblas-0.3.21-2.el9.x86_64.rpm 351 kB/s | 35 kB 00:00 2024-04-15T00:18:40.631 INFO:teuthology.orchestra.run.smithi031.stdout:(69/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 1.8 MB/s | 4.1 MB 00:02 2024-04-15T00:18:40.740 INFO:teuthology.orchestra.run.smithi031.stdout:(70/174): postgresql-13.14-1.el9.x86_64.rpm 689 kB/s | 1.6 MB 00:02 2024-04-15T00:18:40.788 INFO:teuthology.orchestra.run.smithi050.stdout:(68/174): libtool-2.4.6-45.el9.x86_64.rpm 670 kB/s | 582 kB 00:00 2024-04-15T00:18:40.806 INFO:teuthology.orchestra.run.smithi031.stdout:(71/174): openblas-openmp-0.3.21-2.el9.x86_64.r 1.9 MB/s | 4.7 MB 00:02 2024-04-15T00:18:41.158 INFO:teuthology.orchestra.run.smithi031.stdout:(72/174): postgresql-private-libs-13.14-1.el9.x 320 kB/s | 133 kB 00:00 2024-04-15T00:18:41.772 INFO:teuthology.orchestra.run.smithi050.stdout:(69/174): openblas-openmp-0.3.21-2.el9.x86_64.r 3.1 MB/s | 4.7 MB 00:01 2024-04-15T00:18:42.089 INFO:teuthology.orchestra.run.smithi050.stdout:(70/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 2.3 MB/s | 4.1 MB 00:01 2024-04-15T00:18:42.090 INFO:teuthology.orchestra.run.smithi031.stdout:(73/174): protobuf-3.14.0-13.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2024-04-15T00:18:42.364 INFO:teuthology.orchestra.run.smithi050.stdout:(71/174): postgresql-private-libs-13.14-1.el9.x 485 kB/s | 133 kB 00:00 2024-04-15T00:18:42.507 INFO:teuthology.orchestra.run.smithi031.stdout:(74/174): postgresql-contrib-13.14-1.el9.x86_64 486 kB/s | 911 kB 00:01 2024-04-15T00:18:42.532 INFO:teuthology.orchestra.run.smithi031.stdout:(75/174): python3-attrs-20.3.0-7.el9.noarch.rpm 198 kB/s | 87 kB 00:00 2024-04-15T00:18:42.906 INFO:teuthology.orchestra.run.smithi050.stdout:(72/174): postgresql-13.14-1.el9.x86_64.rpm 768 kB/s | 1.6 MB 00:02 2024-04-15T00:18:43.023 INFO:teuthology.orchestra.run.smithi050.stdout:(73/174): postgresql-contrib-13.14-1.el9.x86_64 728 kB/s | 911 kB 00:01 2024-04-15T00:18:43.191 INFO:teuthology.orchestra.run.smithi031.stdout:(76/174): python3-devel-3.9.17-2.el9.x86_64.rpm 373 kB/s | 245 kB 00:00 2024-04-15T00:18:43.206 INFO:teuthology.orchestra.run.smithi050.stdout:(74/174): python3-attrs-20.3.0-7.el9.noarch.rpm 477 kB/s | 87 kB 00:00 2024-04-15T00:18:43.683 INFO:teuthology.orchestra.run.smithi031.stdout:(77/174): python3-jinja2-2.11.3-5.el9.noarch.rp 504 kB/s | 248 kB 00:00 2024-04-15T00:18:43.950 INFO:teuthology.orchestra.run.smithi031.stdout:(78/174): python3-jsonpatch-1.21-16.el9.noarch. 96 kB/s | 26 kB 00:00 2024-04-15T00:18:44.208 INFO:teuthology.orchestra.run.smithi031.stdout:(79/174): python3-jsonpointer-2.0-4.el9.noarch. 74 kB/s | 19 kB 00:00 2024-04-15T00:18:44.273 INFO:teuthology.orchestra.run.smithi050.stdout:(75/174): protobuf-3.14.0-13.el9.x86_64.rpm 756 kB/s | 1.0 MB 00:01 2024-04-15T00:18:44.607 INFO:teuthology.orchestra.run.smithi050.stdout:(76/174): python3-devel-3.9.17-2.el9.x86_64.rpm 736 kB/s | 245 kB 00:00 2024-04-15T00:18:44.634 INFO:teuthology.orchestra.run.smithi031.stdout:(80/174): python3-mako-1.1.4-6.el9.noarch.rpm 405 kB/s | 172 kB 00:00 2024-04-15T00:18:44.900 INFO:teuthology.orchestra.run.smithi031.stdout:(81/174): python3-markupsafe-1.1.1-12.el9.x86_6 130 kB/s | 35 kB 00:00 2024-04-15T00:18:44.949 INFO:teuthology.orchestra.run.smithi050.stdout:(77/174): python3-jinja2-2.11.3-5.el9.noarch.rp 726 kB/s | 248 kB 00:00 2024-04-15T00:18:45.049 INFO:teuthology.orchestra.run.smithi050.stdout:(78/174): python3-jsonpatch-1.21-16.el9.noarch. 256 kB/s | 26 kB 00:00 2024-04-15T00:18:45.157 INFO:teuthology.orchestra.run.smithi050.stdout:(79/174): python3-jsonpointer-2.0-4.el9.noarch. 177 kB/s | 19 kB 00:00 2024-04-15T00:18:45.226 INFO:teuthology.orchestra.run.smithi031.stdout:(82/174): postgresql-server-13.14-1.el9.x86_64. 1.3 MB/s | 5.8 MB 00:04 2024-04-15T00:18:45.449 INFO:teuthology.orchestra.run.smithi050.stdout:(80/174): python3-mako-1.1.4-6.el9.noarch.rpm 590 kB/s | 172 kB 00:00 2024-04-15T00:18:45.558 INFO:teuthology.orchestra.run.smithi050.stdout:(81/174): python3-markupsafe-1.1.1-12.el9.x86_6 321 kB/s | 35 kB 00:00 2024-04-15T00:18:46.051 INFO:teuthology.orchestra.run.smithi031.stdout:(83/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 304 kB/s | 250 kB 00:00 2024-04-15T00:18:46.559 INFO:teuthology.orchestra.run.smithi031.stdout:(84/174): python3-oauthlib-3.1.1-5.el9.noarch.r 437 kB/s | 222 kB 00:00 2024-04-15T00:18:46.643 INFO:teuthology.orchestra.run.smithi031.stdout:(85/174): python3-babel-2.9.1-2.el9.noarch.rpm 1.4 MB/s | 6.0 MB 00:04 2024-04-15T00:18:46.927 INFO:teuthology.orchestra.run.smithi031.stdout:(86/174): python3-packaging-20.9-5.el9.noarch.r 210 kB/s | 77 kB 00:00 2024-04-15T00:18:46.985 INFO:teuthology.orchestra.run.smithi031.stdout:(87/174): python3-prettytable-0.7.2-27.el9.noar 124 kB/s | 42 kB 00:00 2024-04-15T00:18:47.452 INFO:teuthology.orchestra.run.smithi031.stdout:(88/174): python3-protobuf-3.14.0-13.el9.noarch 513 kB/s | 269 kB 00:00 2024-04-15T00:18:47.477 INFO:teuthology.orchestra.run.smithi031.stdout:(89/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 323 kB/s | 159 kB 00:00 2024-04-15T00:18:47.819 INFO:teuthology.orchestra.run.smithi031.stdout:(90/174): python3-pytz-2021.1-5.el9.noarch.rpm 149 kB/s | 51 kB 00:00 2024-04-15T00:18:47.970 INFO:teuthology.orchestra.run.smithi031.stdout:(91/174): python3-pyasn1-modules-0.4.8-6.el9.no 539 kB/s | 279 kB 00:00 2024-04-15T00:18:48.162 INFO:teuthology.orchestra.run.smithi031.stdout:(92/174): python3-requests-oauthlib-1.3.0-12.el 157 kB/s | 54 kB 00:00 2024-04-15T00:18:48.428 INFO:teuthology.orchestra.run.smithi031.stdout:(93/174): python3-toml-0.10.2-6.el9.noarch.rpm 156 kB/s | 42 kB 00:00 2024-04-15T00:18:48.821 INFO:teuthology.orchestra.run.smithi031.stdout:(94/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 113 kB/s | 44 kB 00:00 2024-04-15T00:18:48.946 INFO:teuthology.orchestra.run.smithi031.stdout:(95/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.3 MB/s | 5.1 MB 00:04 2024-04-15T00:18:49.229 INFO:teuthology.orchestra.run.smithi031.stdout:(96/174): qatlib-service-24.02.0-1.el9.x86_64.r 127 kB/s | 36 kB 00:00 2024-04-15T00:18:49.571 INFO:teuthology.orchestra.run.smithi031.stdout:(97/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 139 kB/s | 47 kB 00:00 2024-04-15T00:18:49.605 INFO:teuthology.orchestra.run.smithi031.stdout:(98/174): qatlib-24.02.0-1.el9.x86_64.rpm 282 kB/s | 221 kB 00:00 2024-04-15T00:18:49.955 INFO:teuthology.orchestra.run.smithi031.stdout:(99/174): uuid-1.6.2-55.el9.x86_64.rpm 165 kB/s | 58 kB 00:00 2024-04-15T00:18:50.158 INFO:teuthology.orchestra.run.smithi050.stdout:(82/174): postgresql-server-13.14-1.el9.x86_64. 759 kB/s | 5.8 MB 00:07 2024-04-15T00:18:50.222 INFO:teuthology.orchestra.run.smithi031.stdout:(100/174): socat-1.7.4.1-5.el9.x86_64.rpm 468 kB/s | 305 kB 00:00 2024-04-15T00:18:50.489 INFO:teuthology.orchestra.run.smithi031.stdout:(101/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 176 kB/s | 94 kB 00:00 2024-04-15T00:18:50.510 INFO:teuthology.orchestra.run.smithi050.stdout:(83/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 716 kB/s | 250 kB 00:00 2024-04-15T00:18:50.583 INFO:teuthology.orchestra.run.smithi031.stdout:(102/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 176 kB/s | 64 kB 00:00 2024-04-15T00:18:50.723 INFO:teuthology.orchestra.run.smithi031.stdout:(103/174): lua-devel-5.4.4-4.el9.x86_64.rpm 160 kB/s | 22 kB 00:00 2024-04-15T00:18:50.840 INFO:teuthology.orchestra.run.smithi031.stdout:(104/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 129 kB/s | 45 kB 00:00 2024-04-15T00:18:50.850 INFO:teuthology.orchestra.run.smithi050.stdout:(84/174): python3-oauthlib-3.1.1-5.el9.noarch.r 650 kB/s | 222 kB 00:00 2024-04-15T00:18:50.982 INFO:teuthology.orchestra.run.smithi031.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 3.3 MB/s | 863 kB 00:00 2024-04-15T00:18:51.067 INFO:teuthology.orchestra.run.smithi050.stdout:(85/174): python3-babel-2.9.1-2.el9.noarch.rpm 777 kB/s | 6.0 MB 00:07 2024-04-15T00:18:51.092 INFO:teuthology.orchestra.run.smithi050.stdout:(86/174): python3-packaging-20.9-5.el9.noarch.r 319 kB/s | 77 kB 00:00 2024-04-15T00:18:51.176 INFO:teuthology.orchestra.run.smithi050.stdout:(87/174): python3-prettytable-0.7.2-27.el9.noar 389 kB/s | 42 kB 00:00 2024-04-15T00:18:51.440 INFO:teuthology.orchestra.run.smithi031.stdout:(106/174): abseil-cpp-20211102.0-3.el9.x86_64.r 913 kB/s | 548 kB 00:00 2024-04-15T00:18:51.468 INFO:teuthology.orchestra.run.smithi050.stdout:(88/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 544 kB/s | 159 kB 00:00 2024-04-15T00:18:51.515 INFO:teuthology.orchestra.run.smithi031.stdout:(107/174): gperftools-libs-2.9.1-2.el9.x86_64.r 579 kB/s | 309 kB 00:00 2024-04-15T00:18:51.518 INFO:teuthology.orchestra.run.smithi050.stdout:(89/174): python3-protobuf-3.14.0-13.el9.noarch 633 kB/s | 269 kB 00:00 2024-04-15T00:18:51.541 INFO:teuthology.orchestra.run.smithi031.stdout:(108/174): grpc-data-1.46.7-10.el9.noarch.rpm 194 kB/s | 19 kB 00:00 2024-04-15T00:18:51.627 INFO:teuthology.orchestra.run.smithi050.stdout:(90/174): python3-pytz-2021.1-5.el9.noarch.rpm 471 kB/s | 51 kB 00:00 2024-04-15T00:18:51.650 INFO:teuthology.orchestra.run.smithi031.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 239 kB/s | 26 kB 00:00 2024-04-15T00:18:51.727 INFO:teuthology.orchestra.run.smithi050.stdout:(91/174): python3-requests-oauthlib-1.3.0-12.el 535 kB/s | 54 kB 00:00 2024-04-15T00:18:51.750 INFO:teuthology.orchestra.run.smithi031.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 486 kB/s | 49 kB 00:00 2024-04-15T00:18:51.850 INFO:teuthology.orchestra.run.smithi031.stdout:(111/174): libunwind-1.6.2-1.el9.x86_64.rpm 675 kB/s | 67 kB 00:00 2024-04-15T00:18:51.919 INFO:teuthology.orchestra.run.smithi050.stdout:(92/174): python3-pyasn1-modules-0.4.8-6.el9.no 618 kB/s | 279 kB 00:00 2024-04-15T00:18:51.951 INFO:teuthology.orchestra.run.smithi031.stdout:(112/174): luarocks-3.9.2-1.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2024-04-15T00:18:52.019 INFO:teuthology.orchestra.run.smithi050.stdout:(93/174): python3-toml-0.10.2-6.el9.noarch.rpm 416 kB/s | 42 kB 00:00 2024-04-15T00:18:52.120 INFO:teuthology.orchestra.run.smithi050.stdout:(94/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 442 kB/s | 44 kB 00:00 2024-04-15T00:18:52.245 INFO:teuthology.orchestra.run.smithi050.stdout:(95/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 781 kB/s | 5.1 MB 00:06 2024-04-15T00:18:52.276 INFO:teuthology.orchestra.run.smithi031.stdout:(113/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.5 MB/s | 838 kB 00:00 2024-04-15T00:18:52.337 INFO:teuthology.orchestra.run.smithi050.stdout:(96/174): qatlib-service-24.02.0-1.el9.x86_64.r 391 kB/s | 36 kB 00:00 2024-04-15T00:18:52.437 INFO:teuthology.orchestra.run.smithi050.stdout:(97/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 475 kB/s | 47 kB 00:00 2024-04-15T00:18:52.476 INFO:teuthology.orchestra.run.smithi031.stdout:(114/174): python3-asyncssh-2.13.2-5.el9.noarch 2.7 MB/s | 548 kB 00:00 2024-04-15T00:18:52.504 INFO:teuthology.orchestra.run.smithi050.stdout:(98/174): qatlib-24.02.0-1.el9.x86_64.rpm 574 kB/s | 221 kB 00:00 2024-04-15T00:18:52.605 INFO:teuthology.orchestra.run.smithi050.stdout:(99/174): uuid-1.6.2-55.el9.x86_64.rpm 578 kB/s | 58 kB 00:00 2024-04-15T00:18:52.701 INFO:teuthology.orchestra.run.smithi031.stdout:(115/174): libarrow-9.0.0-10.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2024-04-15T00:18:52.718 INFO:teuthology.orchestra.run.smithi031.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 179 kB/s | 43 kB 00:00 2024-04-15T00:18:52.785 INFO:teuthology.orchestra.run.smithi031.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 385 kB/s | 32 kB 00:00 2024-04-15T00:18:52.788 INFO:teuthology.orchestra.run.smithi050.stdout:(100/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 512 kB/s | 94 kB 00:00 2024-04-15T00:18:52.810 INFO:teuthology.orchestra.run.smithi031.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 163 kB/s | 15 kB 00:00 2024-04-15T00:18:52.872 INFO:teuthology.orchestra.run.smithi050.stdout:(101/174): socat-1.7.4.1-5.el9.x86_64.rpm 702 kB/s | 305 kB 00:00 2024-04-15T00:18:52.886 INFO:teuthology.orchestra.run.smithi031.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2024-04-15T00:18:52.972 INFO:teuthology.orchestra.run.smithi050.stdout:(102/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 346 kB/s | 64 kB 00:00 2024-04-15T00:18:52.997 INFO:teuthology.orchestra.run.smithi050.stdout:(103/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 360 kB/s | 45 kB 00:00 2024-04-15T00:18:53.072 INFO:teuthology.orchestra.run.smithi050.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 298 kB/s | 22 kB 00:00 2024-04-15T00:18:53.178 INFO:teuthology.orchestra.run.smithi031.stdout:(120/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.1 MB/s | 16 MB 00:05 2024-04-15T00:18:53.181 INFO:teuthology.orchestra.run.smithi050.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 4.6 MB/s | 863 kB 00:00 2024-04-15T00:18:53.298 INFO:teuthology.orchestra.run.smithi050.stdout:(106/174): abseil-cpp-20211102.0-3.el9.x86_64.r 2.4 MB/s | 548 kB 00:00 2024-04-15T00:18:53.340 INFO:teuthology.orchestra.run.smithi050.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 469 kB/s | 19 kB 00:00 2024-04-15T00:18:53.390 INFO:teuthology.orchestra.run.smithi050.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 1.4 MB/s | 309 kB 00:00 2024-04-15T00:18:53.420 INFO:teuthology.orchestra.run.smithi031.stdout:(121/174): python3-colorama-0.4.4-12.el9.noarch 146 kB/s | 35 kB 00:00 2024-04-15T00:18:53.432 INFO:teuthology.orchestra.run.smithi050.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 625 kB/s | 26 kB 00:00 2024-04-15T00:18:53.483 INFO:teuthology.orchestra.run.smithi050.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 973 kB/s | 49 kB 00:00 2024-04-15T00:18:53.575 INFO:teuthology.orchestra.run.smithi050.stdout:(111/174): libarrow-9.0.0-10.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2024-04-15T00:18:53.600 INFO:teuthology.orchestra.run.smithi050.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 577 kB/s | 67 kB 00:00 2024-04-15T00:18:53.617 INFO:teuthology.orchestra.run.smithi050.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2024-04-15T00:18:53.667 INFO:teuthology.orchestra.run.smithi050.stdout:(114/174): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-04-15T00:18:53.695 INFO:teuthology.orchestra.run.smithi031.stdout:(122/174): python3-cherrypy-18.6.1-2.el9.noarch 405 kB/s | 358 kB 00:00 2024-04-15T00:18:53.718 INFO:teuthology.orchestra.run.smithi050.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 867 kB/s | 43 kB 00:00 2024-04-15T00:18:53.743 INFO:teuthology.orchestra.run.smithi050.stdout:(116/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 5.7 MB/s | 838 kB 00:00 2024-04-15T00:18:53.768 INFO:teuthology.orchestra.run.smithi050.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 643 kB/s | 32 kB 00:00 2024-04-15T00:18:53.795 INFO:teuthology.orchestra.run.smithi031.stdout:(123/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 333 kB/s | 303 kB 00:00 2024-04-15T00:18:53.801 INFO:teuthology.orchestra.run.smithi050.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 256 kB/s | 15 kB 00:00 2024-04-15T00:18:53.827 INFO:teuthology.orchestra.run.smithi050.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-04-15T00:18:53.869 INFO:teuthology.orchestra.run.smithi050.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-04-15T00:18:53.894 INFO:teuthology.orchestra.run.smithi050.stdout:(121/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-04-15T00:18:53.920 INFO:teuthology.orchestra.run.smithi050.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 701 kB/s | 35 kB 00:00 2024-04-15T00:18:53.929 INFO:teuthology.orchestra.run.smithi031.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-04-15T00:18:53.945 INFO:teuthology.orchestra.run.smithi050.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 4.0 MB/s | 203 kB 00:00 2024-04-15T00:18:53.995 INFO:teuthology.orchestra.run.smithi050.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-04-15T00:18:53.996 INFO:teuthology.orchestra.run.smithi031.stdout:(125/174): python3-google-auth-2.28.2-1.el9.noa 352 kB/s | 203 kB 00:00 2024-04-15T00:18:54.037 INFO:teuthology.orchestra.run.smithi050.stdout:(125/174): python3-grpcio-1.46.7-10.el9.x86_64. 17 MB/s | 2.0 MB 00:00 2024-04-15T00:18:54.054 INFO:teuthology.orchestra.run.smithi031.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 85 kB/s | 11 kB 00:00 2024-04-15T00:18:54.062 INFO:teuthology.orchestra.run.smithi050.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 160 kB/s | 11 kB 00:00 2024-04-15T00:18:54.088 INFO:teuthology.orchestra.run.smithi050.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-04-15T00:18:54.113 INFO:teuthology.orchestra.run.smithi050.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-04-15T00:18:54.121 INFO:teuthology.orchestra.run.smithi031.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 141 kB/s | 18 kB 00:00 2024-04-15T00:18:54.138 INFO:teuthology.orchestra.run.smithi050.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-04-15T00:18:54.163 INFO:teuthology.orchestra.run.smithi050.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 394 kB/s | 20 kB 00:00 2024-04-15T00:18:54.206 INFO:teuthology.orchestra.run.smithi050.stdout:(131/174): python3-kubernetes-26.1.0-2.el9.noar 15 MB/s | 1.0 MB 00:00 2024-04-15T00:18:54.213 INFO:teuthology.orchestra.run.smithi031.stdout:(128/174): python3-jaraco-functools-3.5.0-2.el9 212 kB/s | 19 kB 00:00 2024-04-15T00:18:54.231 INFO:teuthology.orchestra.run.smithi050.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 690 kB/s | 46 kB 00:00 2024-04-15T00:18:54.256 INFO:teuthology.orchestra.run.smithi050.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-04-15T00:18:54.281 INFO:teuthology.orchestra.run.smithi050.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-04-15T00:18:54.307 INFO:teuthology.orchestra.run.smithi050.stdout:(135/174): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2024-04-15T00:18:54.421 INFO:teuthology.orchestra.run.smithi050.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 118 kB/s | 16 kB 00:00 2024-04-15T00:18:54.457 INFO:teuthology.orchestra.run.smithi050.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 598 kB/s | 90 kB 00:00 2024-04-15T00:18:54.483 INFO:teuthology.orchestra.run.smithi050.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 458 kB/s | 28 kB 00:00 2024-04-15T00:18:54.508 INFO:teuthology.orchestra.run.smithi050.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-04-15T00:18:54.520 INFO:teuthology.orchestra.run.smithi031.stdout:(129/174): python3-jaraco-text-3.2.0-6.el9.noar 64 kB/s | 20 kB 00:00 2024-04-15T00:18:54.533 INFO:teuthology.orchestra.run.smithi050.stdout:(140/174): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-04-15T00:18:54.559 INFO:teuthology.orchestra.run.smithi050.stdout:(141/174): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-04-15T00:18:54.603 INFO:teuthology.orchestra.run.smithi050.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 514 kB/s | 36 kB 00:00 2024-04-15T00:18:54.626 INFO:teuthology.orchestra.run.smithi050.stdout:(143/174): python3-typing-extensions-4.4.0-2.el 761 kB/s | 51 kB 00:00 2024-04-15T00:18:54.655 INFO:teuthology.orchestra.run.smithi031.stdout:(130/174): python3-jaraco-collections-3.0.0-8.e 38 kB/s | 23 kB 00:00 2024-04-15T00:18:54.676 INFO:teuthology.orchestra.run.smithi050.stdout:(144/174): python3-webob-1.8.7-6.el9.noarch.rpm 3.1 MB/s | 230 kB 00:00 2024-04-15T00:18:54.697 INFO:teuthology.orchestra.run.smithi031.stdout:(131/174): python3-grpcio-1.46.7-10.el9.x86_64. 2.0 MB/s | 2.0 MB 00:01 2024-04-15T00:18:54.701 INFO:teuthology.orchestra.run.smithi050.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-04-15T00:18:54.727 INFO:teuthology.orchestra.run.smithi050.stdout:(146/174): python3-werkzeug-2.0.3-3.el9.1.noarc 8.3 MB/s | 427 kB 00:00 2024-04-15T00:18:54.744 INFO:teuthology.orchestra.run.smithi050.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 475 kB/s | 20 kB 00:00 2024-04-15T00:18:54.747 INFO:teuthology.orchestra.run.smithi031.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 503 kB/s | 46 kB 00:00 2024-04-15T00:18:54.786 INFO:teuthology.orchestra.run.smithi050.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-04-15T00:18:54.815 INFO:teuthology.orchestra.run.smithi031.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 674 kB/s | 79 kB 00:00 2024-04-15T00:18:54.829 INFO:teuthology.orchestra.run.smithi050.stdout:(149/174): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-04-15T00:18:54.848 INFO:teuthology.orchestra.run.smithi031.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 575 kB/s | 58 kB 00:00 2024-04-15T00:18:54.940 INFO:teuthology.orchestra.run.smithi031.stdout:(135/174): python3-portend-3.1.0-2.el9.noarch.r 179 kB/s | 16 kB 00:00 2024-04-15T00:18:55.066 INFO:teuthology.orchestra.run.smithi031.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 1.1 MB/s | 272 kB 00:00 2024-04-15T00:18:55.166 INFO:teuthology.orchestra.run.smithi031.stdout:(137/174): python3-pyperclip-1.8.2-2.el9.noarch 282 kB/s | 28 kB 00:00 2024-04-15T00:18:55.245 INFO:teuthology.orchestra.run.smithi050.stdout:(150/174): librbd1-19.0.0-2114.ga9a752df.el7.x8 7.5 MB/s | 3.1 MB 00:00 2024-04-15T00:18:55.325 INFO:teuthology.orchestra.run.smithi031.stdout:(138/174): python3-repoze-lru-0.7-16.el9.noarch 194 kB/s | 31 kB 00:00 2024-04-15T00:18:55.363 INFO:teuthology.orchestra.run.smithi050.stdout:(151/174): librados2-19.0.0-2114.ga9a752df.el7. 5.9 MB/s | 3.4 MB 00:00 2024-04-15T00:18:55.375 INFO:teuthology.orchestra.run.smithi031.stdout:(139/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 207 kB/s | 90 kB 00:00 2024-04-15T00:18:55.434 INFO:teuthology.orchestra.run.smithi031.stdout:(140/174): python3-kubernetes-26.1.0-2.el9.noar 1.1 MB/s | 1.0 MB 00:00 2024-04-15T00:18:55.467 INFO:teuthology.orchestra.run.smithi031.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-04-15T00:18:55.493 INFO:teuthology.orchestra.run.smithi031.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 504 kB/s | 59 kB 00:00 2024-04-15T00:18:55.526 INFO:teuthology.orchestra.run.smithi031.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 388 kB/s | 36 kB 00:00 2024-04-15T00:18:55.568 INFO:teuthology.orchestra.run.smithi031.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 508 kB/s | 51 kB 00:00 2024-04-15T00:18:55.587 INFO:teuthology.orchestra.run.smithi050.stdout:(152/174): NetworkManager-1.47.4-1.el9.x86_64.r 6.8 MB/s | 2.3 MB 00:00 2024-04-15T00:18:55.643 INFO:teuthology.orchestra.run.smithi031.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 767 kB/s | 90 kB 00:00 2024-04-15T00:18:55.654 INFO:teuthology.orchestra.run.smithi050.stdout:(153/174): NetworkManager-libnm-1.47.4-1.el9.x8 6.3 MB/s | 1.8 MB 00:00 2024-04-15T00:18:55.669 INFO:teuthology.orchestra.run.smithi031.stdout:(146/174): python3-webob-1.8.7-6.el9.noarch.rpm 1.3 MB/s | 230 kB 00:00 2024-04-15T00:18:55.679 INFO:teuthology.orchestra.run.smithi050.stdout:(154/174): NetworkManager-team-1.47.4-1.el9.x86 455 kB/s | 42 kB 00:00 2024-04-15T00:18:55.713 INFO:teuthology.orchestra.run.smithi050.stdout:(155/174): NetworkManager-tui-1.47.4-1.el9.x86_ 4.2 MB/s | 249 kB 00:00 2024-04-15T00:18:55.735 INFO:teuthology.orchestra.run.smithi031.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 2.5 MB/s | 427 kB 00:00 2024-04-15T00:18:55.738 INFO:teuthology.orchestra.run.smithi050.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 1.2 MB/s | 71 kB 00:00 2024-04-15T00:18:55.761 INFO:teuthology.orchestra.run.smithi031.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 170 kB/s | 20 kB 00:00 2024-04-15T00:18:55.763 INFO:teuthology.orchestra.run.smithi050.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 725 kB/s | 36 kB 00:00 2024-04-15T00:18:55.797 INFO:teuthology.orchestra.run.smithi050.stdout:(158/174): elfutils-libelf-0.190-2.el9.x86_64.r 3.2 MB/s | 192 kB 00:00 2024-04-15T00:18:55.811 INFO:teuthology.orchestra.run.smithi031.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 1.3 MB/s | 192 kB 00:00 2024-04-15T00:18:55.822 INFO:teuthology.orchestra.run.smithi050.stdout:(159/174): elfutils-libs-0.190-2.el9.x86_64.rpm 4.3 MB/s | 256 kB 00:00 2024-04-15T00:18:55.848 INFO:teuthology.orchestra.run.smithi050.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 457 kB/s | 23 kB 00:00 2024-04-15T00:18:55.873 INFO:teuthology.orchestra.run.smithi050.stdout:(161/174): libblkid-2.37.4-18.el9.x86_64.rpm 2.1 MB/s | 108 kB 00:00 2024-04-15T00:18:55.898 INFO:teuthology.orchestra.run.smithi050.stdout:(162/174): libfdisk-2.37.4-18.el9.x86_64.rpm 3.0 MB/s | 155 kB 00:00 2024-04-15T00:18:55.920 INFO:teuthology.orchestra.run.smithi031.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 8.6 MB/s | 1.6 MB 00:00 2024-04-15T00:18:55.923 INFO:teuthology.orchestra.run.smithi050.stdout:(163/174): libmount-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 136 kB 00:00 2024-04-15T00:18:55.949 INFO:teuthology.orchestra.run.smithi050.stdout:(164/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.2 MB/s | 64 kB 00:00 2024-04-15T00:18:55.974 INFO:teuthology.orchestra.run.smithi050.stdout:(165/174): libuuid-2.37.4-18.el9.x86_64.rpm 571 kB/s | 29 kB 00:00 2024-04-15T00:18:56.075 INFO:teuthology.orchestra.run.smithi050.stdout:(166/174): openssl-3.0.7-27.el9.x86_64.rpm 9.7 MB/s | 1.2 MB 00:00 2024-04-15T00:18:56.137 INFO:teuthology.orchestra.run.smithi031.stdout:(151/174): librados2-19.0.0-2114.ga9a752df.el7. 9.0 MB/s | 3.4 MB 00:00 2024-04-15T00:18:56.208 INFO:teuthology.orchestra.run.smithi050.stdout:(167/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 9.2 MB/s | 2.2 MB 00:00 2024-04-15T00:18:56.220 INFO:teuthology.orchestra.run.smithi031.stdout:(152/174): librbd1-19.0.0-2114.ga9a752df.el7.x8 7.7 MB/s | 3.1 MB 00:00 2024-04-15T00:18:56.275 INFO:teuthology.orchestra.run.smithi050.stdout:(168/174): util-linux-2.37.4-18.el9.x86_64.rpm 11 MB/s | 2.3 MB 00:00 2024-04-15T00:18:56.329 INFO:teuthology.orchestra.run.smithi031.stdout:(153/174): NetworkManager-1.47.4-1.el9.x86_64.r 5.7 MB/s | 2.3 MB 00:00 2024-04-15T00:18:56.334 INFO:teuthology.orchestra.run.smithi050.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 3.6 MB/s | 465 kB 00:00 2024-04-15T00:18:56.346 INFO:teuthology.orchestra.run.smithi031.stdout:(154/174): NetworkManager-team-1.47.4-1.el9.x86 334 kB/s | 42 kB 00:00 2024-04-15T00:18:56.359 INFO:teuthology.orchestra.run.smithi050.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 372 kB/s | 31 kB 00:00 2024-04-15T00:18:56.388 INFO:teuthology.orchestra.run.smithi031.stdout:(155/174): NetworkManager-tui-1.47.4-1.el9.x86_ 4.2 MB/s | 249 kB 00:00 2024-04-15T00:18:56.392 INFO:teuthology.orchestra.run.smithi050.stdout:(171/174): xfsdump-3.1.12-4.el9.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2024-04-15T00:18:56.438 INFO:teuthology.orchestra.run.smithi031.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 776 kB/s | 71 kB 00:00 2024-04-15T00:18:56.455 INFO:teuthology.orchestra.run.smithi031.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 545 kB/s | 36 kB 00:00 2024-04-15T00:18:56.484 INFO:teuthology.orchestra.run.smithi050.stdout:(172/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 8.6 MB/s | 1.1 MB 00:00 2024-04-15T00:18:56.522 INFO:teuthology.orchestra.run.smithi031.stdout:(158/174): elfutils-libs-0.190-2.el9.x86_64.rpm 3.8 MB/s | 256 kB 00:00 2024-04-15T00:18:56.555 INFO:teuthology.orchestra.run.smithi031.stdout:(159/174): elfutils-libelf-0.190-2.el9.x86_64.r 1.6 MB/s | 192 kB 00:00 2024-04-15T00:18:56.581 INFO:teuthology.orchestra.run.smithi031.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 392 kB/s | 23 kB 00:00 2024-04-15T00:18:56.606 INFO:teuthology.orchestra.run.smithi031.stdout:(161/174): libblkid-2.37.4-18.el9.x86_64.rpm 2.1 MB/s | 108 kB 00:00 2024-04-15T00:18:56.640 INFO:teuthology.orchestra.run.smithi031.stdout:(162/174): libfdisk-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 155 kB 00:00 2024-04-15T00:18:56.660 INFO:teuthology.orchestra.run.smithi050.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 278 kB/s | 74 kB 00:00 2024-04-15T00:18:56.665 INFO:teuthology.orchestra.run.smithi031.stdout:(163/174): libmount-2.37.4-18.el9.x86_64.rpm 2.3 MB/s | 136 kB 00:00 2024-04-15T00:18:56.699 INFO:teuthology.orchestra.run.smithi031.stdout:(164/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.1 MB/s | 64 kB 00:00 2024-04-15T00:18:56.724 INFO:teuthology.orchestra.run.smithi031.stdout:(165/174): libuuid-2.37.4-18.el9.x86_64.rpm 490 kB/s | 29 kB 00:00 2024-04-15T00:18:56.782 INFO:teuthology.orchestra.run.smithi031.stdout:(166/174): openssl-3.0.7-27.el9.x86_64.rpm 15 MB/s | 1.2 MB 00:00 2024-04-15T00:18:56.900 INFO:teuthology.orchestra.run.smithi031.stdout:(167/174): util-linux-2.37.4-18.el9.x86_64.rpm 20 MB/s | 2.3 MB 00:00 2024-04-15T00:18:56.966 INFO:teuthology.orchestra.run.smithi031.stdout:(168/174): util-linux-core-2.37.4-18.el9.x86_64 6.8 MB/s | 465 kB 00:00 2024-04-15T00:18:57.025 INFO:teuthology.orchestra.run.smithi031.stdout:(169/174): util-linux-user-2.37.4-18.el9.x86_64 534 kB/s | 31 kB 00:00 2024-04-15T00:18:57.084 INFO:teuthology.orchestra.run.smithi031.stdout:(170/174): xfsdump-3.1.12-4.el9.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2024-04-15T00:18:57.126 INFO:teuthology.orchestra.run.smithi031.stdout:(171/174): NetworkManager-libnm-1.47.4-1.el9.x8 1.9 MB/s | 1.8 MB 00:00 2024-04-15T00:18:57.168 INFO:teuthology.orchestra.run.smithi031.stdout:(172/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-04-15T00:18:57.243 INFO:teuthology.orchestra.run.smithi031.stdout:(173/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 4.2 MB/s | 2.2 MB 00:00 2024-04-15T00:18:57.585 INFO:teuthology.orchestra.run.smithi031.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 162 kB/s | 74 kB 00:00 2024-04-15T00:18:57.588 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-04-15T00:18:57.589 INFO:teuthology.orchestra.run.smithi031.stdout:Total 7.4 MB/s | 228 MB 00:30 2024-04-15T00:18:58.895 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-04-15T00:18:59.201 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-04-15T00:18:59.201 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-04-15T00:19:01.447 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-04-15T00:19:01.447 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-04-15T00:19:04.102 INFO:teuthology.orchestra.run.smithi050.stdout:(174/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 1.3 MB/s | 16 MB 00:12 2024-04-15T00:19:04.104 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-04-15T00:19:04.104 INFO:teuthology.orchestra.run.smithi050.stdout:Total 7.0 MB/s | 228 MB 00:32 2024-04-15T00:19:05.423 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2024-04-15T00:19:05.728 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2024-04-15T00:19:05.728 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2024-04-15T00:19:07.989 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2024-04-15T00:19:07.989 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2024-04-15T00:19:08.852 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-04-15T00:19:08.939 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-15T00:19:08.974 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-15T00:19:09.012 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-15T00:19:09.021 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-15T00:19:09.067 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-15T00:19:09.116 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-15T00:19:09.157 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-15T00:19:09.191 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-15T00:19:09.242 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-15T00:19:09.647 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-15T00:19:09.693 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 10/198 2024-04-15T00:19:09.817 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 10/198 2024-04-15T00:19:09.961 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 11/198 2024-04-15T00:19:10.036 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 11/198 2024-04-15T00:19:10.065 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rados-2:19.0.0-2114.ga9a752df.el7.x86_64 12/198 2024-04-15T00:19:10.101 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-15T00:19:10.278 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-15T00:19:10.330 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-15T00:19:10.357 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 16/198 2024-04-15T00:19:10.446 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 16/198 2024-04-15T00:19:10.475 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86 17/198 2024-04-15T00:19:10.540 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86 17/198 2024-04-15T00:19:10.571 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-15T00:19:10.593 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-15T00:19:10.609 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-15T00:19:10.802 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-15T00:19:10.834 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-15T00:19:10.864 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-15T00:19:11.036 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-15T00:19:11.170 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-15T00:19:11.214 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-15T00:19:11.314 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-15T00:19:11.357 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-15T00:19:11.571 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-15T00:19:11.682 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-15T00:19:11.794 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-15T00:19:11.828 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-15T00:19:11.863 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-15T00:19:11.929 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 29/198 2024-04-15T00:19:11.962 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 30/198 2024-04-15T00:19:12.006 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 31/198 2024-04-15T00:19:12.039 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 32/198 2024-04-15T00:19:12.066 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : lua-5.4.4-4.el9.x86_64 33/198 2024-04-15T00:19:12.137 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 34/198 2024-04-15T00:19:12.314 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 35/198 2024-04-15T00:19:12.344 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 36/198 2024-04-15T00:19:12.379 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 37/198 2024-04-15T00:19:12.456 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 38/198 2024-04-15T00:19:12.490 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ceph-common-2:19.0.0-2114.ga9a752df.el7. 39/198 2024-04-15T00:19:12.534 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ceph-argparse-2:19.0.0-2114.ga9a752df.el 40/198 2024-04-15T00:19:12.562 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cephfs-2:19.0.0-2114.ga9a752df.el7.x86_6 41/198 2024-04-15T00:19:12.632 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-15T00:19:12.677 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-15T00:19:12.752 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-15T00:19:12.897 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-15T00:19:12.954 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-15T00:19:13.509 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-15T00:19:13.592 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-15T00:19:13.672 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-15T00:19:13.710 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-15T00:19:13.719 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-15T00:19:13.756 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-15T00:19:13.809 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-15T00:19:13.845 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librados-devel-2:19.0.0-2114.ga9a752df.el7.x86_6 53/198 2024-04-15T00:19:13.876 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-15T00:19:14.168 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-15T00:19:14.350 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-15T00:19:14.435 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-15T00:19:14.480 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-15T00:19:14.629 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-15T00:19:14.674 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-15T00:19:14.730 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-15T00:19:14.803 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-15T00:19:14.840 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-15T00:19:14.878 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-15T00:19:14.925 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-15T00:19:14.968 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-15T00:19:15.012 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-15T00:19:15.054 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-15T00:19:15.193 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-15T00:19:15.251 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-15T00:19:15.274 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2024-04-15T00:19:15.280 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-15T00:19:15.323 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-15T00:19:15.373 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-15T00:19:15.408 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-15T00:19:15.418 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-15T00:19:15.449 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-15T00:19:15.455 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-15T00:19:15.458 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-15T00:19:15.495 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-15T00:19:15.507 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-15T00:19:15.520 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-15T00:19:15.545 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-15T00:19:15.567 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-15T00:19:15.612 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-15T00:19:15.623 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-15T00:19:15.637 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-15T00:19:15.691 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-15T00:19:15.760 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-15T00:19:15.803 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-15T00:19:15.839 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 81/198 2024-04-15T00:19:15.873 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 82/198 2024-04-15T00:19:15.913 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : uuid-1.6.2-55.el9.x86_64 83/198 2024-04-15T00:19:15.944 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 84/198 2024-04-15T00:19:15.973 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 85/198 2024-04-15T00:19:16.008 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 86/198 2024-04-15T00:19:16.041 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 87/198 2024-04-15T00:19:16.042 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-15T00:19:16.083 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 88/198 2024-04-15T00:19:16.096 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 10/198 2024-04-15T00:19:16.117 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 89/198 2024-04-15T00:19:16.203 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 10/198 2024-04-15T00:19:16.207 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 90/198 2024-04-15T00:19:16.256 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 91/198 2024-04-15T00:19:16.286 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 92/198 2024-04-15T00:19:16.348 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 11/198 2024-04-15T00:19:16.351 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 93/198 2024-04-15T00:19:16.440 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 11/198 2024-04-15T00:19:16.452 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-packaging-20.9-5.el9.noarch 94/198 2024-04-15T00:19:16.469 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rados-2:19.0.0-2114.ga9a752df.el7.x86_64 12/198 2024-04-15T00:19:16.505 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 95/198 2024-04-15T00:19:16.512 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-15T00:19:16.705 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-15T00:19:16.759 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-15T00:19:16.786 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 16/198 2024-04-15T00:19:16.891 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 16/198 2024-04-15T00:19:16.920 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86 17/198 2024-04-15T00:19:16.986 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86 17/198 2024-04-15T00:19:17.025 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-15T00:19:17.047 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-15T00:19:17.062 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-15T00:19:17.253 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-15T00:19:17.270 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 96/198 2024-04-15T00:19:17.293 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-15T00:19:17.309 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 97/198 2024-04-15T00:19:17.324 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-15T00:19:17.343 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 98/198 2024-04-15T00:19:17.446 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 99/198 2024-04-15T00:19:17.500 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-15T00:19:17.510 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 100/198 2024-04-15T00:19:17.600 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 101/198 2024-04-15T00:19:17.617 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-15T00:19:17.637 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 102/198 2024-04-15T00:19:17.678 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-15T00:19:17.776 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-15T00:19:17.812 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-15T00:19:17.822 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : openblas-0.3.21-2.el9.x86_64 103/198 2024-04-15T00:19:17.851 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 104/198 2024-04-15T00:19:17.935 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 105/198 2024-04-15T00:19:18.029 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-15T00:19:18.137 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-15T00:19:18.233 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-15T00:19:18.384 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-15T00:19:18.427 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-15T00:19:18.503 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 29/198 2024-04-15T00:19:18.543 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 30/198 2024-04-15T00:19:18.587 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 31/198 2024-04-15T00:19:18.609 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 106/198 2024-04-15T00:19:18.619 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 32/198 2024-04-15T00:19:18.646 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lua-5.4.4-4.el9.x86_64 33/198 2024-04-15T00:19:18.717 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 34/198 2024-04-15T00:19:18.725 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 107/198 2024-04-15T00:19:18.778 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 35/198 2024-04-15T00:19:18.808 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 36/198 2024-04-15T00:19:18.852 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 37/198 2024-04-15T00:19:18.929 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 38/198 2024-04-15T00:19:18.962 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-common-2:19.0.0-2114.ga9a752df.el7. 39/198 2024-04-15T00:19:18.998 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-argparse-2:19.0.0-2114.ga9a752df.el 40/198 2024-04-15T00:19:19.026 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cephfs-2:19.0.0-2114.ga9a752df.el7.x86_6 41/198 2024-04-15T00:19:19.098 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-15T00:19:19.140 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-15T00:19:19.225 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-15T00:19:19.363 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-15T00:19:19.410 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-15T00:19:19.975 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-15T00:19:20.027 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 108/198 2024-04-15T00:19:20.058 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-15T00:19:20.110 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 109/198 2024-04-15T00:19:20.137 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 110/198 2024-04-15T00:19:20.155 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-15T00:19:20.225 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-15T00:19:20.234 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-15T00:19:20.283 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-15T00:19:20.324 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-15T00:19:20.360 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librados-devel-2:19.0.0-2114.ga9a752df.el7.x86_6 53/198 2024-04-15T00:19:20.391 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-15T00:19:20.465 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 111/198 2024-04-15T00:19:20.492 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 112/198 2024-04-15T00:19:20.583 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 112/198 2024-04-15T00:19:20.614 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rbd-2:19.0.0-2114.ga9a752df.el7.x86_64 113/198 2024-04-15T00:19:20.650 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 114/198 2024-04-15T00:19:20.860 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-15T00:19:21.135 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-15T00:19:21.161 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 116/198 2024-04-15T00:19:21.175 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-15T00:19:21.215 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 116/198 2024-04-15T00:19:21.237 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rgw-2:19.0.0-2114.ga9a752df.el7.x86_64 117/198 2024-04-15T00:19:21.250 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-15T00:19:21.287 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-15T00:19:21.428 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-15T00:19:21.473 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-15T00:19:21.528 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-15T00:19:21.602 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-15T00:19:21.640 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-15T00:19:21.677 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-15T00:19:21.724 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-15T00:19:21.760 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-15T00:19:21.803 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-15T00:19:21.844 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-15T00:19:22.002 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-15T00:19:22.042 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-15T00:19:22.072 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-15T00:19:22.114 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-15T00:19:22.212 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-15T00:19:22.246 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-15T00:19:22.299 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-15T00:19:22.329 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-15T00:19:22.353 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-15T00:19:22.442 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-15T00:19:22.575 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-15T00:19:22.611 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-15T00:19:22.639 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 81/198 2024-04-15T00:19:22.673 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 82/198 2024-04-15T00:19:22.713 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : uuid-1.6.2-55.el9.x86_64 83/198 2024-04-15T00:19:22.744 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 84/198 2024-04-15T00:19:22.774 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 85/198 2024-04-15T00:19:22.808 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 86/198 2024-04-15T00:19:22.841 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 87/198 2024-04-15T00:19:22.909 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 88/198 2024-04-15T00:19:22.942 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 89/198 2024-04-15T00:19:23.032 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 90/198 2024-04-15T00:19:23.073 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 91/198 2024-04-15T00:19:23.112 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 92/198 2024-04-15T00:19:23.161 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 93/198 2024-04-15T00:19:23.269 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-packaging-20.9-5.el9.noarch 94/198 2024-04-15T00:19:23.323 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 95/198 2024-04-15T00:19:23.570 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 118/198 2024-04-15T00:19:23.600 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 118/198 2024-04-15T00:19:24.098 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 96/198 2024-04-15T00:19:24.144 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 97/198 2024-04-15T00:19:24.172 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 118/198 2024-04-15T00:19:24.178 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 98/198 2024-04-15T00:19:24.212 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 119/198 2024-04-15T00:19:24.280 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 99/198 2024-04-15T00:19:24.303 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 119/198 2024-04-15T00:19:24.303 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-15T00:19:24.303 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-15T00:19:24.303 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:19:24.336 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 100/198 2024-04-15T00:19:24.338 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 120/198 2024-04-15T00:19:24.427 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 101/198 2024-04-15T00:19:24.463 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 102/198 2024-04-15T00:19:24.648 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-0.3.21-2.el9.x86_64 103/198 2024-04-15T00:19:24.686 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 104/198 2024-04-15T00:19:24.769 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 105/198 2024-04-15T00:19:25.452 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 106/198 2024-04-15T00:19:25.579 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 107/198 2024-04-15T00:19:26.876 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 108/198 2024-04-15T00:19:26.957 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 109/198 2024-04-15T00:19:26.984 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 110/198 2024-04-15T00:19:27.313 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 111/198 2024-04-15T00:19:27.347 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 112/198 2024-04-15T00:19:27.438 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 112/198 2024-04-15T00:19:27.469 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rbd-2:19.0.0-2114.ga9a752df.el7.x86_64 113/198 2024-04-15T00:19:27.506 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 114/198 2024-04-15T00:19:27.990 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-15T00:19:28.017 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 116/198 2024-04-15T00:19:28.080 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 116/198 2024-04-15T00:19:28.102 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rgw-2:19.0.0-2114.ga9a752df.el7.x86_64 117/198 2024-04-15T00:19:30.411 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 118/198 2024-04-15T00:19:30.440 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 118/198 2024-04-15T00:19:31.014 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 118/198 2024-04-15T00:19:31.052 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 119/198 2024-04-15T00:19:31.130 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 119/198 2024-04-15T00:19:31.131 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-15T00:19:31.131 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-15T00:19:31.131 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:19:31.162 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 120/198 2024-04-15T00:19:36.378 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 120/198 2024-04-15T00:19:36.378 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /sys 2024-04-15T00:19:36.378 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /proc 2024-04-15T00:19:36.378 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /mnt 2024-04-15T00:19:36.378 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /var/tmp 2024-04-15T00:19:36.378 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /home 2024-04-15T00:19:36.378 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /root 2024-04-15T00:19:36.378 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /tmp 2024-04-15T00:19:36.378 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:19:36.547 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 121/198 2024-04-15T00:19:36.561 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 121/198 2024-04-15T00:19:36.562 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T00:19:36.562 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-15T00:19:36.562 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:19:38.091 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 122/198 2024-04-15T00:19:38.116 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 122/198 2024-04-15T00:19:38.116 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T00:19:38.116 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-15T00:19:38.116 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-15T00:19:38.116 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-15T00:19:38.117 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:19:38.351 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 123/198 2024-04-15T00:19:38.374 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 123/198 2024-04-15T00:19:38.374 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T00:19:38.374 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-15T00:19:38.374 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-15T00:19:38.374 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-15T00:19:38.374 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:19:38.836 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 124/198 2024-04-15T00:19:38.858 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 124/198 2024-04-15T00:19:38.858 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T00:19:38.859 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-15T00:19:38.859 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-15T00:19:38.859 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-15T00:19:38.859 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:19:38.975 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : automake-1.16.2-8.el9.noarch 125/198 2024-04-15T00:19:39.032 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ply-3.11-14.el9.noarch 126/198 2024-04-15T00:19:39.094 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 127/198 2024-04-15T00:19:39.295 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 128/198 2024-04-15T00:19:39.345 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 129/198 2024-04-15T00:19:39.425 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 130/198 2024-04-15T00:19:39.515 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 131/198 2024-04-15T00:19:39.656 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 132/198 2024-04-15T00:19:39.712 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 133/198 2024-04-15T00:19:39.745 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 134/198 2024-04-15T00:19:39.776 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 135/198 2024-04-15T00:19:39.812 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : jq-1.6-16.el9.x86_64 136/198 2024-04-15T00:19:39.839 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : fuse-2.9.9-15.el9.x86_64 137/198 2024-04-15T00:19:40.231 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 138/198 2024-04-15T00:19:40.263 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 138/198 2024-04-15T00:19:40.295 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2114.ga9a752df.e 139/198 2024-04-15T00:19:40.357 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2114.ga9a752df. 140/198 2024-04-15T00:19:40.386 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noa 141/198 2024-04-15T00:19:41.470 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noa 141/198 2024-04-15T00:19:41.504 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.n 142/198 2024-04-15T00:19:42.518 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.n 142/198 2024-04-15T00:19:42.546 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a 143/198 2024-04-15T00:19:42.651 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a 143/198 2024-04-15T00:19:42.841 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2114.ga9a752df.el 144/198 2024-04-15T00:19:42.881 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 145/198 2024-04-15T00:19:42.904 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 145/198 2024-04-15T00:19:42.904 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T00:19:42.904 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-15T00:19:42.904 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-15T00:19:42.904 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-15T00:19:42.904 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:19:42.949 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 146/198 2024-04-15T00:19:42.959 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 146/198 2024-04-15T00:19:43.062 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-2:19.0.0-2114.ga9a752df.el7.x86_64 147/198 2024-04-15T00:19:43.491 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 120/198 2024-04-15T00:19:43.491 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /sys 2024-04-15T00:19:43.491 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /proc 2024-04-15T00:19:43.491 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /mnt 2024-04-15T00:19:43.491 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /var/tmp 2024-04-15T00:19:43.491 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /home 2024-04-15T00:19:43.491 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /root 2024-04-15T00:19:43.491 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /tmp 2024-04-15T00:19:43.491 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:19:43.649 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 121/198 2024-04-15T00:19:43.663 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 121/198 2024-04-15T00:19:43.664 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T00:19:43.664 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-15T00:19:43.664 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:19:45.200 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 122/198 2024-04-15T00:19:45.225 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 122/198 2024-04-15T00:19:45.226 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T00:19:45.226 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-15T00:19:45.226 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-15T00:19:45.226 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-15T00:19:45.226 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:19:45.476 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 123/198 2024-04-15T00:19:45.499 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 123/198 2024-04-15T00:19:45.499 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T00:19:45.499 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-15T00:19:45.499 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-15T00:19:45.499 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-15T00:19:45.499 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:19:45.962 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 124/198 2024-04-15T00:19:45.984 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 124/198 2024-04-15T00:19:45.984 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T00:19:45.984 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-15T00:19:45.984 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-15T00:19:45.984 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-15T00:19:45.984 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:19:46.101 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : automake-1.16.2-8.el9.noarch 125/198 2024-04-15T00:19:46.158 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ply-3.11-14.el9.noarch 126/198 2024-04-15T00:19:46.222 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 127/198 2024-04-15T00:19:46.418 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 128/198 2024-04-15T00:19:46.471 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 129/198 2024-04-15T00:19:46.552 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 130/198 2024-04-15T00:19:46.642 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 131/198 2024-04-15T00:19:46.783 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 132/198 2024-04-15T00:19:46.837 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 133/198 2024-04-15T00:19:46.871 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 134/198 2024-04-15T00:19:46.902 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 135/198 2024-04-15T00:19:46.938 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : jq-1.6-16.el9.x86_64 136/198 2024-04-15T00:19:46.965 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : fuse-2.9.9-15.el9.x86_64 137/198 2024-04-15T00:19:47.383 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 138/198 2024-04-15T00:19:47.414 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 138/198 2024-04-15T00:19:47.446 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2114.ga9a752df.e 139/198 2024-04-15T00:19:47.516 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2114.ga9a752df. 140/198 2024-04-15T00:19:47.545 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noa 141/198 2024-04-15T00:19:47.743 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 148/198 2024-04-15T00:19:47.818 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-test-2:19.0.0-2114.ga9a752df.el7.x86_64 149/198 2024-04-15T00:19:48.631 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noa 141/198 2024-04-15T00:19:48.680 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.n 142/198 2024-04-15T00:19:48.734 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libtool-2.4.6-45.el9.x86_64 150/198 2024-04-15T00:19:48.764 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 151/198 2024-04-15T00:19:48.786 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 151/198 2024-04-15T00:19:48.786 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T00:19:48.786 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-15T00:19:48.786 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-15T00:19:48.786 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-15T00:19:48.786 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:19:48.848 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2114.ga9a75 152/198 2024-04-15T00:19:48.870 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2114.ga9a75 152/198 2024-04-15T00:19:48.870 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T00:19:48.870 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-15T00:19:48.870 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:19:48.915 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : cephfs-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 153/198 2024-04-15T00:19:48.937 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 153/198 2024-04-15T00:19:48.937 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T00:19:48.937 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-15T00:19:48.937 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-15T00:19:48.937 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-15T00:19:48.937 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:19:49.258 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 154/198 2024-04-15T00:19:49.280 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 154/198 2024-04-15T00:19:49.280 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T00:19:49.280 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-15T00:19:49.280 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-15T00:19:49.280 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-15T00:19:49.280 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:19:49.333 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 155/198 2024-04-15T00:19:49.363 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-nbd-2:19.0.0-2114.ga9a752df.el7.x86_64 156/198 2024-04-15T00:19:49.390 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/198 2024-04-15T00:19:49.583 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : cephfs-shell-2:19.0.0-2114.ga9a752df.el7.x86_64 158/198 2024-04-15T00:19:49.640 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 159/198 2024-04-15T00:19:49.685 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-15T00:19:49.694 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.n 142/198 2024-04-15T00:19:49.730 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a 143/198 2024-04-15T00:19:49.764 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-15T00:19:49.807 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-15T00:19:49.836 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a 143/198 2024-04-15T00:19:49.840 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephfs-devel-2:19.0.0-2114.ga9a752df.el7.x86_ 163/198 2024-04-15T00:19:49.880 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-15T00:19:49.910 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : NetworkManager-team-1:1.47.4-1.el9.x86_64 165/198 2024-04-15T00:19:49.976 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : NetworkManager-tui-1:1.47.4-1.el9.x86_64 166/198 2024-04-15T00:19:50.008 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2114.ga9a752df.el 144/198 2024-04-15T00:19:50.033 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 145/198 2024-04-15T00:19:50.055 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 145/198 2024-04-15T00:19:50.055 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T00:19:50.055 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-15T00:19:50.055 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-15T00:19:50.055 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-15T00:19:50.056 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:19:50.057 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-15T00:19:50.100 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 146/198 2024-04-15T00:19:50.100 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-15T00:19:50.110 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 146/198 2024-04-15T00:19:50.213 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-2:19.0.0-2114.ga9a752df.el7.x86_64 147/198 2024-04-15T00:19:50.767 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-15T00:19:50.806 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-15T00:19:50.826 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-15T00:19:51.696 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : cephfs-top-2:19.0.0-2114.ga9a752df.el7.noarch 170/198 2024-04-15T00:19:51.802 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-15T00:19:51.903 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/198 2024-04-15T00:19:51.937 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/198 2024-04-15T00:19:51.971 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 174/198 2024-04-15T00:19:51.996 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-15T00:19:52.021 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-15T00:19:52.048 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-15T00:19:52.048 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-15T00:19:52.135 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-15T00:19:52.165 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-15T00:19:52.165 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-15T00:19:52.250 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-15T00:19:52.276 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-15T00:19:52.317 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-15T00:19:52.351 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-15T00:19:52.376 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-15T00:19:52.420 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-15T00:19:52.457 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-15T00:19:52.489 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-15T00:19:52.514 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-15T00:19:52.548 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-15T00:19:52.573 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-15T00:19:52.599 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-15T00:19:52.606 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-15T00:19:52.606 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-15T00:19:52.785 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-15T00:19:52.785 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-15T00:19:52.876 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-15T00:19:52.901 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-15T00:19:52.933 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-15T00:19:52.961 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-15T00:19:52.994 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-15T00:19:53.063 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-15T00:19:54.884 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 148/198 2024-04-15T00:19:54.965 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-test-2:19.0.0-2114.ga9a752df.el7.x86_64 149/198 2024-04-15T00:19:55.877 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libtool-2.4.6-45.el9.x86_64 150/198 2024-04-15T00:19:55.915 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 151/198 2024-04-15T00:19:55.938 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 151/198 2024-04-15T00:19:55.938 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T00:19:55.938 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-15T00:19:55.938 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-15T00:19:55.939 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-15T00:19:55.939 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:19:55.983 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2114.ga9a75 152/198 2024-04-15T00:19:56.004 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2114.ga9a75 152/198 2024-04-15T00:19:56.005 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T00:19:56.005 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-15T00:19:56.005 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:19:56.050 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephfs-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 153/198 2024-04-15T00:19:56.072 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 153/198 2024-04-15T00:19:56.072 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T00:19:56.072 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-15T00:19:56.072 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-15T00:19:56.072 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-15T00:19:56.072 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:19:56.393 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 154/198 2024-04-15T00:19:56.414 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 154/198 2024-04-15T00:19:56.415 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T00:19:56.415 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-15T00:19:56.415 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-15T00:19:56.415 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-15T00:19:56.415 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:19:56.470 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 155/198 2024-04-15T00:19:56.500 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-nbd-2:19.0.0-2114.ga9a752df.el7.x86_64 156/198 2024-04-15T00:19:56.527 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/198 2024-04-15T00:19:56.739 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephfs-shell-2:19.0.0-2114.ga9a752df.el7.x86_64 158/198 2024-04-15T00:19:56.792 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 159/198 2024-04-15T00:19:56.851 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-15T00:19:56.907 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-15T00:19:56.951 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-15T00:19:56.984 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs-devel-2:19.0.0-2114.ga9a752df.el7.x86_ 163/198 2024-04-15T00:19:57.016 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-15T00:19:57.045 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : NetworkManager-team-1:1.47.4-1.el9.x86_64 165/198 2024-04-15T00:19:57.114 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : NetworkManager-tui-1:1.47.4-1.el9.x86_64 166/198 2024-04-15T00:19:57.188 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-15T00:19:57.227 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-15T00:19:57.888 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-15T00:19:57.933 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-15T00:19:57.953 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-15T00:19:58.474 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-15T00:19:58.474 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-2:19.0.0-2114.ga9a752df.el7.x86_64 1/198 2024-04-15T00:19:58.474 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 2/198 2024-04-15T00:19:58.474 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 3/198 2024-04-15T00:19:58.474 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 4/198 2024-04-15T00:19:58.474 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2114.ga9a75 5/198 2024-04-15T00:19:58.474 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 6/198 2024-04-15T00:19:58.474 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 7/198 2024-04-15T00:19:58.474 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 8/198 2024-04-15T00:19:58.475 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 9/198 2024-04-15T00:19:58.475 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 10/198 2024-04-15T00:19:58.475 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 11/198 2024-04-15T00:19:58.475 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-test-2:19.0.0-2114.ga9a752df.el7.x86_64 12/198 2024-04-15T00:19:58.475 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : cephfs-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 13/198 2024-04-15T00:19:58.475 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : cephfs-shell-2:19.0.0-2114.ga9a752df.el7.x86_64 14/198 2024-04-15T00:19:58.475 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephfs-devel-2:19.0.0-2114.ga9a752df.el7.x86_ 15/198 2024-04-15T00:19:58.475 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 16/198 2024-04-15T00:19:58.475 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 17/198 2024-04-15T00:19:58.475 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados-devel-2:19.0.0-2114.ga9a752df.el7.x86_6 18/198 2024-04-15T00:19:58.475 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86 19/198 2024-04-15T00:19:58.475 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 20/198 2024-04-15T00:19:58.475 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2114.ga9a752df.el 21/198 2024-04-15T00:19:58.475 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ceph-common-2:19.0.0-2114.ga9a752df.el7. 22/198 2024-04-15T00:19:58.476 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cephfs-2:19.0.0-2114.ga9a752df.el7.x86_6 23/198 2024-04-15T00:19:58.476 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rados-2:19.0.0-2114.ga9a752df.el7.x86_64 24/198 2024-04-15T00:19:58.476 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rbd-2:19.0.0-2114.ga9a752df.el7.x86_64 25/198 2024-04-15T00:19:58.476 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rgw-2:19.0.0-2114.ga9a752df.el7.x86_64 26/198 2024-04-15T00:19:58.476 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 27/198 2024-04-15T00:19:58.476 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 28/198 2024-04-15T00:19:58.476 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-nbd-2:19.0.0-2114.ga9a752df.el7.x86_64 29/198 2024-04-15T00:19:58.476 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2114.ga9a752df. 30/198 2024-04-15T00:19:58.476 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noa 31/198 2024-04-15T00:19:58.476 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.n 32/198 2024-04-15T00:19:58.476 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a 33/198 2024-04-15T00:19:58.476 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2114.ga9a752df.el 34/198 2024-04-15T00:19:58.476 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 35/198 2024-04-15T00:19:58.476 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2114.ga9a752df.e 36/198 2024-04-15T00:19:58.477 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 37/198 2024-04-15T00:19:58.477 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 38/198 2024-04-15T00:19:58.477 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : cephfs-top-2:19.0.0-2114.ga9a752df.el7.noarch 39/198 2024-04-15T00:19:58.477 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 40/198 2024-04-15T00:19:58.477 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 41/198 2024-04-15T00:19:58.477 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : jq-1.6-16.el9.x86_64 42/198 2024-04-15T00:19:58.477 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 43/198 2024-04-15T00:19:58.477 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 44/198 2024-04-15T00:19:58.477 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 45/198 2024-04-15T00:19:58.477 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/198 2024-04-15T00:19:58.477 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/198 2024-04-15T00:19:58.477 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/198 2024-04-15T00:19:58.477 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/198 2024-04-15T00:19:58.477 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/198 2024-04-15T00:19:58.478 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 51/198 2024-04-15T00:19:58.478 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : automake-1.16.2-8.el9.noarch 52/198 2024-04-15T00:19:58.478 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : bison-3.7.4-5.el9.x86_64 53/198 2024-04-15T00:19:58.478 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 54/198 2024-04-15T00:19:58.478 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 55/198 2024-04-15T00:19:58.478 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : flex-2.6.4-9.el9.x86_64 56/198 2024-04-15T00:19:58.478 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 57/198 2024-04-15T00:19:58.478 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 58/198 2024-04-15T00:19:58.478 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 59/198 2024-04-15T00:19:58.479 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 60/198 2024-04-15T00:19:58.479 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 61/198 2024-04-15T00:19:58.479 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 62/198 2024-04-15T00:19:58.479 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 63/198 2024-04-15T00:19:58.479 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 64/198 2024-04-15T00:19:58.479 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 65/198 2024-04-15T00:19:58.479 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 66/198 2024-04-15T00:19:58.479 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : lua-5.4.4-4.el9.x86_64 67/198 2024-04-15T00:19:58.479 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 68/198 2024-04-15T00:19:58.479 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 69/198 2024-04-15T00:19:58.479 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 70/198 2024-04-15T00:19:58.479 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : postgresql-13.14-1.el9.x86_64 71/198 2024-04-15T00:19:58.479 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 72/198 2024-04-15T00:19:58.479 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 73/198 2024-04-15T00:19:58.480 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 74/198 2024-04-15T00:19:58.480 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 75/198 2024-04-15T00:19:58.480 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 76/198 2024-04-15T00:19:58.480 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 77/198 2024-04-15T00:19:58.480 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 78/198 2024-04-15T00:19:58.480 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 79/198 2024-04-15T00:19:58.480 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/198 2024-04-15T00:19:58.480 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/198 2024-04-15T00:19:58.480 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/198 2024-04-15T00:19:58.480 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/198 2024-04-15T00:19:58.480 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/198 2024-04-15T00:19:58.480 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/198 2024-04-15T00:19:58.480 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/198 2024-04-15T00:19:58.480 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/198 2024-04-15T00:19:58.481 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/198 2024-04-15T00:19:58.481 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/198 2024-04-15T00:19:58.481 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/198 2024-04-15T00:19:58.481 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/198 2024-04-15T00:19:58.481 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/198 2024-04-15T00:19:58.481 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/198 2024-04-15T00:19:58.481 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/198 2024-04-15T00:19:58.481 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/198 2024-04-15T00:19:58.481 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/198 2024-04-15T00:19:58.482 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/198 2024-04-15T00:19:58.482 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/198 2024-04-15T00:19:58.482 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/198 2024-04-15T00:19:58.482 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 100/198 2024-04-15T00:19:58.482 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/198 2024-04-15T00:19:58.482 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 102/198 2024-04-15T00:19:58.482 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/198 2024-04-15T00:19:58.482 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 104/198 2024-04-15T00:19:58.482 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-15T00:19:58.483 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-15T00:19:58.483 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-15T00:19:58.483 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-15T00:19:58.483 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-15T00:19:58.483 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-15T00:19:58.483 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-15T00:19:58.483 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-15T00:19:58.483 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-15T00:19:58.483 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-15T00:19:58.483 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-15T00:19:58.484 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-15T00:19:58.484 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-15T00:19:58.484 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-15T00:19:58.484 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-15T00:19:58.484 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-15T00:19:58.484 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-15T00:19:58.484 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-15T00:19:58.484 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-15T00:19:58.484 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-15T00:19:58.485 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-15T00:19:58.485 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-15T00:19:58.485 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-15T00:19:58.485 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-15T00:19:58.485 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-15T00:19:58.485 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-15T00:19:58.486 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-15T00:19:58.486 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-15T00:19:58.486 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-15T00:19:58.486 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-15T00:19:58.486 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-15T00:19:58.486 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-15T00:19:58.486 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-15T00:19:58.487 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-15T00:19:58.487 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-15T00:19:58.487 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-15T00:19:58.487 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-15T00:19:58.487 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-15T00:19:58.487 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-15T00:19:58.487 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-15T00:19:58.487 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-15T00:19:58.488 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-15T00:19:58.488 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-15T00:19:58.488 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-15T00:19:58.488 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-15T00:19:58.488 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-15T00:19:58.488 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 151/198 2024-04-15T00:19:58.488 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-15T00:19:58.488 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 153/198 2024-04-15T00:19:58.488 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-15T00:19:58.488 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 155/198 2024-04-15T00:19:58.488 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-15T00:19:58.488 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 157/198 2024-04-15T00:19:58.488 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-15T00:19:58.488 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 159/198 2024-04-15T00:19:58.489 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-15T00:19:58.489 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/198 2024-04-15T00:19:58.489 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-15T00:19:58.489 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : acl-2.3.1-4.el9.x86_64 163/198 2024-04-15T00:19:58.489 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : acl-2.3.1-3.el9.x86_64 164/198 2024-04-15T00:19:58.489 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/198 2024-04-15T00:19:58.489 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 166/198 2024-04-15T00:19:58.489 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 167/198 2024-04-15T00:19:58.489 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 168/198 2024-04-15T00:19:58.489 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 169/198 2024-04-15T00:19:58.489 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 170/198 2024-04-15T00:19:58.489 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 171/198 2024-04-15T00:19:58.490 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 172/198 2024-04-15T00:19:58.490 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 173/198 2024-04-15T00:19:58.490 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 174/198 2024-04-15T00:19:58.490 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 175/198 2024-04-15T00:19:58.490 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 176/198 2024-04-15T00:19:58.490 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 177/198 2024-04-15T00:19:58.490 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 178/198 2024-04-15T00:19:58.490 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 179/198 2024-04-15T00:19:58.490 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 180/198 2024-04-15T00:19:58.490 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 181/198 2024-04-15T00:19:58.490 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 182/198 2024-04-15T00:19:58.490 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 183/198 2024-04-15T00:19:58.491 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 184/198 2024-04-15T00:19:58.491 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 185/198 2024-04-15T00:19:58.491 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 186/198 2024-04-15T00:19:58.491 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 187/198 2024-04-15T00:19:58.491 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 188/198 2024-04-15T00:19:58.491 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 189/198 2024-04-15T00:19:58.491 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 190/198 2024-04-15T00:19:58.491 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 191/198 2024-04-15T00:19:58.491 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 192/198 2024-04-15T00:19:58.491 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 193/198 2024-04-15T00:19:58.491 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 194/198 2024-04-15T00:19:58.492 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-15T00:19:58.492 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-15T00:19:58.492 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-15T00:19:58.837 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephfs-top-2:19.0.0-2114.ga9a752df.el7.noarch 170/198 2024-04-15T00:19:58.946 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-15T00:19:59.037 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/198 2024-04-15T00:19:59.073 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/198 2024-04-15T00:19:59.090 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 174/198 2024-04-15T00:19:59.115 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-15T00:19:59.141 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-15T00:19:59.168 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-15T00:19:59.168 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-15T00:19:59.255 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-15T00:19:59.285 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-15T00:19:59.285 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-15T00:19:59.369 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-15T00:19:59.395 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-15T00:19:59.437 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-15T00:19:59.463 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-15T00:19:59.487 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-15T00:19:59.522 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-15T00:19:59.568 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-15T00:19:59.609 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-15T00:19:59.634 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-15T00:19:59.659 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-15T00:19:59.685 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-15T00:19:59.710 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-15T00:19:59.718 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-15T00:19:59.718 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-15T00:19:59.905 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-15T00:19:59.905 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-15T00:19:59.987 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-15T00:20:00.012 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-15T00:20:00.044 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-15T00:20:00.072 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-15T00:20:00.097 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-15T00:20:00.166 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-15T00:20:01.650 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-15T00:20:01.650 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:01.650 INFO:teuthology.orchestra.run.smithi031.stdout:Upgraded: 2024-04-15T00:20:01.650 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-1:1.47.4-1.el9.x86_64 2024-04-15T00:20:01.651 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 2024-04-15T00:20:01.651 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-team-1:1.47.4-1.el9.x86_64 2024-04-15T00:20:01.651 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-tui-1:1.47.4-1.el9.x86_64 2024-04-15T00:20:01.651 INFO:teuthology.orchestra.run.smithi031.stdout: acl-2.3.1-4.el9.x86_64 2024-04-15T00:20:01.651 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-15T00:20:01.651 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-15T00:20:01.651 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-15T00:20:01.651 INFO:teuthology.orchestra.run.smithi031.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-15T00:20:01.651 INFO:teuthology.orchestra.run.smithi031.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-15T00:20:01.651 INFO:teuthology.orchestra.run.smithi031.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-15T00:20:01.651 INFO:teuthology.orchestra.run.smithi031.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-15T00:20:01.651 INFO:teuthology.orchestra.run.smithi031.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-15T00:20:01.651 INFO:teuthology.orchestra.run.smithi031.stdout: librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:01.651 INFO:teuthology.orchestra.run.smithi031.stdout: librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:01.652 INFO:teuthology.orchestra.run.smithi031.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-15T00:20:01.652 INFO:teuthology.orchestra.run.smithi031.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-15T00:20:01.652 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-15T00:20:01.652 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-15T00:20:01.652 INFO:teuthology.orchestra.run.smithi031.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-15T00:20:01.652 INFO:teuthology.orchestra.run.smithi031.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-15T00:20:01.652 INFO:teuthology.orchestra.run.smithi031.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-15T00:20:01.652 INFO:teuthology.orchestra.run.smithi031.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-15T00:20:01.652 INFO:teuthology.orchestra.run.smithi031.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-15T00:20:01.652 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-04-15T00:20:01.652 INFO:teuthology.orchestra.run.smithi031.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-15T00:20:01.652 INFO:teuthology.orchestra.run.smithi031.stdout: automake-1.16.2-8.el9.noarch 2024-04-15T00:20:01.652 INFO:teuthology.orchestra.run.smithi031.stdout: bison-3.7.4-5.el9.x86_64 2024-04-15T00:20:01.652 INFO:teuthology.orchestra.run.smithi031.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-15T00:20:01.653 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:01.653 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:01.653 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:01.653 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:01.653 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-grafana-dashboards-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T00:20:01.653 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-immutable-object-cache-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:01.653 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:01.653 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:01.653 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T00:20:01.653 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T00:20:01.653 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T00:20:01.653 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T00:20:01.653 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T00:20:01.653 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:01.654 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:01.654 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-prometheus-alerts-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T00:20:01.654 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:01.654 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:01.654 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-test-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:01.654 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T00:20:01.654 INFO:teuthology.orchestra.run.smithi031.stdout: cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T00:20:01.654 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:01.654 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-shell-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:01.654 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-top-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T00:20:01.654 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-15T00:20:01.654 INFO:teuthology.orchestra.run.smithi031.stdout: flex-2.6.4-9.el9.x86_64 2024-04-15T00:20:01.654 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-15T00:20:01.654 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-15T00:20:01.655 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-15T00:20:01.655 INFO:teuthology.orchestra.run.smithi031.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-15T00:20:01.655 INFO:teuthology.orchestra.run.smithi031.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-15T00:20:01.655 INFO:teuthology.orchestra.run.smithi031.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-15T00:20:01.655 INFO:teuthology.orchestra.run.smithi031.stdout: jq-1.6-16.el9.x86_64 2024-04-15T00:20:01.655 INFO:teuthology.orchestra.run.smithi031.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-15T00:20:01.655 INFO:teuthology.orchestra.run.smithi031.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-15T00:20:01.655 INFO:teuthology.orchestra.run.smithi031.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-15T00:20:01.655 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs-devel-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:01.655 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:01.655 INFO:teuthology.orchestra.run.smithi031.stdout: libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:01.655 INFO:teuthology.orchestra.run.smithi031.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-15T00:20:01.655 INFO:teuthology.orchestra.run.smithi031.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-15T00:20:01.655 INFO:teuthology.orchestra.run.smithi031.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-15T00:20:01.656 INFO:teuthology.orchestra.run.smithi031.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-15T00:20:01.656 INFO:teuthology.orchestra.run.smithi031.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-15T00:20:01.656 INFO:teuthology.orchestra.run.smithi031.stdout: librados-devel-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:01.656 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:01.656 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-15T00:20:01.656 INFO:teuthology.orchestra.run.smithi031.stdout: librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:01.656 INFO:teuthology.orchestra.run.smithi031.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-15T00:20:01.656 INFO:teuthology.orchestra.run.smithi031.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-15T00:20:01.656 INFO:teuthology.orchestra.run.smithi031.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-15T00:20:01.656 INFO:teuthology.orchestra.run.smithi031.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-15T00:20:01.656 INFO:teuthology.orchestra.run.smithi031.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-15T00:20:01.656 INFO:teuthology.orchestra.run.smithi031.stdout: lua-5.4.4-4.el9.x86_64 2024-04-15T00:20:01.656 INFO:teuthology.orchestra.run.smithi031.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-15T00:20:01.656 INFO:teuthology.orchestra.run.smithi031.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-15T00:20:01.656 INFO:teuthology.orchestra.run.smithi031.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-15T00:20:01.657 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-15T00:20:01.657 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-15T00:20:01.657 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-15T00:20:01.657 INFO:teuthology.orchestra.run.smithi031.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-15T00:20:01.657 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-13.14-1.el9.x86_64 2024-04-15T00:20:01.657 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-15T00:20:01.657 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-15T00:20:01.657 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-15T00:20:01.657 INFO:teuthology.orchestra.run.smithi031.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-15T00:20:01.657 INFO:teuthology.orchestra.run.smithi031.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-15T00:20:01.657 INFO:teuthology.orchestra.run.smithi031.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-15T00:20:01.657 INFO:teuthology.orchestra.run.smithi031.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-15T00:20:01.657 INFO:teuthology.orchestra.run.smithi031.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-15T00:20:01.657 INFO:teuthology.orchestra.run.smithi031.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-15T00:20:01.657 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-15T00:20:01.658 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:01.658 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:01.658 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cephfs-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:01.658 INFO:teuthology.orchestra.run.smithi031.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-15T00:20:01.658 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-15T00:20:01.658 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-15T00:20:01.658 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-15T00:20:01.658 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-15T00:20:01.658 INFO:teuthology.orchestra.run.smithi031.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-15T00:20:01.658 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-15T00:20:01.658 INFO:teuthology.orchestra.run.smithi031.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-15T00:20:01.658 INFO:teuthology.orchestra.run.smithi031.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-15T00:20:01.658 INFO:teuthology.orchestra.run.smithi031.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-15T00:20:01.658 INFO:teuthology.orchestra.run.smithi031.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-15T00:20:01.659 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-15T00:20:01.659 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-15T00:20:01.659 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-15T00:20:01.659 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-15T00:20:01.659 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-15T00:20:01.659 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-15T00:20:01.659 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-15T00:20:01.659 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-15T00:20:01.659 INFO:teuthology.orchestra.run.smithi031.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-15T00:20:01.659 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-15T00:20:01.659 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-15T00:20:01.659 INFO:teuthology.orchestra.run.smithi031.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-15T00:20:01.659 INFO:teuthology.orchestra.run.smithi031.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-15T00:20:01.659 INFO:teuthology.orchestra.run.smithi031.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-15T00:20:01.660 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-15T00:20:01.660 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-15T00:20:01.660 INFO:teuthology.orchestra.run.smithi031.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-15T00:20:01.660 INFO:teuthology.orchestra.run.smithi031.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-15T00:20:01.660 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-15T00:20:01.660 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ply-3.11-14.el9.noarch 2024-04-15T00:20:01.660 INFO:teuthology.orchestra.run.smithi031.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-15T00:20:01.660 INFO:teuthology.orchestra.run.smithi031.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-15T00:20:01.660 INFO:teuthology.orchestra.run.smithi031.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-15T00:20:01.660 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-15T00:20:01.660 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-15T00:20:01.660 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-15T00:20:01.660 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-15T00:20:01.660 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-15T00:20:01.660 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-15T00:20:01.661 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:01.661 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rbd-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:01.661 INFO:teuthology.orchestra.run.smithi031.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-15T00:20:01.661 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-15T00:20:01.661 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-15T00:20:01.661 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rgw-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:01.661 INFO:teuthology.orchestra.run.smithi031.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-15T00:20:01.661 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-15T00:20:01.661 INFO:teuthology.orchestra.run.smithi031.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-15T00:20:01.661 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-15T00:20:01.661 INFO:teuthology.orchestra.run.smithi031.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-15T00:20:01.661 INFO:teuthology.orchestra.run.smithi031.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-15T00:20:01.661 INFO:teuthology.orchestra.run.smithi031.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-15T00:20:01.661 INFO:teuthology.orchestra.run.smithi031.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-15T00:20:01.661 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-15T00:20:01.662 INFO:teuthology.orchestra.run.smithi031.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-15T00:20:01.662 INFO:teuthology.orchestra.run.smithi031.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-15T00:20:01.662 INFO:teuthology.orchestra.run.smithi031.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-15T00:20:01.662 INFO:teuthology.orchestra.run.smithi031.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-15T00:20:01.662 INFO:teuthology.orchestra.run.smithi031.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-15T00:20:01.662 INFO:teuthology.orchestra.run.smithi031.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-15T00:20:01.662 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:01.662 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:01.662 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-nbd-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:01.662 INFO:teuthology.orchestra.run.smithi031.stdout: re2-1:20211101-3.el9.x86_64 2024-04-15T00:20:01.662 INFO:teuthology.orchestra.run.smithi031.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-15T00:20:01.662 INFO:teuthology.orchestra.run.smithi031.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-15T00:20:01.662 INFO:teuthology.orchestra.run.smithi031.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-15T00:20:01.662 INFO:teuthology.orchestra.run.smithi031.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-15T00:20:01.663 INFO:teuthology.orchestra.run.smithi031.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-15T00:20:01.663 INFO:teuthology.orchestra.run.smithi031.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-15T00:20:01.663 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:01.663 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-15T00:20:02.150 DEBUG:teuthology.parallel:result is None 2024-04-15T00:20:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-15T00:20:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-2:19.0.0-2114.ga9a752df.el7.x86_64 1/198 2024-04-15T00:20:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 2/198 2024-04-15T00:20:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 3/198 2024-04-15T00:20:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 4/198 2024-04-15T00:20:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2114.ga9a75 5/198 2024-04-15T00:20:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 6/198 2024-04-15T00:20:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 7/198 2024-04-15T00:20:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 8/198 2024-04-15T00:20:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 9/198 2024-04-15T00:20:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 10/198 2024-04-15T00:20:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 11/198 2024-04-15T00:20:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-test-2:19.0.0-2114.ga9a752df.el7.x86_64 12/198 2024-04-15T00:20:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephfs-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 13/198 2024-04-15T00:20:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephfs-shell-2:19.0.0-2114.ga9a752df.el7.x86_64 14/198 2024-04-15T00:20:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs-devel-2:19.0.0-2114.ga9a752df.el7.x86_ 15/198 2024-04-15T00:20:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 16/198 2024-04-15T00:20:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 17/198 2024-04-15T00:20:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados-devel-2:19.0.0-2114.ga9a752df.el7.x86_6 18/198 2024-04-15T00:20:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86 19/198 2024-04-15T00:20:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 20/198 2024-04-15T00:20:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2114.ga9a752df.el 21/198 2024-04-15T00:20:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-common-2:19.0.0-2114.ga9a752df.el7. 22/198 2024-04-15T00:20:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cephfs-2:19.0.0-2114.ga9a752df.el7.x86_6 23/198 2024-04-15T00:20:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rados-2:19.0.0-2114.ga9a752df.el7.x86_64 24/198 2024-04-15T00:20:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rbd-2:19.0.0-2114.ga9a752df.el7.x86_64 25/198 2024-04-15T00:20:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rgw-2:19.0.0-2114.ga9a752df.el7.x86_64 26/198 2024-04-15T00:20:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 27/198 2024-04-15T00:20:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 28/198 2024-04-15T00:20:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-nbd-2:19.0.0-2114.ga9a752df.el7.x86_64 29/198 2024-04-15T00:20:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2114.ga9a752df. 30/198 2024-04-15T00:20:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noa 31/198 2024-04-15T00:20:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.n 32/198 2024-04-15T00:20:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a 33/198 2024-04-15T00:20:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2114.ga9a752df.el 34/198 2024-04-15T00:20:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 35/198 2024-04-15T00:20:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2114.ga9a752df.e 36/198 2024-04-15T00:20:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 37/198 2024-04-15T00:20:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 38/198 2024-04-15T00:20:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephfs-top-2:19.0.0-2114.ga9a752df.el7.noarch 39/198 2024-04-15T00:20:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 40/198 2024-04-15T00:20:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 41/198 2024-04-15T00:20:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : jq-1.6-16.el9.x86_64 42/198 2024-04-15T00:20:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 43/198 2024-04-15T00:20:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 44/198 2024-04-15T00:20:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 45/198 2024-04-15T00:20:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/198 2024-04-15T00:20:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/198 2024-04-15T00:20:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/198 2024-04-15T00:20:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/198 2024-04-15T00:20:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/198 2024-04-15T00:20:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 51/198 2024-04-15T00:20:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : automake-1.16.2-8.el9.noarch 52/198 2024-04-15T00:20:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : bison-3.7.4-5.el9.x86_64 53/198 2024-04-15T00:20:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 54/198 2024-04-15T00:20:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 55/198 2024-04-15T00:20:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flex-2.6.4-9.el9.x86_64 56/198 2024-04-15T00:20:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 57/198 2024-04-15T00:20:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 58/198 2024-04-15T00:20:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 59/198 2024-04-15T00:20:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 60/198 2024-04-15T00:20:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 61/198 2024-04-15T00:20:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 62/198 2024-04-15T00:20:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 63/198 2024-04-15T00:20:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 64/198 2024-04-15T00:20:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 65/198 2024-04-15T00:20:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 66/198 2024-04-15T00:20:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lua-5.4.4-4.el9.x86_64 67/198 2024-04-15T00:20:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 68/198 2024-04-15T00:20:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 69/198 2024-04-15T00:20:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 70/198 2024-04-15T00:20:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-13.14-1.el9.x86_64 71/198 2024-04-15T00:20:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 72/198 2024-04-15T00:20:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 73/198 2024-04-15T00:20:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 74/198 2024-04-15T00:20:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 75/198 2024-04-15T00:20:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 76/198 2024-04-15T00:20:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 77/198 2024-04-15T00:20:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 78/198 2024-04-15T00:20:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 79/198 2024-04-15T00:20:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/198 2024-04-15T00:20:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/198 2024-04-15T00:20:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/198 2024-04-15T00:20:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/198 2024-04-15T00:20:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/198 2024-04-15T00:20:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/198 2024-04-15T00:20:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/198 2024-04-15T00:20:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/198 2024-04-15T00:20:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/198 2024-04-15T00:20:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/198 2024-04-15T00:20:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/198 2024-04-15T00:20:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/198 2024-04-15T00:20:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/198 2024-04-15T00:20:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/198 2024-04-15T00:20:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/198 2024-04-15T00:20:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/198 2024-04-15T00:20:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/198 2024-04-15T00:20:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/198 2024-04-15T00:20:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/198 2024-04-15T00:20:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/198 2024-04-15T00:20:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 100/198 2024-04-15T00:20:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/198 2024-04-15T00:20:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 102/198 2024-04-15T00:20:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/198 2024-04-15T00:20:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 104/198 2024-04-15T00:20:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-15T00:20:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-15T00:20:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-15T00:20:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-15T00:20:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-15T00:20:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-15T00:20:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-15T00:20:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-15T00:20:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-15T00:20:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-15T00:20:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-15T00:20:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-15T00:20:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-15T00:20:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-15T00:20:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-15T00:20:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-15T00:20:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-15T00:20:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-15T00:20:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-15T00:20:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-15T00:20:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-15T00:20:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-15T00:20:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-15T00:20:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-15T00:20:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-15T00:20:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-15T00:20:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-15T00:20:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-15T00:20:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-15T00:20:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-15T00:20:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-15T00:20:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-15T00:20:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-15T00:20:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-15T00:20:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-15T00:20:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-15T00:20:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-15T00:20:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-15T00:20:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-15T00:20:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-15T00:20:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-15T00:20:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-15T00:20:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-15T00:20:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-15T00:20:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-15T00:20:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-15T00:20:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 151/198 2024-04-15T00:20:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-15T00:20:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 153/198 2024-04-15T00:20:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-15T00:20:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 155/198 2024-04-15T00:20:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-15T00:20:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 157/198 2024-04-15T00:20:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-15T00:20:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 159/198 2024-04-15T00:20:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-15T00:20:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/198 2024-04-15T00:20:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-15T00:20:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : acl-2.3.1-4.el9.x86_64 163/198 2024-04-15T00:20:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : acl-2.3.1-3.el9.x86_64 164/198 2024-04-15T00:20:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/198 2024-04-15T00:20:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 166/198 2024-04-15T00:20:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 167/198 2024-04-15T00:20:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 168/198 2024-04-15T00:20:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 169/198 2024-04-15T00:20:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 170/198 2024-04-15T00:20:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 171/198 2024-04-15T00:20:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 172/198 2024-04-15T00:20:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 173/198 2024-04-15T00:20:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 174/198 2024-04-15T00:20:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 175/198 2024-04-15T00:20:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 176/198 2024-04-15T00:20:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 177/198 2024-04-15T00:20:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 178/198 2024-04-15T00:20:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 179/198 2024-04-15T00:20:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 180/198 2024-04-15T00:20:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 181/198 2024-04-15T00:20:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 182/198 2024-04-15T00:20:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 183/198 2024-04-15T00:20:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 184/198 2024-04-15T00:20:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 185/198 2024-04-15T00:20:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 186/198 2024-04-15T00:20:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 187/198 2024-04-15T00:20:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 188/198 2024-04-15T00:20:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 189/198 2024-04-15T00:20:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 190/198 2024-04-15T00:20:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 191/198 2024-04-15T00:20:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 192/198 2024-04-15T00:20:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 193/198 2024-04-15T00:20:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 194/198 2024-04-15T00:20:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-15T00:20:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-15T00:20:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-15T00:20:08.441 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-15T00:20:08.442 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:20:08.442 INFO:teuthology.orchestra.run.smithi050.stdout:Upgraded: 2024-04-15T00:20:08.442 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-1:1.47.4-1.el9.x86_64 2024-04-15T00:20:08.442 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 2024-04-15T00:20:08.442 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-team-1:1.47.4-1.el9.x86_64 2024-04-15T00:20:08.442 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-tui-1:1.47.4-1.el9.x86_64 2024-04-15T00:20:08.442 INFO:teuthology.orchestra.run.smithi050.stdout: acl-2.3.1-4.el9.x86_64 2024-04-15T00:20:08.442 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-15T00:20:08.442 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-15T00:20:08.442 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-15T00:20:08.442 INFO:teuthology.orchestra.run.smithi050.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-15T00:20:08.442 INFO:teuthology.orchestra.run.smithi050.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-15T00:20:08.443 INFO:teuthology.orchestra.run.smithi050.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-15T00:20:08.443 INFO:teuthology.orchestra.run.smithi050.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-15T00:20:08.443 INFO:teuthology.orchestra.run.smithi050.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-15T00:20:08.443 INFO:teuthology.orchestra.run.smithi050.stdout: librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:08.443 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:08.443 INFO:teuthology.orchestra.run.smithi050.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-15T00:20:08.443 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-15T00:20:08.443 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-15T00:20:08.443 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-15T00:20:08.443 INFO:teuthology.orchestra.run.smithi050.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-15T00:20:08.443 INFO:teuthology.orchestra.run.smithi050.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-15T00:20:08.443 INFO:teuthology.orchestra.run.smithi050.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-15T00:20:08.443 INFO:teuthology.orchestra.run.smithi050.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-15T00:20:08.443 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-15T00:20:08.444 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2024-04-15T00:20:08.444 INFO:teuthology.orchestra.run.smithi050.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-15T00:20:08.444 INFO:teuthology.orchestra.run.smithi050.stdout: automake-1.16.2-8.el9.noarch 2024-04-15T00:20:08.444 INFO:teuthology.orchestra.run.smithi050.stdout: bison-3.7.4-5.el9.x86_64 2024-04-15T00:20:08.444 INFO:teuthology.orchestra.run.smithi050.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-15T00:20:08.444 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:08.444 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:08.444 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:08.444 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:08.444 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T00:20:08.444 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:08.444 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:08.444 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:08.445 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T00:20:08.445 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T00:20:08.445 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T00:20:08.445 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T00:20:08.445 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T00:20:08.445 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:08.445 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:08.445 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T00:20:08.445 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:08.445 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:08.445 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:08.445 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T00:20:08.445 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T00:20:08.445 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:08.446 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-shell-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:08.446 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-top-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T00:20:08.446 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-15T00:20:08.446 INFO:teuthology.orchestra.run.smithi050.stdout: flex-2.6.4-9.el9.x86_64 2024-04-15T00:20:08.446 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-15T00:20:08.446 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-15T00:20:08.446 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-15T00:20:08.446 INFO:teuthology.orchestra.run.smithi050.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-15T00:20:08.446 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-15T00:20:08.446 INFO:teuthology.orchestra.run.smithi050.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-15T00:20:08.446 INFO:teuthology.orchestra.run.smithi050.stdout: jq-1.6-16.el9.x86_64 2024-04-15T00:20:08.446 INFO:teuthology.orchestra.run.smithi050.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-15T00:20:08.446 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-15T00:20:08.447 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-15T00:20:08.447 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:08.447 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:08.447 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:08.447 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-15T00:20:08.447 INFO:teuthology.orchestra.run.smithi050.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-15T00:20:08.447 INFO:teuthology.orchestra.run.smithi050.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-15T00:20:08.447 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-15T00:20:08.447 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-15T00:20:08.447 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:08.447 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:08.447 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-15T00:20:08.447 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:08.447 INFO:teuthology.orchestra.run.smithi050.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-15T00:20:08.448 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-15T00:20:08.448 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-15T00:20:08.448 INFO:teuthology.orchestra.run.smithi050.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-15T00:20:08.448 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-15T00:20:08.448 INFO:teuthology.orchestra.run.smithi050.stdout: lua-5.4.4-4.el9.x86_64 2024-04-15T00:20:08.448 INFO:teuthology.orchestra.run.smithi050.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-15T00:20:08.448 INFO:teuthology.orchestra.run.smithi050.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-15T00:20:08.448 INFO:teuthology.orchestra.run.smithi050.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-15T00:20:08.448 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-15T00:20:08.449 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-15T00:20:08.449 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-15T00:20:08.449 INFO:teuthology.orchestra.run.smithi050.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-15T00:20:08.449 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-13.14-1.el9.x86_64 2024-04-15T00:20:08.449 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-15T00:20:08.449 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-15T00:20:08.449 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-15T00:20:08.449 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-15T00:20:08.449 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-15T00:20:08.449 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-15T00:20:08.449 INFO:teuthology.orchestra.run.smithi050.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-15T00:20:08.449 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-15T00:20:08.449 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-15T00:20:08.450 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-15T00:20:08.450 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:08.450 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:08.450 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:08.450 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-15T00:20:08.450 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-15T00:20:08.450 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-15T00:20:08.450 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-15T00:20:08.450 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-15T00:20:08.450 INFO:teuthology.orchestra.run.smithi050.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-15T00:20:08.450 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-15T00:20:08.450 INFO:teuthology.orchestra.run.smithi050.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-15T00:20:08.450 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-15T00:20:08.451 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-15T00:20:08.451 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-15T00:20:08.451 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-15T00:20:08.451 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-15T00:20:08.451 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-15T00:20:08.451 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-15T00:20:08.451 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-15T00:20:08.451 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-15T00:20:08.451 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-15T00:20:08.451 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-15T00:20:08.451 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-15T00:20:08.451 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-15T00:20:08.451 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-15T00:20:08.452 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-15T00:20:08.452 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-15T00:20:08.452 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-15T00:20:08.452 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-15T00:20:08.452 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-15T00:20:08.452 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-15T00:20:08.452 INFO:teuthology.orchestra.run.smithi050.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-15T00:20:08.452 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-15T00:20:08.452 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ply-3.11-14.el9.noarch 2024-04-15T00:20:08.452 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-15T00:20:08.452 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-15T00:20:08.452 INFO:teuthology.orchestra.run.smithi050.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-15T00:20:08.452 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-15T00:20:08.452 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-15T00:20:08.452 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-15T00:20:08.453 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-15T00:20:08.453 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-15T00:20:08.453 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-15T00:20:08.453 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:08.453 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:08.453 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-15T00:20:08.453 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-15T00:20:08.453 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-15T00:20:08.453 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:08.453 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-15T00:20:08.453 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-15T00:20:08.453 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-15T00:20:08.453 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-15T00:20:08.454 INFO:teuthology.orchestra.run.smithi050.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-15T00:20:08.454 INFO:teuthology.orchestra.run.smithi050.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-15T00:20:08.454 INFO:teuthology.orchestra.run.smithi050.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-15T00:20:08.454 INFO:teuthology.orchestra.run.smithi050.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-15T00:20:08.454 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-15T00:20:08.454 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-15T00:20:08.454 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-15T00:20:08.454 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-15T00:20:08.454 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-15T00:20:08.454 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-15T00:20:08.454 INFO:teuthology.orchestra.run.smithi050.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-15T00:20:08.454 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:08.454 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:08.454 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T00:20:08.455 INFO:teuthology.orchestra.run.smithi050.stdout: re2-1:20211101-3.el9.x86_64 2024-04-15T00:20:08.455 INFO:teuthology.orchestra.run.smithi050.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-15T00:20:08.455 INFO:teuthology.orchestra.run.smithi050.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-15T00:20:08.455 INFO:teuthology.orchestra.run.smithi050.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-15T00:20:08.455 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-15T00:20:08.455 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-15T00:20:08.455 INFO:teuthology.orchestra.run.smithi050.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-15T00:20:08.455 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:20:08.456 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-04-15T00:20:08.942 DEBUG:teuthology.parallel:result is None 2024-04-15T00:20:08.943 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 2024-04-15T00:20:09.086 DEBUG:teuthology.orchestra.run.smithi031:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-15T00:20:09.111 INFO:teuthology.orchestra.run.smithi031.stdout:19.0.0-2114.ga9a752df.el7 2024-04-15T00:20:09.112 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2114.ga9a752df.el7 2024-04-15T00:20:09.112 INFO:teuthology.task.install:The correct ceph version 19.0.0-2114.ga9a752df is installed. 2024-04-15T00:20:09.114 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 2024-04-15T00:20:09.260 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-15T00:20:09.281 INFO:teuthology.orchestra.run.smithi050.stdout:19.0.0-2114.ga9a752df.el7 2024-04-15T00:20:09.281 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2114.ga9a752df.el7 2024-04-15T00:20:09.281 INFO:teuthology.task.install:The correct ceph version 19.0.0-2114.ga9a752df is installed. 2024-04-15T00:20:09.283 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-15T00:20:09.283 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-15T00:20:09.284 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-15T00:20:09.318 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-15T00:20:09.318 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-15T00:20:09.349 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-15T00:20:09.350 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-15T00:20:09.350 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/daemon-helper 2024-04-15T00:20:09.387 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-15T00:20:09.456 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-15T00:20:09.456 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/daemon-helper 2024-04-15T00:20:09.482 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-15T00:20:09.548 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-15T00:20:09.548 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-15T00:20:09.548 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-15T00:20:09.577 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-15T00:20:09.644 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-15T00:20:09.645 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-15T00:20:09.672 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-15T00:20:09.739 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-15T00:20:09.740 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-15T00:20:09.740 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/stdin-killer 2024-04-15T00:20:09.767 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-15T00:20:09.834 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-15T00:20:09.834 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/stdin-killer 2024-04-15T00:20:09.861 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-15T00:20:09.928 INFO:teuthology.run_tasks:Running task ceph... 2024-04-15T00:20:10.015 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-15T00:20:10.016 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 777 /var/log/ceph 2024-04-15T00:20:10.018 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 777 /var/log/ceph 2024-04-15T00:20:10.044 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-15T00:20:10.044 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-15T00:20:10.085 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-15T00:20:10.111 INFO:tasks.ceph:Creating extra log directories... 2024-04-15T00:20:10.112 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-15T00:20:10.152 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-15T00:20:10.185 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-15T00:20:10.185 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-15T00:20:10.185 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-15T00:20:10.185 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-15T00:20:10.185 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-15T00:20:10.231 DEBUG:teuthology.orchestra.run.smithi031:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-15T00:20:10.350 DEBUG:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-15T00:20:10.377 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-15T00:20:10.377 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-15T00:20:10.392 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-15T00:20:10.509 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-15T00:20:10.541 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-15T00:20:10.541 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds inject traceless reply probability': 0.5, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'SLOW_OPS', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-15T00:20:10.541 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656634', 'branch': 'squid', 'description': 'fs/traceless/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_ffsb traceless/50pc}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7656634', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds inject traceless reply probability': 0.5, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'SLOW_OPS', 'slow request'], 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 840, 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765', 'sleep_before_teardown': 0, 'subset': '427/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi031.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNn/78zpNCO1u7aePEvFteOWbNZakRUONk4VBVixpEo1uoDb94JpfpsnF22EsVb3bXpizehxZKpiHaVAf1Ws0ws=', 'smithi050.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLWOzY9VzwV1Diat2zO7DNPgVuGriryQsfJfgWGy09MvJqO0dpFD8H69w3WY7BZREN5LA/YhK/MaW5QfYGq4bvQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds inject traceless reply probability': 0.5, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'SLOW_OPS', 'slow request'], 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'check-counter': {'counters': {'mds': ['mds.dir_split']}}}, {'workunit': {'clients': {'all': ['suites/ffsb.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '6c637841c215537a4502385240412f1966e0faab', 'timestamp': '2024-04-14_21:24:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-15T00:20:10.542 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-15T00:20:10.545 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-15T00:20:10.591 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/run/ceph 2024-04-15T00:20:10.600 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/run/ceph 2024-04-15T00:20:10.658 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-15T00:20:10.658 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/scratch_devs of=/dev/stdout 2024-04-15T00:20:10.678 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-15T00:20:10.678 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_1 2024-04-15T00:20:10.732 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-15T00:20:10.732 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T00:20:10.732 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-15T00:20:10.732 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T00:20:10.732 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T00:20:10.732 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-04-15 00:19:53.452548655 +0000 2024-04-15T00:20:10.732 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-04-15 00:17:27.190882762 +0000 2024-04-15T00:20:10.733 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-04-15 00:17:27.190882762 +0000 2024-04-15T00:20:10.733 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2024-04-15 00:17:27.190882762 +0000 2024-04-15T00:20:10.733 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-15T00:20:10.797 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-04-15T00:20:10.797 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-04-15T00:20:10.797 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000184108 s, 2.8 MB/s 2024-04-15T00:20:10.798 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-15T00:20:10.853 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_2 2024-04-15T00:20:10.908 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-15T00:20:10.909 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T00:20:10.909 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-15T00:20:10.909 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T00:20:10.909 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T00:20:10.909 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-04-15 00:19:53.452548655 +0000 2024-04-15T00:20:10.909 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-04-15 00:17:27.535876883 +0000 2024-04-15T00:20:10.909 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-04-15 00:17:27.535876883 +0000 2024-04-15T00:20:10.909 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2024-04-15 00:17:27.535876883 +0000 2024-04-15T00:20:10.909 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-15T00:20:10.974 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-04-15T00:20:10.974 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-04-15T00:20:10.974 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000206079 s, 2.5 MB/s 2024-04-15T00:20:10.975 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-15T00:20:11.030 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_3 2024-04-15T00:20:11.085 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-15T00:20:11.085 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T00:20:11.085 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-15T00:20:11.085 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T00:20:11.085 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T00:20:11.085 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-04-15 00:19:53.453548638 +0000 2024-04-15T00:20:11.086 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-04-15 00:17:27.882870970 +0000 2024-04-15T00:20:11.086 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-04-15 00:17:27.882870970 +0000 2024-04-15T00:20:11.086 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2024-04-15 00:17:27.882870970 +0000 2024-04-15T00:20:11.086 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-15T00:20:11.149 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-04-15T00:20:11.150 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-04-15T00:20:11.150 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000175299 s, 2.9 MB/s 2024-04-15T00:20:11.151 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-15T00:20:11.206 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_4 2024-04-15T00:20:11.261 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-15T00:20:11.262 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T00:20:11.262 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-15T00:20:11.262 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T00:20:11.262 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T00:20:11.262 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-04-15 00:19:53.453548638 +0000 2024-04-15T00:20:11.262 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-04-15 00:17:28.232865006 +0000 2024-04-15T00:20:11.262 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-04-15 00:17:28.232865006 +0000 2024-04-15T00:20:11.262 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2024-04-15 00:17:28.232865006 +0000 2024-04-15T00:20:11.263 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-15T00:20:11.327 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-04-15T00:20:11.327 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-04-15T00:20:11.327 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000188262 s, 2.7 MB/s 2024-04-15T00:20:11.328 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-15T00:20:11.384 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-15T00:20:11.384 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-15T00:20:11.384 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/scratch_devs of=/dev/stdout 2024-04-15T00:20:11.402 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-15T00:20:11.402 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_1 2024-04-15T00:20:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-15T00:20:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T00:20:11.458 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-15T00:20:11.459 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T00:20:11.459 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T00:20:11.459 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-04-15 00:20:00.499183374 +0000 2024-04-15T00:20:11.459 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-04-15 00:17:27.184555726 +0000 2024-04-15T00:20:11.459 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-04-15 00:17:27.184555726 +0000 2024-04-15T00:20:11.459 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-04-15 00:17:27.184555726 +0000 2024-04-15T00:20:11.459 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-15T00:20:11.529 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-04-15T00:20:11.529 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-04-15T00:20:11.529 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000108458 s, 4.7 MB/s 2024-04-15T00:20:11.530 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-15T00:20:11.588 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_2 2024-04-15T00:20:11.645 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-15T00:20:11.646 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T00:20:11.646 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-15T00:20:11.646 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T00:20:11.646 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T00:20:11.646 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-04-15 00:20:00.500183349 +0000 2024-04-15T00:20:11.646 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-04-15 00:17:27.537546509 +0000 2024-04-15T00:20:11.646 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-04-15 00:17:27.537546509 +0000 2024-04-15T00:20:11.646 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-04-15 00:17:27.537546509 +0000 2024-04-15T00:20:11.646 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-15T00:20:11.714 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-04-15T00:20:11.714 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-04-15T00:20:11.714 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000109058 s, 4.7 MB/s 2024-04-15T00:20:11.716 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-15T00:20:11.773 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_3 2024-04-15T00:20:11.831 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-15T00:20:11.831 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T00:20:11.831 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-04-15T00:20:11.831 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T00:20:11.831 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T00:20:11.831 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-04-15 00:20:00.500183349 +0000 2024-04-15T00:20:11.831 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-04-15 00:17:27.881537528 +0000 2024-04-15T00:20:11.831 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-04-15 00:17:27.881537528 +0000 2024-04-15T00:20:11.831 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-04-15 00:17:27.881537528 +0000 2024-04-15T00:20:11.831 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-15T00:20:11.898 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-04-15T00:20:11.899 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-04-15T00:20:11.899 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.00010141 s, 5.0 MB/s 2024-04-15T00:20:11.900 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-15T00:20:11.957 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_4 2024-04-15T00:20:12.013 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-15T00:20:12.013 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T00:20:12.013 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-04-15T00:20:12.013 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T00:20:12.013 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T00:20:12.013 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-04-15 00:20:00.501183324 +0000 2024-04-15T00:20:12.013 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-04-15 00:17:28.211528912 +0000 2024-04-15T00:20:12.013 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-04-15 00:17:28.212528885 +0000 2024-04-15T00:20:12.013 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-04-15 00:17:28.211528912 +0000 2024-04-15T00:20:12.014 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-15T00:20:12.080 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-04-15T00:20:12.080 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-04-15T00:20:12.080 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000102851 s, 5.0 MB/s 2024-04-15T00:20:12.081 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-15T00:20:12.139 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-15T00:20:12.139 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-15T00:20:12.139 INFO:tasks.ceph:Generating config... 2024-04-15T00:20:12.140 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-15T00:20:12.140 INFO:tasks.ceph:[client] debug client = 20 2024-04-15T00:20:12.140 INFO:tasks.ceph:[client] debug ms = 1 2024-04-15T00:20:12.141 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-15T00:20:12.141 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-15T00:20:12.141 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-15T00:20:12.141 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-15T00:20:12.141 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-15T00:20:12.141 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-04-15T00:20:12.141 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-04-15T00:20:12.141 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-04-15T00:20:12.141 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-04-15T00:20:12.141 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-15T00:20:12.141 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-15T00:20:12.141 INFO:tasks.ceph:[mds] mds inject traceless reply probability = 0.5 2024-04-15T00:20:12.141 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-15T00:20:12.141 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-15T00:20:12.141 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-15T00:20:12.142 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-15T00:20:12.142 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-15T00:20:12.142 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-15T00:20:12.142 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-15T00:20:12.142 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-15T00:20:12.142 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-15T00:20:12.142 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-15T00:20:12.142 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-15T00:20:12.142 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-15T00:20:12.142 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-15T00:20:12.142 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-15T00:20:12.142 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-15T00:20:12.142 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-15T00:20:12.142 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-15T00:20:12.142 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-15T00:20:12.143 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-15T00:20:12.143 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-15T00:20:12.143 INFO:tasks.ceph:[osd] filestore flush min = 0 2024-04-15T00:20:12.143 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-15T00:20:12.143 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-15T00:20:12.143 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-15T00:20:12.143 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-15T00:20:12.143 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-15T00:20:12.143 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-15T00:20:12.143 INFO:tasks.ceph:Setting up mon.a... 2024-04-15T00:20:12.143 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-15T00:20:12.250 INFO:teuthology.orchestra.run.smithi031.stdout:creating /etc/ceph/ceph.keyring 2024-04-15T00:20:12.253 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-15T00:20:12.298 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-15T00:20:12.326 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.31'), ('mon.b', '172.21.15.50'), ('mon.c', '[v2:172.21.15.50:3301,v1:172.21.15.50:6790]')] 2024-04-15T00:20:12.327 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.31,172.21.15.50,[v2:172.21.15.50:3301,v1:172.21.15.50:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds inject traceless reply probability': 0.5, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-15T00:20:12.328 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-15T00:20:12.328 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-15T00:20:12.381 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.31 --add b 172.21.15.50 --addv c '[v2:172.21.15.50:3301,v1:172.21.15.50:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-15T00:20:12.466 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-15T00:20:12.466 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: generated fsid b57c03ab-2810-4ea5-b233-6164468328c0 2024-04-15T00:20:12.467 INFO:teuthology.orchestra.run.smithi031.stdout:setting min_mon_release = quincy 2024-04-15T00:20:12.467 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 0 2024-04-15T00:20:12.467 INFO:teuthology.orchestra.run.smithi031.stdout:fsid b57c03ab-2810-4ea5-b233-6164468328c0 2024-04-15T00:20:12.467 INFO:teuthology.orchestra.run.smithi031.stdout:last_changed 2024-04-15T00:20:12.460533+0000 2024-04-15T00:20:12.467 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-04-15T00:20:12.460533+0000 2024-04-15T00:20:12.467 INFO:teuthology.orchestra.run.smithi031.stdout:min_mon_release 17 (quincy) 2024-04-15T00:20:12.467 INFO:teuthology.orchestra.run.smithi031.stdout:election_strategy: 1 2024-04-15T00:20:12.467 INFO:teuthology.orchestra.run.smithi031.stdout:0: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.a 2024-04-15T00:20:12.467 INFO:teuthology.orchestra.run.smithi031.stdout:1: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.b 2024-04-15T00:20:12.467 INFO:teuthology.orchestra.run.smithi031.stdout:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-04-15T00:20:12.467 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-15T00:20:12.468 DEBUG:teuthology.orchestra.run.smithi031:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-15T00:20:12.482 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b57c03ab-2810-4ea5-b233-6164468328c0... 2024-04-15T00:20:12.483 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-15T00:20:12.524 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-15T00:20:12.572 INFO:teuthology.orchestra.run.smithi031.stdout:[global] 2024-04-15T00:20:12.572 INFO:teuthology.orchestra.run.smithi031.stdout: chdir = "" 2024-04-15T00:20:12.572 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-15T00:20:12.572 INFO:teuthology.orchestra.run.smithi031.stdout: auth supported = cephx 2024-04-15T00:20:12.572 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:12.572 INFO:teuthology.orchestra.run.smithi031.stdout: filestore xattr use omap = true 2024-04-15T00:20:12.572 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:12.572 INFO:teuthology.orchestra.run.smithi031.stdout: mon clock drift allowed = 1.000 2024-04-15T00:20:12.572 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:12.572 INFO:teuthology.orchestra.run.smithi031.stdout: osd crush chooseleaf type = 0 2024-04-15T00:20:12.573 INFO:teuthology.orchestra.run.smithi031.stdout: auth debug = true 2024-04-15T00:20:12.573 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:12.573 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on old message = true 2024-04-15T00:20:12.573 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on bug = true 2024-04-15T00:20:12.573 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:12.573 INFO:teuthology.orchestra.run.smithi031.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-15T00:20:12.573 INFO:teuthology.orchestra.run.smithi031.stdout: mon pg warn max object skew = 0 2024-04-15T00:20:12.573 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:12.573 INFO:teuthology.orchestra.run.smithi031.stdout: # disable pg_autoscaler by default for new pools 2024-04-15T00:20:12.573 INFO:teuthology.orchestra.run.smithi031.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-15T00:20:12.573 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:12.573 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default size = 2 2024-04-15T00:20:12.574 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:12.574 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow primary affinity = true 2024-04-15T00:20:12.574 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow pg remap = true 2024-04-15T00:20:12.574 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on legacy crush tunables = false 2024-04-15T00:20:12.574 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on crush straw calc version zero = false 2024-04-15T00:20:12.574 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on no sortbitwise = false 2024-04-15T00:20:12.574 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on osd down out interval zero = false 2024-04-15T00:20:12.574 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on too few osds = false 2024-04-15T00:20:12.574 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-15T00:20:12.574 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-15T00:20:12.574 INFO:teuthology.orchestra.run.smithi031.stdout: mon_allow_pool_size_one = true 2024-04-15T00:20:12.574 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:12.574 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-15T00:20:12.574 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:12.575 INFO:teuthology.orchestra.run.smithi031.stdout: osd default data pool replay window = 5 2024-04-15T00:20:12.575 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:12.575 INFO:teuthology.orchestra.run.smithi031.stdout: mon allow pool delete = true 2024-04-15T00:20:12.575 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:12.575 INFO:teuthology.orchestra.run.smithi031.stdout: mon cluster log file level = debug 2024-04-15T00:20:12.575 INFO:teuthology.orchestra.run.smithi031.stdout: debug asserts on shutdown = true 2024-04-15T00:20:12.575 INFO:teuthology.orchestra.run.smithi031.stdout: mon health detail to clog = false 2024-04-15T00:20:12.575 INFO:teuthology.orchestra.run.smithi031.stdout: mon host = "172.21.15.31,172.21.15.50,[v2:172.21.15.50:3301,v1:172.21.15.50:6790]" 2024-04-15T00:20:12.575 INFO:teuthology.orchestra.run.smithi031.stdout: fsid = b57c03ab-2810-4ea5-b233-6164468328c0 2024-04-15T00:20:12.575 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:12.575 INFO:teuthology.orchestra.run.smithi031.stdout:[osd] 2024-04-15T00:20:12.575 INFO:teuthology.orchestra.run.smithi031.stdout: osd journal size = 100 2024-04-15T00:20:12.575 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:12.575 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub load threshold = 5.0 2024-04-15T00:20:12.575 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub max interval = 600 2024-04-15T00:20:12.576 INFO:teuthology.orchestra.run.smithi031.stdout: osd mclock profile = high_recovery_ops 2024-04-15T00:20:12.576 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:12.576 INFO:teuthology.orchestra.run.smithi031.stdout: osd recover clone overlap = true 2024-04-15T00:20:12.576 INFO:teuthology.orchestra.run.smithi031.stdout: osd recovery max chunk = 1048576 2024-04-15T00:20:12.576 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:12.576 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug shutdown = true 2024-04-15T00:20:12.576 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug op order = true 2024-04-15T00:20:12.576 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug verify stray on activate = true 2024-04-15T00:20:12.576 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug trim objects = true 2024-04-15T00:20:12.576 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:12.576 INFO:teuthology.orchestra.run.smithi031.stdout: osd open classes on start = true 2024-04-15T00:20:12.576 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug pg log writeout = true 2024-04-15T00:20:12.576 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:12.576 INFO:teuthology.orchestra.run.smithi031.stdout: osd deep scrub update digest min age = 30 2024-04-15T00:20:12.576 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:12.577 INFO:teuthology.orchestra.run.smithi031.stdout: osd map max advance = 10 2024-04-15T00:20:12.577 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:12.577 INFO:teuthology.orchestra.run.smithi031.stdout: journal zero on create = true 2024-04-15T00:20:12.577 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:12.577 INFO:teuthology.orchestra.run.smithi031.stdout: filestore ondisk finisher threads = 3 2024-04-15T00:20:12.577 INFO:teuthology.orchestra.run.smithi031.stdout: filestore apply finisher threads = 3 2024-04-15T00:20:12.577 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:12.577 INFO:teuthology.orchestra.run.smithi031.stdout: bdev debug aio = true 2024-04-15T00:20:12.577 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug misdirected ops = true 2024-04-15T00:20:12.577 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore block size = 96636764160 2024-04-15T00:20:12.577 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore fsck on mount = True 2024-04-15T00:20:12.577 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluefs = 20 2024-04-15T00:20:12.577 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluestore = 20 2024-04-15T00:20:12.577 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-04-15T00:20:12.577 INFO:teuthology.orchestra.run.smithi031.stdout: debug osd = 20 2024-04-15T00:20:12.578 INFO:teuthology.orchestra.run.smithi031.stdout: debug rocksdb = 10 2024-04-15T00:20:12.578 INFO:teuthology.orchestra.run.smithi031.stdout: filestore flush min = 0 2024-04-15T00:20:12.578 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd backfillfull_ratio = 0.85 2024-04-15T00:20:12.578 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd full ratio = 0.9 2024-04-15T00:20:12.578 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd nearfull ratio = 0.8 2024-04-15T00:20:12.578 INFO:teuthology.orchestra.run.smithi031.stdout: osd failsafe full ratio = 0.95 2024-04-15T00:20:12.578 INFO:teuthology.orchestra.run.smithi031.stdout: osd objectstore = bluestore 2024-04-15T00:20:12.578 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2024-04-15T00:20:12.578 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:12.578 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr] 2024-04-15T00:20:12.578 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-04-15T00:20:12.578 INFO:teuthology.orchestra.run.smithi031.stdout: debug mgr = 20 2024-04-15T00:20:12.578 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2024-04-15T00:20:12.578 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2024-04-15T00:20:12.579 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2024-04-15T00:20:12.579 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2024-04-15T00:20:12.579 INFO:teuthology.orchestra.run.smithi031.stdout: mgr/telemetry/nag = false 2024-04-15T00:20:12.579 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2024-04-15T00:20:12.579 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:12.579 INFO:teuthology.orchestra.run.smithi031.stdout:[mon] 2024-04-15T00:20:12.579 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-04-15T00:20:12.579 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2024-04-15T00:20:12.579 INFO:teuthology.orchestra.run.smithi031.stdout: debug paxos = 20 2024-04-15T00:20:12.579 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2024-04-15T00:20:12.579 INFO:teuthology.orchestra.run.smithi031.stdout: mon data avail warn = 5 2024-04-15T00:20:12.579 INFO:teuthology.orchestra.run.smithi031.stdout: mon mgr mkfs grace = 240 2024-04-15T00:20:12.579 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2024-04-15T00:20:12.579 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd reporter subtree level = osd 2024-04-15T00:20:12.579 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd prime pg temp = true 2024-04-15T00:20:12.579 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2024-04-15T00:20:12.580 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:12.580 INFO:teuthology.orchestra.run.smithi031.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-15T00:20:12.580 INFO:teuthology.orchestra.run.smithi031.stdout: auth mon ticket ttl = 660 # 11m 2024-04-15T00:20:12.580 INFO:teuthology.orchestra.run.smithi031.stdout: auth service ticket ttl = 240 # 4m 2024-04-15T00:20:12.580 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:12.580 INFO:teuthology.orchestra.run.smithi031.stdout: # don't complain about insecure global_id in the test suite 2024-04-15T00:20:12.580 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-15T00:20:12.580 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-15T00:20:12.580 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:12.580 INFO:teuthology.orchestra.run.smithi031.stdout: # 1m isn't quite enough 2024-04-15T00:20:12.580 INFO:teuthology.orchestra.run.smithi031.stdout: mon_down_mkfs_grace = 2m 2024-04-15T00:20:12.580 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:12.580 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_filestore_osds = false 2024-04-15T00:20:12.580 INFO:teuthology.orchestra.run.smithi031.stdout: mon down mkfs grace = 300 2024-04-15T00:20:12.580 INFO:teuthology.orchestra.run.smithi031.stdout: mon op complaint time = 120 2024-04-15T00:20:12.581 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:12.581 INFO:teuthology.orchestra.run.smithi031.stdout:[client] 2024-04-15T00:20:12.581 INFO:teuthology.orchestra.run.smithi031.stdout: rgw cache enabled = true 2024-04-15T00:20:12.581 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable ops log = true 2024-04-15T00:20:12.581 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable usage log = true 2024-04-15T00:20:12.581 INFO:teuthology.orchestra.run.smithi031.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-15T00:20:12.581 INFO:teuthology.orchestra.run.smithi031.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-15T00:20:12.581 INFO:teuthology.orchestra.run.smithi031.stdout: client mount timeout = 600 2024-04-15T00:20:12.581 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2024-04-15T00:20:12.581 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-04-15T00:20:12.582 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2024-04-15T00:20:12.582 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2024-04-15T00:20:12.582 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.a] 2024-04-15T00:20:12.582 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.b] 2024-04-15T00:20:12.583 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.c] 2024-04-15T00:20:12.583 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2024-04-15T00:20:12.583 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2024-04-15T00:20:12.583 INFO:teuthology.orchestra.run.smithi031.stdout:[mds] 2024-04-15T00:20:12.583 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds = 20 2024-04-15T00:20:12.583 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds balancer = 20 2024-04-15T00:20:12.583 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-04-15T00:20:12.583 INFO:teuthology.orchestra.run.smithi031.stdout: mds bal fragment size max = 10000 2024-04-15T00:20:12.583 INFO:teuthology.orchestra.run.smithi031.stdout: mds bal merge size = 5 2024-04-15T00:20:12.583 INFO:teuthology.orchestra.run.smithi031.stdout: mds bal split bits = 3 2024-04-15T00:20:12.583 INFO:teuthology.orchestra.run.smithi031.stdout: mds bal split size = 100 2024-04-15T00:20:12.583 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug frag = True 2024-04-15T00:20:12.583 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug scatterstat = True 2024-04-15T00:20:12.583 INFO:teuthology.orchestra.run.smithi031.stdout: mds inject traceless reply probability = 0.5 2024-04-15T00:20:12.583 INFO:teuthology.orchestra.run.smithi031.stdout: mds op complaint time = 180 2024-04-15T00:20:12.584 INFO:teuthology.orchestra.run.smithi031.stdout: mds verify scatter = True 2024-04-15T00:20:12.584 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2024-04-15T00:20:12.584 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2024-04-15T00:20:12.584 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2024-04-15T00:20:12.584 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2024-04-15T00:20:12.584 INFO:teuthology.orchestra.run.smithi050.stdout: chdir = "" 2024-04-15T00:20:12.584 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-15T00:20:12.584 INFO:teuthology.orchestra.run.smithi050.stdout: auth supported = cephx 2024-04-15T00:20:12.585 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:20:12.585 INFO:teuthology.orchestra.run.smithi050.stdout: filestore xattr use omap = true 2024-04-15T00:20:12.585 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:20:12.585 INFO:teuthology.orchestra.run.smithi050.stdout: mon clock drift allowed = 1.000 2024-04-15T00:20:12.585 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:20:12.585 INFO:teuthology.orchestra.run.smithi050.stdout: osd crush chooseleaf type = 0 2024-04-15T00:20:12.585 INFO:teuthology.orchestra.run.smithi050.stdout: auth debug = true 2024-04-15T00:20:12.585 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:20:12.585 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on old message = true 2024-04-15T00:20:12.585 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on bug = true 2024-04-15T00:20:12.585 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:20:12.585 INFO:teuthology.orchestra.run.smithi050.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-15T00:20:12.585 INFO:teuthology.orchestra.run.smithi050.stdout: mon pg warn max object skew = 0 2024-04-15T00:20:12.585 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:20:12.586 INFO:teuthology.orchestra.run.smithi050.stdout: # disable pg_autoscaler by default for new pools 2024-04-15T00:20:12.586 INFO:teuthology.orchestra.run.smithi050.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-15T00:20:12.586 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:20:12.586 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default size = 2 2024-04-15T00:20:12.586 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:20:12.586 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow primary affinity = true 2024-04-15T00:20:12.586 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow pg remap = true 2024-04-15T00:20:12.586 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on legacy crush tunables = false 2024-04-15T00:20:12.586 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on crush straw calc version zero = false 2024-04-15T00:20:12.586 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on no sortbitwise = false 2024-04-15T00:20:12.586 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on osd down out interval zero = false 2024-04-15T00:20:12.586 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on too few osds = false 2024-04-15T00:20:12.586 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-15T00:20:12.586 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-15T00:20:12.587 INFO:teuthology.orchestra.run.smithi050.stdout: mon_allow_pool_size_one = true 2024-04-15T00:20:12.587 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:20:12.587 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-15T00:20:12.587 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:20:12.587 INFO:teuthology.orchestra.run.smithi050.stdout: osd default data pool replay window = 5 2024-04-15T00:20:12.587 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:20:12.587 INFO:teuthology.orchestra.run.smithi050.stdout: mon allow pool delete = true 2024-04-15T00:20:12.587 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:20:12.587 INFO:teuthology.orchestra.run.smithi050.stdout: mon cluster log file level = debug 2024-04-15T00:20:12.587 INFO:teuthology.orchestra.run.smithi050.stdout: debug asserts on shutdown = true 2024-04-15T00:20:12.587 INFO:teuthology.orchestra.run.smithi050.stdout: mon health detail to clog = false 2024-04-15T00:20:12.587 INFO:teuthology.orchestra.run.smithi050.stdout: mon host = "172.21.15.31,172.21.15.50,[v2:172.21.15.50:3301,v1:172.21.15.50:6790]" 2024-04-15T00:20:12.587 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = b57c03ab-2810-4ea5-b233-6164468328c0 2024-04-15T00:20:12.587 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:20:12.587 INFO:teuthology.orchestra.run.smithi050.stdout:[osd] 2024-04-15T00:20:12.588 INFO:teuthology.orchestra.run.smithi050.stdout: osd journal size = 100 2024-04-15T00:20:12.588 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:20:12.588 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub load threshold = 5.0 2024-04-15T00:20:12.588 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub max interval = 600 2024-04-15T00:20:12.588 INFO:teuthology.orchestra.run.smithi050.stdout: osd mclock profile = high_recovery_ops 2024-04-15T00:20:12.588 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:20:12.588 INFO:teuthology.orchestra.run.smithi050.stdout: osd recover clone overlap = true 2024-04-15T00:20:12.588 INFO:teuthology.orchestra.run.smithi050.stdout: osd recovery max chunk = 1048576 2024-04-15T00:20:12.588 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:20:12.588 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug shutdown = true 2024-04-15T00:20:12.588 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug op order = true 2024-04-15T00:20:12.588 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug verify stray on activate = true 2024-04-15T00:20:12.588 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug trim objects = true 2024-04-15T00:20:12.588 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:20:12.588 INFO:teuthology.orchestra.run.smithi050.stdout: osd open classes on start = true 2024-04-15T00:20:12.589 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug pg log writeout = true 2024-04-15T00:20:12.589 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:20:12.589 INFO:teuthology.orchestra.run.smithi050.stdout: osd deep scrub update digest min age = 30 2024-04-15T00:20:12.589 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:20:12.589 INFO:teuthology.orchestra.run.smithi050.stdout: osd map max advance = 10 2024-04-15T00:20:12.589 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:20:12.589 INFO:teuthology.orchestra.run.smithi050.stdout: journal zero on create = true 2024-04-15T00:20:12.589 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:20:12.589 INFO:teuthology.orchestra.run.smithi050.stdout: filestore ondisk finisher threads = 3 2024-04-15T00:20:12.589 INFO:teuthology.orchestra.run.smithi050.stdout: filestore apply finisher threads = 3 2024-04-15T00:20:12.589 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:20:12.589 INFO:teuthology.orchestra.run.smithi050.stdout: bdev debug aio = true 2024-04-15T00:20:12.589 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug misdirected ops = true 2024-04-15T00:20:12.590 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore block size = 96636764160 2024-04-15T00:20:12.590 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore fsck on mount = True 2024-04-15T00:20:12.590 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluefs = 20 2024-04-15T00:20:12.590 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluestore = 20 2024-04-15T00:20:12.590 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-04-15T00:20:12.590 INFO:teuthology.orchestra.run.smithi050.stdout: debug osd = 20 2024-04-15T00:20:12.590 INFO:teuthology.orchestra.run.smithi050.stdout: debug rocksdb = 10 2024-04-15T00:20:12.590 INFO:teuthology.orchestra.run.smithi050.stdout: filestore flush min = 0 2024-04-15T00:20:12.590 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd backfillfull_ratio = 0.85 2024-04-15T00:20:12.590 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd full ratio = 0.9 2024-04-15T00:20:12.590 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd nearfull ratio = 0.8 2024-04-15T00:20:12.590 INFO:teuthology.orchestra.run.smithi050.stdout: osd failsafe full ratio = 0.95 2024-04-15T00:20:12.590 INFO:teuthology.orchestra.run.smithi050.stdout: osd objectstore = bluestore 2024-04-15T00:20:12.590 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2024-04-15T00:20:12.591 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:20:12.591 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr] 2024-04-15T00:20:12.591 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-04-15T00:20:12.591 INFO:teuthology.orchestra.run.smithi050.stdout: debug mgr = 20 2024-04-15T00:20:12.591 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2024-04-15T00:20:12.591 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2024-04-15T00:20:12.591 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2024-04-15T00:20:12.591 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2024-04-15T00:20:12.591 INFO:teuthology.orchestra.run.smithi050.stdout: mgr/telemetry/nag = false 2024-04-15T00:20:12.591 INFO:teuthology.orchestra.run.smithi050.stdout: debug client = 20 2024-04-15T00:20:12.591 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:20:12.592 INFO:teuthology.orchestra.run.smithi050.stdout:[mon] 2024-04-15T00:20:12.592 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-04-15T00:20:12.592 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2024-04-15T00:20:12.592 INFO:teuthology.orchestra.run.smithi050.stdout: debug paxos = 20 2024-04-15T00:20:12.592 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2024-04-15T00:20:12.592 INFO:teuthology.orchestra.run.smithi050.stdout: mon data avail warn = 5 2024-04-15T00:20:12.592 INFO:teuthology.orchestra.run.smithi050.stdout: mon mgr mkfs grace = 240 2024-04-15T00:20:12.592 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2024-04-15T00:20:12.592 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd reporter subtree level = osd 2024-04-15T00:20:12.592 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd prime pg temp = true 2024-04-15T00:20:12.592 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2024-04-15T00:20:12.593 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:20:12.593 INFO:teuthology.orchestra.run.smithi050.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-15T00:20:12.593 INFO:teuthology.orchestra.run.smithi050.stdout: auth mon ticket ttl = 660 # 11m 2024-04-15T00:20:12.593 INFO:teuthology.orchestra.run.smithi050.stdout: auth service ticket ttl = 240 # 4m 2024-04-15T00:20:12.593 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:20:12.593 INFO:teuthology.orchestra.run.smithi050.stdout: # don't complain about insecure global_id in the test suite 2024-04-15T00:20:12.593 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-15T00:20:12.593 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-15T00:20:12.593 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:20:12.593 INFO:teuthology.orchestra.run.smithi050.stdout: # 1m isn't quite enough 2024-04-15T00:20:12.593 INFO:teuthology.orchestra.run.smithi050.stdout: mon_down_mkfs_grace = 2m 2024-04-15T00:20:12.593 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:20:12.593 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_filestore_osds = false 2024-04-15T00:20:12.593 INFO:teuthology.orchestra.run.smithi050.stdout: mon down mkfs grace = 300 2024-04-15T00:20:12.593 INFO:teuthology.orchestra.run.smithi050.stdout: mon op complaint time = 120 2024-04-15T00:20:12.594 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-04-15T00:20:12.594 INFO:teuthology.orchestra.run.smithi050.stdout:[client] 2024-04-15T00:20:12.594 INFO:teuthology.orchestra.run.smithi050.stdout: rgw cache enabled = true 2024-04-15T00:20:12.594 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable ops log = true 2024-04-15T00:20:12.594 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable usage log = true 2024-04-15T00:20:12.594 INFO:teuthology.orchestra.run.smithi050.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-15T00:20:12.594 INFO:teuthology.orchestra.run.smithi050.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-15T00:20:12.594 INFO:teuthology.orchestra.run.smithi050.stdout: client mount timeout = 600 2024-04-15T00:20:12.594 INFO:teuthology.orchestra.run.smithi050.stdout: debug client = 20 2024-04-15T00:20:12.594 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-04-15T00:20:12.594 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2024-04-15T00:20:12.594 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2024-04-15T00:20:12.594 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.a] 2024-04-15T00:20:12.594 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.b] 2024-04-15T00:20:12.595 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.c] 2024-04-15T00:20:12.595 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2024-04-15T00:20:12.595 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2024-04-15T00:20:12.595 INFO:teuthology.orchestra.run.smithi050.stdout:[mds] 2024-04-15T00:20:12.595 INFO:teuthology.orchestra.run.smithi050.stdout: debug mds = 20 2024-04-15T00:20:12.595 INFO:teuthology.orchestra.run.smithi050.stdout: debug mds balancer = 20 2024-04-15T00:20:12.595 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-04-15T00:20:12.595 INFO:teuthology.orchestra.run.smithi050.stdout: mds bal fragment size max = 10000 2024-04-15T00:20:12.595 INFO:teuthology.orchestra.run.smithi050.stdout: mds bal merge size = 5 2024-04-15T00:20:12.595 INFO:teuthology.orchestra.run.smithi050.stdout: mds bal split bits = 3 2024-04-15T00:20:12.595 INFO:teuthology.orchestra.run.smithi050.stdout: mds bal split size = 100 2024-04-15T00:20:12.595 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug frag = True 2024-04-15T00:20:12.595 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug scatterstat = True 2024-04-15T00:20:12.595 INFO:teuthology.orchestra.run.smithi050.stdout: mds inject traceless reply probability = 0.5 2024-04-15T00:20:12.595 INFO:teuthology.orchestra.run.smithi050.stdout: mds op complaint time = 180 2024-04-15T00:20:12.596 INFO:teuthology.orchestra.run.smithi050.stdout: mds verify scatter = True 2024-04-15T00:20:12.596 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2024-04-15T00:20:12.596 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2024-04-15T00:20:12.596 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2024-04-15T00:20:12.597 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-15T00:20:12.597 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-15T00:20:12.692 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-15T00:20:12.692 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-15T00:20:12.692 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-15T00:20:12.706 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-15T00:20:12.707 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-15T00:20:12.762 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi031.front.sepia.ceph.com 2024-04-15T00:20:12.762 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-15T00:20:12.762 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-15T00:20:12.762 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-15T00:20:12.841 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-15T00:20:12.841 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-15T00:20:12.896 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi050.front.sepia.ceph.com 2024-04-15T00:20:12.896 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-15T00:20:12.896 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-15T00:20:12.896 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-15T00:20:12.941 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-15T00:20:12.942 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-15T00:20:12.999 INFO:tasks.ceph:Setting up mon nodes... 2024-04-15T00:20:13.000 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-15T00:20:13.000 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-15T00:20:13.055 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-15T00:20:13.057 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-15T00:20:13.134 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-15T00:20:13.137 INFO:tasks.ceph:Setting up mds nodes... 2024-04-15T00:20:13.137 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-15T00:20:13.192 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-15T00:20:13.194 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-15T00:20:13.221 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-15T00:20:13.279 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-15T00:20:13.281 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-15T00:20:13.309 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-15T00:20:13.310 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-15T00:20:13.352 INFO:teuthology.orchestra.run.smithi031.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-15T00:20:13.367 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-15T00:20:13.367 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-15T00:20:13.367 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-15T00:20:13.434 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-15T00:20:13.434 INFO:tasks.ceph:role: osd.0 2024-04-15T00:20:13.434 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com 2024-04-15T00:20:13.434 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-15T00:20:13.507 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-15T00:20:13.507 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-15T00:20:13.508 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-15T00:20:13.508 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-15T00:20:13.508 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-15T00:20:13.508 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2024-04-15T00:20:13.508 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-15T00:20:13.508 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-15T00:20:13.508 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-15T00:20:13.508 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-15T00:20:14.018 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2024-04-15T00:20:14.020 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2024-04-15T00:20:14.020 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-15T00:20:14.145 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-15T00:20:14.180 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-15T00:20:14.248 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-15T00:20:14.248 INFO:tasks.ceph:role: osd.1 2024-04-15T00:20:14.249 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi031.front.sepia.ceph.com 2024-04-15T00:20:14.249 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-15T00:20:14.324 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-15T00:20:14.324 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-15T00:20:14.324 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-15T00:20:14.324 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-15T00:20:14.324 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-15T00:20:14.324 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2024-04-15T00:20:14.324 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-15T00:20:14.324 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-15T00:20:14.324 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-15T00:20:14.324 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-15T00:20:14.787 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2024-04-15T00:20:14.789 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2024-04-15T00:20:14.789 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-15T00:20:14.882 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-15T00:20:14.915 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-15T00:20:14.983 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-15T00:20:14.983 INFO:tasks.ceph:role: osd.2 2024-04-15T00:20:14.983 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi031.front.sepia.ceph.com 2024-04-15T00:20:14.983 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-15T00:20:15.058 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-15T00:20:15.058 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-15T00:20:15.058 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-15T00:20:15.058 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-15T00:20:15.059 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-15T00:20:15.059 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2024-04-15T00:20:15.059 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-15T00:20:15.059 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-15T00:20:15.059 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-15T00:20:15.059 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-15T00:20:15.548 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2024-04-15T00:20:15.550 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2024-04-15T00:20:15.550 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-15T00:20:15.687 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-15T00:20:15.722 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-15T00:20:15.791 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-15T00:20:15.791 INFO:tasks.ceph:role: osd.3 2024-04-15T00:20:15.791 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi031.front.sepia.ceph.com 2024-04-15T00:20:15.791 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-15T00:20:15.866 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-15T00:20:15.866 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-15T00:20:15.866 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-15T00:20:15.866 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-15T00:20:15.866 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-15T00:20:15.866 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2024-04-15T00:20:15.866 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-15T00:20:15.866 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-15T00:20:15.866 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-15T00:20:15.867 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-15T00:20:16.386 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2024-04-15T00:20:16.388 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2024-04-15T00:20:16.388 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-15T00:20:16.521 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-15T00:20:16.559 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T00:20:16.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:16.654+0000 7f3190868640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-15T00:20:16.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:16.655+0000 7f3190868640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-15T00:20:16.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:16.655+0000 7f3190868640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-15T00:20:16.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:16.655+0000 7f3190868640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-15T00:20:16.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:16.655+0000 7f3190868640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-15T00:20:16.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:16.656+0000 7f3190868640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-15T00:20:19.524 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-15T00:20:19.555 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T00:20:19.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:19.640+0000 7f8a87938640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-15T00:20:19.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:19.640+0000 7f8a87938640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-15T00:20:19.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:19.640+0000 7f8a87938640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-15T00:20:19.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:19.640+0000 7f8a87938640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-15T00:20:19.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:19.640+0000 7f8a87938640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-15T00:20:19.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:19.641+0000 7f8a87938640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-15T00:20:22.493 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-15T00:20:22.525 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T00:20:22.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:22.609+0000 7f5e87538640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-15T00:20:22.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:22.610+0000 7f5e87538640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-15T00:20:22.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:22.610+0000 7f5e87538640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-15T00:20:22.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:22.610+0000 7f5e87538640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-15T00:20:22.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:22.610+0000 7f5e87538640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-15T00:20:22.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:22.610+0000 7f5e87538640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-15T00:20:25.471 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-15T00:20:25.504 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T00:20:25.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:25.589+0000 7fc250622640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-15T00:20:25.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:25.589+0000 7fc250622640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-15T00:20:25.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:25.589+0000 7fc250622640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-15T00:20:25.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:25.589+0000 7fc250622640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-15T00:20:25.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:25.589+0000 7fc250622640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-15T00:20:25.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:25.589+0000 7fc250622640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-15T00:20:28.463 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-15T00:20:28.494 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-15T00:20:28.527 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-15T00:20:28.527 INFO:tasks.ceph:role: osd.4 2024-04-15T00:20:28.527 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com 2024-04-15T00:20:28.527 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-15T00:20:28.598 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-15T00:20:28.599 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-15T00:20:28.599 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-15T00:20:28.599 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-15T00:20:28.599 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-15T00:20:28.599 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-04-15T00:20:28.600 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-15T00:20:28.600 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-15T00:20:28.600 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-15T00:20:28.600 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-15T00:20:28.632 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-04-15T00:20:28.634 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-04-15T00:20:28.634 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-15T00:20:28.713 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-15T00:20:28.786 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-15T00:20:28.854 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-15T00:20:28.854 INFO:tasks.ceph:role: osd.5 2024-04-15T00:20:28.854 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com 2024-04-15T00:20:28.854 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-15T00:20:28.920 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-15T00:20:28.920 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-15T00:20:28.920 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-15T00:20:28.921 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-15T00:20:28.921 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-15T00:20:28.921 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-04-15T00:20:28.921 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-15T00:20:28.921 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-15T00:20:28.921 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-15T00:20:28.921 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-15T00:20:28.952 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-04-15T00:20:28.954 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-04-15T00:20:28.954 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-15T00:20:29.025 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-15T00:20:29.095 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-15T00:20:29.164 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-15T00:20:29.164 INFO:tasks.ceph:role: osd.6 2024-04-15T00:20:29.164 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com 2024-04-15T00:20:29.164 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-15T00:20:29.233 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-15T00:20:29.233 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-15T00:20:29.233 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-15T00:20:29.233 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-15T00:20:29.233 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-15T00:20:29.233 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-04-15T00:20:29.233 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-15T00:20:29.233 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-15T00:20:29.233 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-15T00:20:29.233 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-15T00:20:29.265 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-04-15T00:20:29.267 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-04-15T00:20:29.267 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-15T00:20:29.338 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-15T00:20:29.410 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-15T00:20:29.477 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-15T00:20:29.478 INFO:tasks.ceph:role: osd.7 2024-04-15T00:20:29.478 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com 2024-04-15T00:20:29.478 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-15T00:20:29.544 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-15T00:20:29.544 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-15T00:20:29.544 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-15T00:20:29.544 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-15T00:20:29.544 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-15T00:20:29.544 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-04-15T00:20:29.544 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-15T00:20:29.545 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-15T00:20:29.545 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-15T00:20:29.545 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-15T00:20:29.576 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-04-15T00:20:29.578 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-04-15T00:20:29.578 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-15T00:20:29.654 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-15T00:20:29.725 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T00:20:29.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:29.815+0000 7f825f010640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-15T00:20:29.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:29.815+0000 7f825f010640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-15T00:20:29.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:29.815+0000 7f825f010640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-15T00:20:29.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:29.815+0000 7f825f010640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-15T00:20:29.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:29.815+0000 7f825f010640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-15T00:20:29.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:29.815+0000 7f825f010640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-15T00:20:32.668 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-15T00:20:32.700 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T00:20:32.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:32.784+0000 7fafb6a8b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-15T00:20:32.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:32.784+0000 7fafb6a8b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-15T00:20:32.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:32.784+0000 7fafb6a8b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-15T00:20:32.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:32.784+0000 7fafb6a8b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-15T00:20:32.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:32.784+0000 7fafb6a8b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-15T00:20:32.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:32.785+0000 7fafb6a8b640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-15T00:20:35.640 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-15T00:20:35.671 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T00:20:35.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:35.755+0000 7f71d2e1d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-15T00:20:35.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:35.755+0000 7f71d2e1d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-15T00:20:35.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:35.755+0000 7f71d2e1d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-15T00:20:35.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:35.755+0000 7f71d2e1d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-15T00:20:35.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:35.755+0000 7f71d2e1d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-15T00:20:35.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:35.755+0000 7f71d2e1d640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-15T00:20:38.604 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-15T00:20:38.635 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T00:20:38.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:38.720+0000 7f28b3c1f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-15T00:20:38.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:38.720+0000 7f28b3c1f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-15T00:20:38.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:38.720+0000 7f28b3c1f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-15T00:20:38.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:38.720+0000 7f28b3c1f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-15T00:20:38.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:38.720+0000 7f28b3c1f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-15T00:20:38.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:38.720+0000 7f28b3c1f640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-15T00:20:40.543 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:20:40.546 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:20:41.579 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-15T00:20:41.610 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-15T00:20:41.610 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-15T00:20:41.610 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-15T00:20:41.642 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-15T00:20:41.642 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-15T00:20:41.713 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-15T00:20:41.713 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-15T00:20:41.783 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-15T00:20:41.783 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-15T00:20:41.853 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-15T00:20:41.853 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-15T00:20:41.922 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-15T00:20:41.922 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-15T00:20:41.992 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-15T00:20:41.992 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-15T00:20:42.024 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-15T00:20:42.024 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-15T00:20:42.095 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-15T00:20:42.095 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-15T00:20:42.169 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-15T00:20:42.171 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-15T00:20:42.242 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-15T00:20:42.242 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-15T00:20:42.316 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-15T00:20:42.317 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-15T00:20:42.386 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-15T00:20:42.386 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-15T00:20:42.404 INFO:tasks.ceph:Adding keys to all mons... 2024-04-15T00:20:42.404 DEBUG:teuthology.orchestra.run.smithi031:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-15T00:20:42.447 DEBUG:teuthology.orchestra.run.smithi050:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-15T00:20:42.473 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.y] 2024-04-15T00:20:42.473 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQC9chxmgCvoAhAA4Zya9sChxUVElJsXtJjB1Q== 2024-04-15T00:20:42.473 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2024-04-15T00:20:42.473 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQC9chxmTp8VCxAADehJ6ElPmnMsnskh+lRj6g== 2024-04-15T00:20:42.474 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.0] 2024-04-15T00:20:42.474 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDAchxmWnoOJxAAHhrT3MZ6z0GkCNpSnPl1mg== 2024-04-15T00:20:42.474 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.1] 2024-04-15T00:20:42.474 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDDchxmkv46JhAA1LkxZPtMkE3OhtdI8dzgVQ== 2024-04-15T00:20:42.474 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.2] 2024-04-15T00:20:42.474 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDGchxm4SxqJBAA1ZF46xt3wSqOwvGlhytLkA== 2024-04-15T00:20:42.474 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.3] 2024-04-15T00:20:42.474 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDJchxmWwglIxAAwcHPA1Mle8OnsDxx/KDSjA== 2024-04-15T00:20:42.474 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.x] 2024-04-15T00:20:42.474 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQC9chxmIISrBxAAw/nJBFR4NAg8RJbENjtClg== 2024-04-15T00:20:42.474 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2024-04-15T00:20:42.474 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQC9chxmQ2NKEBAAQwL8aT5isMekAPi0Djh8yg== 2024-04-15T00:20:42.475 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.4] 2024-04-15T00:20:42.475 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDNchxm/KKnMBAA3rz1tU2ZAguFMdi+2JsZ3w== 2024-04-15T00:20:42.475 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.5] 2024-04-15T00:20:42.475 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDQchxmQA7SLhAAnTAqVPBFtzhbCnQOr/JOsg== 2024-04-15T00:20:42.475 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.6] 2024-04-15T00:20:42.475 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDTchxmj5ARLRAAGI3D8gtoydlsjEgPXvm0lA== 2024-04-15T00:20:42.475 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.7] 2024-04-15T00:20:42.475 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDWchxmoTT8KhAACOJ2Uge+9AnbdJNwnNBT4w== 2024-04-15T00:20:42.475 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2024-04-15T00:20:42.475 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQC9chxmNDigFBAAKQCBxUw9g94DrgDVwGr0/w== 2024-04-15T00:20:42.476 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.y] 2024-04-15T00:20:42.477 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQC9chxmgCvoAhAA4Zya9sChxUVElJsXtJjB1Q== 2024-04-15T00:20:42.477 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2024-04-15T00:20:42.477 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQC9chxmTp8VCxAADehJ6ElPmnMsnskh+lRj6g== 2024-04-15T00:20:42.477 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.0] 2024-04-15T00:20:42.477 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDAchxmWnoOJxAAHhrT3MZ6z0GkCNpSnPl1mg== 2024-04-15T00:20:42.477 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.1] 2024-04-15T00:20:42.477 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDDchxmkv46JhAA1LkxZPtMkE3OhtdI8dzgVQ== 2024-04-15T00:20:42.477 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.2] 2024-04-15T00:20:42.477 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDGchxm4SxqJBAA1ZF46xt3wSqOwvGlhytLkA== 2024-04-15T00:20:42.477 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.3] 2024-04-15T00:20:42.477 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDJchxmWwglIxAAwcHPA1Mle8OnsDxx/KDSjA== 2024-04-15T00:20:42.477 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.x] 2024-04-15T00:20:42.477 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQC9chxmIISrBxAAw/nJBFR4NAg8RJbENjtClg== 2024-04-15T00:20:42.477 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2024-04-15T00:20:42.478 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQC9chxmQ2NKEBAAQwL8aT5isMekAPi0Djh8yg== 2024-04-15T00:20:42.478 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.4] 2024-04-15T00:20:42.478 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDNchxm/KKnMBAA3rz1tU2ZAguFMdi+2JsZ3w== 2024-04-15T00:20:42.478 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.5] 2024-04-15T00:20:42.478 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDQchxmQA7SLhAAnTAqVPBFtzhbCnQOr/JOsg== 2024-04-15T00:20:42.478 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.6] 2024-04-15T00:20:42.478 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDTchxmj5ARLRAAGI3D8gtoydlsjEgPXvm0lA== 2024-04-15T00:20:42.478 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.7] 2024-04-15T00:20:42.478 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDWchxmoTT8KhAACOJ2Uge+9AnbdJNwnNBT4w== 2024-04-15T00:20:42.478 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2024-04-15T00:20:42.478 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQC9chxmNDigFBAAKQCBxUw9g94DrgDVwGr0/w== 2024-04-15T00:20:42.478 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-15T00:20:42.520 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-15T00:20:42.576 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-15T00:20:42.578 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-15T00:20:42.634 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:20:42.637 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:20:42.689 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:20:42.691 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:20:42.743 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:20:42.745 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:20:42.796 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:20:42.798 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:20:42.850 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-15T00:20:42.852 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-15T00:20:42.903 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-15T00:20:42.905 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-15T00:20:42.959 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:20:42.961 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:20:43.012 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:20:43.014 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:20:43.066 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:20:43.068 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:20:43.120 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:20:43.122 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:20:43.173 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-15T00:20:43.175 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-15T00:20:43.230 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-15T00:20:43.230 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-15T00:20:43.256 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-15T00:20:43.352 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-15T00:20:43.379 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-15T00:20:43.406 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-15T00:20:43.503 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-15T00:20:43.530 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-15T00:20:43.598 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-15T00:20:43.694 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-15T00:20:43.721 DEBUG:teuthology.orchestra.run.smithi031:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-15T00:20:43.724 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-15T00:20:43.776 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-15T00:20:43.776 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-15T00:20:43.776 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-15T00:20:43.780 INFO:tasks.ceph.mon.a:Started 2024-04-15T00:20:43.780 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-15T00:20:43.780 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-15T00:20:43.818 INFO:tasks.ceph.mon.b:Started 2024-04-15T00:20:43.818 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-15T00:20:43.818 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-15T00:20:43.820 INFO:tasks.ceph.mon.c:Started 2024-04-15T00:20:43.820 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-15T00:20:43.820 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-15T00:20:43.821 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-15T00:20:43.823 INFO:tasks.ceph.mgr.y:Started 2024-04-15T00:20:43.823 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-15T00:20:43.823 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-15T00:20:43.825 INFO:tasks.ceph.mgr.x:Started 2024-04-15T00:20:43.825 INFO:tasks.ceph:Setting crush tunables to default 2024-04-15T00:20:43.825 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd crush tunables default 2024-04-15T00:20:43.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:43.922+0000 7f9eaadfe640 1 Processor -- start 2024-04-15T00:20:43.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:43.922+0000 7f9eaadfe640 1 -- start start 2024-04-15T00:20:43.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:43.923+0000 7f9eaadfe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9ea40baf60 0x7f9ea414aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:43.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:43.923+0000 7f9eaadfe640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ea4141c30 0x7f9ea414b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:43.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:43.923+0000 7f9eaadfe640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ea409b380 con 0x7f9ea409c4a0 2024-04-15T00:20:43.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:43.923+0000 7f9eaadfe640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f9ea409b660 con 0x7f9ea40baf60 2024-04-15T00:20:43.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:43.923+0000 7f9eaadfe640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea409b940 con 0x7f9ea4141c30 2024-04-15T00:20:43.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:43.923+0000 7f9ea8b9a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9ea40baf60 0x7f9ea414aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:43.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:43.923+0000 7f9ea8b9a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9ea40baf60 0x7f9ea414aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.31:33982/0 (socket says 172.21.15.31:33982) 2024-04-15T00:20:43.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:43.923+0000 7f9ea8b9a640 1 -- 172.21.15.31:0/1168733911 learned_addr learned my addr 172.21.15.31:0/1168733911 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:20:43.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:43.923+0000 7f9ea3fff640 1 --1- 172.21.15.31:0/1168733911 >> v1:172.21.15.50:6789/0 conn(0x7f9ea409c4a0 0x7f9ea4141520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.31:53908/0 (socket says 172.21.15.31:53908) 2024-04-15T00:20:43.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:43.923+0000 7f9ea939b640 1 --2- 172.21.15.31:0/1168733911 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ea4141c30 0x7f9ea414b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:43.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:43.923+0000 7f9ea8b9a640 1 -- 172.21.15.31:0/1168733911 >> v2:172.21.15.50:3300/0 conn(0x7f9ea40baf60 msgr2=0x7f9ea414aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-15T00:20:43.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:43.923+0000 7f9ea8b9a640 1 -- 172.21.15.31:0/1168733911 >> v2:172.21.15.50:3300/0 conn(0x7f9ea40baf60 msgr2=0x7f9ea414aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-15T00:20:43.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:43.923+0000 7f9ea8b9a640 1 --2- 172.21.15.31:0/1168733911 >> v2:172.21.15.50:3300/0 conn(0x7f9ea40baf60 0x7f9ea414aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-15T00:20:43.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:43.924+0000 7f9ea8b9a640 1 --2- 172.21.15.31:0/1168733911 >> v2:172.21.15.50:3300/0 conn(0x7f9ea40baf60 0x7f9ea414aef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-15T00:20:43.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:43.924+0000 7f9ea939b640 1 -- 172.21.15.31:0/1168733911 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ea4141c30 msgr2=0x7f9ea414b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-15T00:20:43.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:43.924+0000 7f9ea939b640 1 -- 172.21.15.31:0/1168733911 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ea4141c30 msgr2=0x7f9ea414b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-15T00:20:43.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:43.924+0000 7f9ea939b640 1 --2- 172.21.15.31:0/1168733911 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ea4141c30 0x7f9ea414b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-15T00:20:43.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:43.924+0000 7f9ea939b640 1 --2- 172.21.15.31:0/1168733911 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ea4141c30 0x7f9ea414b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-15T00:20:44.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.080+0000 7f9ea37fe640 1 -- 172.21.15.31:0/1168733911 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1206396113 0 0) 0x7f9ea409b380 con 0x7f9ea409c4a0 2024-04-15T00:20:44.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.080+0000 7f9ea37fe640 1 -- 172.21.15.31:0/1168733911 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e8c003520 con 0x7f9ea409c4a0 2024-04-15T00:20:44.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.080+0000 7f9ea37fe640 1 -- 172.21.15.31:0/1168733911 <== mon.1 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1444394567 0 0) 0x7f9e8c003520 con 0x7f9ea409c4a0 2024-04-15T00:20:44.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.080+0000 7f9ea37fe640 1 -- 172.21.15.31:0/1168733911 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ea4141c30 msgr2=0x7f9ea414b430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-15T00:20:44.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.080+0000 7f9ea37fe640 1 --2- 172.21.15.31:0/1168733911 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ea4141c30 0x7f9ea414b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:44.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.080+0000 7f9ea37fe640 1 -- 172.21.15.31:0/1168733911 >> v2:172.21.15.50:3300/0 conn(0x7f9ea40baf60 msgr2=0x7f9ea414aef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-15T00:20:44.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.080+0000 7f9ea37fe640 1 --2- 172.21.15.31:0/1168733911 >> v2:172.21.15.50:3300/0 conn(0x7f9ea40baf60 0x7f9ea414aef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:44.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.080+0000 7f9ea37fe640 1 -- 172.21.15.31:0/1168733911 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea409c040 con 0x7f9ea409c4a0 2024-04-15T00:20:44.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.080+0000 7f9ea37fe640 1 -- 172.21.15.31:0/1168733911 <== mon.1 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 697057150 0 0) 0x7f9e98001670 con 0x7f9ea409c4a0 2024-04-15T00:20:44.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.080+0000 7f9ea37fe640 1 -- 172.21.15.31:0/1168733911 >> v1:172.21.15.50:6789/0 conn(0x7f9ea409c4a0 legacy=0x7f9ea4141520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:44.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.081+0000 7f9ea37fe640 1 --2- 172.21.15.31:0/1168733911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e8c0039b0 0x7f9e8c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:44.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.081+0000 7f9ea37fe640 1 --2- 172.21.15.31:0/1168733911 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ea4141c30 0x7f9e8c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:44.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.081+0000 7f9ea37fe640 1 --2- 172.21.15.31:0/1168733911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e8c004d40 0x7f9e8c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:44.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.081+0000 7f9ea37fe640 1 -- 172.21.15.31:0/1168733911 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea409b660 con 0x7f9e8c0039b0 2024-04-15T00:20:44.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.081+0000 7f9ea37fe640 1 -- 172.21.15.31:0/1168733911 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea409b940 con 0x7f9e8c004d40 2024-04-15T00:20:44.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.081+0000 7f9ea37fe640 1 -- 172.21.15.31:0/1168733911 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f9e8c00bbd0 con 0x7f9ea4141c30 2024-04-15T00:20:44.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.081+0000 7f9ea8b9a640 1 --2- 172.21.15.31:0/1168733911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e8c0039b0 0x7f9e8c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:44.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.081+0000 7f9ea939b640 1 --2- 172.21.15.31:0/1168733911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e8c004d40 0x7f9e8c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:44.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.081+0000 7f9ea3fff640 1 --2- 172.21.15.31:0/1168733911 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ea4141c30 0x7f9e8c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:44.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.081+0000 7f9ea8b9a640 1 -- 172.21.15.31:0/1168733911 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ea4141c30 msgr2=0x7f9e8c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:20:44.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.081+0000 7f9ea8b9a640 1 --2- 172.21.15.31:0/1168733911 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ea4141c30 0x7f9e8c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:44.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.081+0000 7f9ea8b9a640 1 -- 172.21.15.31:0/1168733911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e8c004d40 msgr2=0x7f9e8c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:20:44.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.081+0000 7f9ea8b9a640 1 --2- 172.21.15.31:0/1168733911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e8c004d40 0x7f9e8c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:44.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.081+0000 7f9ea8b9a640 1 -- 172.21.15.31:0/1168733911 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8c003520 con 0x7f9e8c0039b0 2024-04-15T00:20:44.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.081+0000 7f9ea939b640 1 --2- 172.21.15.31:0/1168733911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e8c004d40 0x7f9e8c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:20:44.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.082+0000 7f9ea8b9a640 1 --2- 172.21.15.31:0/1168733911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e8c0039b0 0x7f9e8c003dd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9e94009890 tx=0x7f9e8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644ae7d4524a2e66 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:20:44.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.082+0000 7f9ea37fe640 1 -- 172.21.15.31:0/1168733911 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e94034070 con 0x7f9e8c0039b0 2024-04-15T00:20:44.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.082+0000 7f9ea37fe640 1 -- 172.21.15.31:0/1168733911 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e94030680 con 0x7f9e8c0039b0 2024-04-15T00:20:44.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.082+0000 7f9ea37fe640 1 -- 172.21.15.31:0/1168733911 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9400f040 con 0x7f9e8c0039b0 2024-04-15T00:20:44.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.083+0000 7f9eaadfe640 1 -- 172.21.15.31:0/1168733911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e8c0039b0 msgr2=0x7f9e8c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:44.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.083+0000 7f9eaadfe640 1 --2- 172.21.15.31:0/1168733911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e8c0039b0 0x7f9e8c003dd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9e94009890 tx=0x7f9e8c005830 comp rx=0 tx=0).stop 2024-04-15T00:20:44.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.083+0000 7f9ea939b640 1 -- 172.21.15.31:0/1168733911 reap_dead start 2024-04-15T00:20:44.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.083+0000 7f9eaadfe640 1 -- 172.21.15.31:0/1168733911 shutdown_connections 2024-04-15T00:20:44.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.083+0000 7f9eaadfe640 1 -- 172.21.15.31:0/1168733911 >> 172.21.15.31:0/1168733911 conn(0x7f9ea409eb20 msgr2=0x7f9ea409ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:20:44.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.083+0000 7f9eaadfe640 1 -- 172.21.15.31:0/1168733911 shutdown_connections 2024-04-15T00:20:44.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.083+0000 7f9eaadfe640 1 -- 172.21.15.31:0/1168733911 wait complete. 2024-04-15T00:20:44.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.084+0000 7f9eaadfe640 1 Processor -- start 2024-04-15T00:20:44.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.084+0000 7f9eaadfe640 1 -- start start 2024-04-15T00:20:44.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.085+0000 7f9eaadfe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e8c0039b0 0x7f9ea40b3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:44.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.085+0000 7f9eaadfe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ea4140500 0x7f9ea413d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:44.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.085+0000 7f9eaadfe640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ea413da20 0x7f9ea409d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:44.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.085+0000 7f9eaadfe640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea409b010 con 0x7f9ea4140500 2024-04-15T00:20:44.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.085+0000 7f9eaadfe640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea40bb340 con 0x7f9e8c0039b0 2024-04-15T00:20:44.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.085+0000 7f9eaadfe640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea414b430 con 0x7f9ea413da20 2024-04-15T00:20:44.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.085+0000 7f9ea3fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ea4140500 0x7f9ea413d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:44.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.085+0000 7f9ea3fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ea4140500 0x7f9ea413d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52610/0 (socket says 172.21.15.31:52610) 2024-04-15T00:20:44.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.085+0000 7f9ea3fff640 1 -- 172.21.15.31:0/1772453702 learned_addr learned my addr 172.21.15.31:0/1772453702 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:20:44.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.085+0000 7f9ea939b640 1 --2- 172.21.15.31:0/1772453702 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ea413da20 0x7f9ea409d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:44.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.085+0000 7f9ea8b9a640 1 --2- 172.21.15.31:0/1772453702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e8c0039b0 0x7f9ea40b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:44.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.086+0000 7f9ea3fff640 1 -- 172.21.15.31:0/1772453702 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ea413da20 msgr2=0x7f9ea409d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:44.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.086+0000 7f9ea3fff640 1 --2- 172.21.15.31:0/1772453702 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ea413da20 0x7f9ea409d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:44.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.086+0000 7f9ea3fff640 1 -- 172.21.15.31:0/1772453702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e8c0039b0 msgr2=0x7f9ea40b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:44.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.086+0000 7f9ea3fff640 1 --2- 172.21.15.31:0/1772453702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e8c0039b0 0x7f9ea40b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:44.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.086+0000 7f9ea3fff640 1 -- 172.21.15.31:0/1772453702 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea409e830 con 0x7f9ea4140500 2024-04-15T00:20:44.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.086+0000 7f9ea3fff640 1 --2- 172.21.15.31:0/1772453702 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ea4140500 0x7f9ea413d4e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9e98001b80 tx=0x7f9e9800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:20:44.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.086+0000 7f9ea17fa640 1 -- 172.21.15.31:0/1772453702 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9800c8d0 con 0x7f9ea4140500 2024-04-15T00:20:44.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.086+0000 7f9ea17fa640 1 -- 172.21.15.31:0/1772453702 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e98018070 con 0x7f9ea4140500 2024-04-15T00:20:44.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.086+0000 7f9eaadfe640 1 -- 172.21.15.31:0/1772453702 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ea4140cf0 con 0x7f9ea4140500 2024-04-15T00:20:44.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.086+0000 7f9ea17fa640 1 -- 172.21.15.31:0/1772453702 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9800ccb0 con 0x7f9ea4140500 2024-04-15T00:20:44.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.086+0000 7f9eaadfe640 1 -- 172.21.15.31:0/1772453702 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ea40b3800 con 0x7f9ea4140500 2024-04-15T00:20:44.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.086+0000 7f9ea17fa640 1 -- 172.21.15.31:0/1772453702 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9e980137b0 con 0x7f9ea4140500 2024-04-15T00:20:44.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.086+0000 7f9ea17fa640 1 -- 172.21.15.31:0/1772453702 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9e9801c960 con 0x7f9ea4140500 2024-04-15T00:20:44.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.087+0000 7f9eaadfe640 1 -- 172.21.15.31:0/1772453702 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ea4140f10 con 0x7f9ea4140500 2024-04-15T00:20:44.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.089+0000 7f9ea17fa640 1 -- 172.21.15.31:0/1772453702 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f9e9801c410 con 0x7f9ea4140500 2024-04-15T00:20:44.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.156+0000 7f9eaadfe640 1 -- 172.21.15.31:0/1772453702 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f9ea404f540 con 0x7f9ea4140500 2024-04-15T00:20:44.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.158+0000 7f9ea17fa640 1 -- 172.21.15.31:0/1772453702 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f9e98013c80 con 0x7f9ea4140500 2024-04-15T00:20:44.166 INFO:teuthology.orchestra.run.smithi031.stderr:adjusted tunables profile to default 2024-04-15T00:20:44.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.159+0000 7f9eaadfe640 1 -- 172.21.15.31:0/1772453702 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ea4140500 msgr2=0x7f9ea413d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:44.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.159+0000 7f9eaadfe640 1 --2- 172.21.15.31:0/1772453702 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ea4140500 0x7f9ea413d4e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9e98001b80 tx=0x7f9e9800ec90 comp rx=0 tx=0).stop 2024-04-15T00:20:44.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.159+0000 7f9eaadfe640 1 -- 172.21.15.31:0/1772453702 shutdown_connections 2024-04-15T00:20:44.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.159+0000 7f9eaadfe640 1 --2- 172.21.15.31:0/1772453702 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ea413da20 0x7f9ea409d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:44.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.159+0000 7f9eaadfe640 1 --2- 172.21.15.31:0/1772453702 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ea4140500 0x7f9ea413d4e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:44.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.159+0000 7f9eaadfe640 1 --2- 172.21.15.31:0/1772453702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e8c0039b0 0x7f9ea40b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:44.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.159+0000 7f9eaadfe640 1 -- 172.21.15.31:0/1772453702 >> 172.21.15.31:0/1772453702 conn(0x7f9ea409eb20 msgr2=0x7f9ea40bcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:20:44.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.159+0000 7f9eaadfe640 1 -- 172.21.15.31:0/1772453702 shutdown_connections 2024-04-15T00:20:44.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:44.159+0000 7f9eaadfe640 1 -- 172.21.15.31:0/1772453702 wait complete. 2024-04-15T00:20:44.178 INFO:tasks.ceph:check_enable_crimson: False 2024-04-15T00:20:44.178 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-15T00:20:44.179 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-15T00:20:44.179 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-15T00:20:44.205 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-15T00:20:44.206 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-15T00:20:44.272 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-15T00:20:44.272 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-15T00:20:44.339 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-15T00:20:44.339 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-15T00:20:44.407 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-15T00:20:44.407 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-15T00:20:44.434 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-15T00:20:44.434 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-15T00:20:44.501 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-15T00:20:44.501 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-15T00:20:44.568 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-04-15T00:20:44.568 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-15T00:20:44.569 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-04-15T00:20:44.561+0000 7f544403e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-15T00:20:44.580 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-15T00:20:44.573+0000 7fb73ec11040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-15T00:20:44.594 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new b085a2f4-5565-4ccc-a98e-e56180791550 0 2024-04-15T00:20:44.627 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-04-15T00:20:44.620+0000 7f544403e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-15T00:20:44.636 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-15T00:20:44.629+0000 7fb73ec11040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-15T00:20:44.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.720+0000 7fee7b38c640 1 Processor -- start 2024-04-15T00:20:44.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.720+0000 7fee7b38c640 1 -- start start 2024-04-15T00:20:44.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.721+0000 7fee7b38c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fee740726d0 0x7fee7409f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:44.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.721+0000 7fee7b38c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fee7406ee00 0x7fee741415c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:44.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.721+0000 7fee7b38c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee740a02f0 con 0x7fee74141b00 2024-04-15T00:20:44.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.721+0000 7fee7b38c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fee7409fe30 con 0x7fee740726d0 2024-04-15T00:20:44.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.721+0000 7fee7b38c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fee74072ab0 con 0x7fee7406ee00 2024-04-15T00:20:44.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.721+0000 7fee78927640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fee7406ee00 0x7fee741415c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:44.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.721+0000 7fee79929640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fee74141b00 0x7fee7414b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35826/0 (socket says 172.21.15.50:35826) 2024-04-15T00:20:44.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.721+0000 7fee79929640 1 -- 172.21.15.50:0/1546479881 learned_addr learned my addr 172.21.15.50:0/1546479881 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-15T00:20:44.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.721+0000 7fee79128640 1 --2- 172.21.15.50:0/1546479881 >> v2:172.21.15.31:3300/0 conn(0x7fee740726d0 0x7fee7409f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:44.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.721+0000 7fee78927640 1 -- 172.21.15.50:0/1546479881 >> v2:172.21.15.31:3300/0 conn(0x7fee740726d0 msgr2=0x7fee7409f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:20:44.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.721+0000 7fee78927640 1 --2- 172.21.15.50:0/1546479881 >> v2:172.21.15.31:3300/0 conn(0x7fee740726d0 0x7fee7409f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:44.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.721+0000 7fee78927640 1 -- 172.21.15.50:0/1546479881 >> v1:172.21.15.50:6789/0 conn(0x7fee74141b00 legacy=0x7fee7414b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:44.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.721+0000 7fee6bfff640 1 -- 172.21.15.50:0/1546479881 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2729975637 0 0) 0x7fee740a02f0 con 0x7fee74141b00 2024-04-15T00:20:44.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.721+0000 7fee78927640 1 -- 172.21.15.50:0/1546479881 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee7409ee10 con 0x7fee7406ee00 2024-04-15T00:20:44.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.722+0000 7fee78927640 1 --2- 172.21.15.50:0/1546479881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee7406ee00 0x7fee741415c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fee740731f0 tx=0x7fee7002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59d69a95c924d41c server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:20:44.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.722+0000 7fee6bfff640 1 -- 172.21.15.50:0/1546479881 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee70035020 con 0x7fee7406ee00 2024-04-15T00:20:44.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.722+0000 7fee6bfff640 1 -- 172.21.15.50:0/1546479881 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee70031830 con 0x7fee7406ee00 2024-04-15T00:20:44.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.722+0000 7fee6bfff640 1 -- 172.21.15.50:0/1546479881 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee70031c00 con 0x7fee7406ee00 2024-04-15T00:20:44.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.723+0000 7fee7b38c640 1 -- 172.21.15.50:0/1546479881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee7406ee00 msgr2=0x7fee741415c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:44.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.723+0000 7fee7b38c640 1 --2- 172.21.15.50:0/1546479881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee7406ee00 0x7fee741415c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fee740731f0 tx=0x7fee7002b8d0 comp rx=0 tx=0).stop 2024-04-15T00:20:44.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.723+0000 7fee7b38c640 1 -- 172.21.15.50:0/1546479881 shutdown_connections 2024-04-15T00:20:44.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.723+0000 7fee7b38c640 1 --2- 172.21.15.50:0/1546479881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee7406ee00 0x7fee741415c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:44.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.723+0000 7fee7b38c640 1 --2- 172.21.15.50:0/1546479881 >> v2:172.21.15.31:3300/0 conn(0x7fee740726d0 0x7fee7409f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:44.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.723+0000 7fee7b38c640 1 -- 172.21.15.50:0/1546479881 >> 172.21.15.50:0/1546479881 conn(0x7fee740bad20 msgr2=0x7fee740bb130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:20:44.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.723+0000 7fee7b38c640 1 -- 172.21.15.50:0/1546479881 shutdown_connections 2024-04-15T00:20:44.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.723+0000 7fee7b38c640 1 -- 172.21.15.50:0/1546479881 wait complete. 2024-04-15T00:20:44.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.724+0000 7fee7b38c640 1 Processor -- start 2024-04-15T00:20:44.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.724+0000 7fee7b38c640 1 -- start start 2024-04-15T00:20:44.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.724+0000 7fee7b38c640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fee7406ee00 0x7fee7413e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:44.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.724+0000 7fee7b38c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee740726d0 0x7fee741dcd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:44.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.724+0000 7fee7b38c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee74141b00 0x7fee741e02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:44.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.724+0000 7fee7b38c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fee7414b7f0 con 0x7fee74141b00 2024-04-15T00:20:44.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.724+0000 7fee7b38c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fee7409f3d0 con 0x7fee740726d0 2024-04-15T00:20:44.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.724+0000 7fee7b38c640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fee7414b970 con 0x7fee7406ee00 2024-04-15T00:20:44.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.725+0000 7fee79128640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fee7406ee00 0x7fee7413e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:44.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.725+0000 7fee78927640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee740726d0 0x7fee741dcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:44.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.725+0000 7fee79128640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fee7406ee00 0x7fee7413e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:51948/0 (socket says 172.21.15.50:51948) 2024-04-15T00:20:44.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.725+0000 7fee79128640 1 -- 172.21.15.50:0/977381842 learned_addr learned my addr 172.21.15.50:0/977381842 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-15T00:20:44.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.725+0000 7fee79929640 1 --2- 172.21.15.50:0/977381842 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee74141b00 0x7fee741e02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:44.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.725+0000 7fee78927640 1 -- 172.21.15.50:0/977381842 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fee7406ee00 msgr2=0x7fee7413e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:44.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.725+0000 7fee78927640 1 --2- 172.21.15.50:0/977381842 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fee7406ee00 0x7fee7413e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:44.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.725+0000 7fee78927640 1 -- 172.21.15.50:0/977381842 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee74141b00 msgr2=0x7fee741e02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:44.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.725+0000 7fee78927640 1 --2- 172.21.15.50:0/977381842 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee74141b00 0x7fee741e02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:44.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.725+0000 7fee78927640 1 -- 172.21.15.50:0/977381842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee7414a590 con 0x7fee740726d0 2024-04-15T00:20:44.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.725+0000 7fee78927640 1 --2- 172.21.15.50:0/977381842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee740726d0 0x7fee741dcd60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fee70033000 tx=0x7fee700046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:20:44.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.725+0000 7fee69ffb640 1 -- 172.21.15.50:0/977381842 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee70041070 con 0x7fee740726d0 2024-04-15T00:20:44.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.725+0000 7fee69ffb640 1 -- 172.21.15.50:0/977381842 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee7003f070 con 0x7fee740726d0 2024-04-15T00:20:44.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.725+0000 7fee7b38c640 1 -- 172.21.15.50:0/977381842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee74149af0 con 0x7fee740726d0 2024-04-15T00:20:44.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.725+0000 7fee69ffb640 1 -- 172.21.15.50:0/977381842 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee70035040 con 0x7fee740726d0 2024-04-15T00:20:44.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.725+0000 7fee7b38c640 1 -- 172.21.15.50:0/977381842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee7414a070 con 0x7fee740726d0 2024-04-15T00:20:44.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.726+0000 7fee69ffb640 1 -- 172.21.15.50:0/977381842 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fee70038020 con 0x7fee740726d0 2024-04-15T00:20:44.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.726+0000 7fee69ffb640 1 -- 172.21.15.50:0/977381842 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fee700468c0 con 0x7fee740726d0 2024-04-15T00:20:44.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.727+0000 7fee7b38c640 1 -- 172.21.15.50:0/977381842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee7404f540 con 0x7fee740726d0 2024-04-15T00:20:44.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.729+0000 7fee69ffb640 1 -- 172.21.15.50:0/977381842 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fee70054020 con 0x7fee740726d0 2024-04-15T00:20:44.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.817+0000 7fee7b38c640 1 -- 172.21.15.50:0/977381842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b085a2f4-5565-4ccc-a98e-e56180791550", "id": 0} v 0) -- 0x7fee7414a240 con 0x7fee740726d0 2024-04-15T00:20:44.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.820+0000 7fee69ffb640 1 -- 172.21.15.50:0/977381842 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b085a2f4-5565-4ccc-a98e-e56180791550", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fee70031800 con 0x7fee740726d0 2024-04-15T00:20:44.827 INFO:teuthology.orchestra.run.smithi050.stdout:0 2024-04-15T00:20:44.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.821+0000 7fee7b38c640 1 -- 172.21.15.50:0/977381842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee740726d0 msgr2=0x7fee741dcd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:44.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.821+0000 7fee7b38c640 1 --2- 172.21.15.50:0/977381842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee740726d0 0x7fee741dcd60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fee70033000 tx=0x7fee700046c0 comp rx=0 tx=0).stop 2024-04-15T00:20:44.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.821+0000 7fee7b38c640 1 -- 172.21.15.50:0/977381842 shutdown_connections 2024-04-15T00:20:44.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.821+0000 7fee7b38c640 1 --2- 172.21.15.50:0/977381842 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee74141b00 0x7fee741e02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:44.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.821+0000 7fee7b38c640 1 --2- 172.21.15.50:0/977381842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee740726d0 0x7fee741dcd60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:44.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.821+0000 7fee7b38c640 1 --2- 172.21.15.50:0/977381842 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fee7406ee00 0x7fee7413e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:44.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.821+0000 7fee7b38c640 1 -- 172.21.15.50:0/977381842 >> 172.21.15.50:0/977381842 conn(0x7fee740bad20 msgr2=0x7fee74071ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:20:44.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.821+0000 7fee7b38c640 1 -- 172.21.15.50:0/977381842 shutdown_connections 2024-04-15T00:20:44.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.821+0000 7fee7b38c640 1 -- 172.21.15.50:0/977381842 wait complete. 2024-04-15T00:20:44.839 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 0f751557-3f18-464f-8b78-614d19549f0f 1 2024-04-15T00:20:44.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.932+0000 7f6fb6bbb640 1 Processor -- start 2024-04-15T00:20:44.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.932+0000 7f6fb6bbb640 1 -- start start 2024-04-15T00:20:44.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.933+0000 7f6fb6bbb640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6fb0067180 0x7f6fb0067820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:44.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.933+0000 7f6fb6bbb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6fb014ac80 0x7f6fb014b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:44.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.933+0000 7f6fb6bbb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fb0067560 con 0x7f6fb0141000 2024-04-15T00:20:44.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.933+0000 7f6fb6bbb640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f6fb0070990 con 0x7f6fb0067180 2024-04-15T00:20:44.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.933+0000 7f6fb6bbb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f6fb0070500 con 0x7f6fb014ac80 2024-04-15T00:20:44.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.933+0000 7f6faffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6fb014ac80 0x7f6fb014b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:44.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.933+0000 7f6faffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6fb014ac80 0x7f6fb014b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44752/0 (socket says 172.21.15.50:44752) 2024-04-15T00:20:44.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.933+0000 7f6faffff640 1 -- 172.21.15.50:0/4205763087 learned_addr learned my addr 172.21.15.50:0/4205763087 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-15T00:20:44.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.933+0000 7f6fb5158640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6fb0141000 0x7f6fb0141450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35830/0 (socket says 172.21.15.50:35830) 2024-04-15T00:20:44.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.933+0000 7f6fb4957640 1 --2- 172.21.15.50:0/4205763087 >> v2:172.21.15.31:3300/0 conn(0x7f6fb0067180 0x7f6fb0067820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:44.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.933+0000 7f6faffff640 1 -- 172.21.15.50:0/4205763087 >> v2:172.21.15.31:3300/0 conn(0x7f6fb0067180 msgr2=0x7f6fb0067820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:20:44.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.933+0000 7f6faffff640 1 --2- 172.21.15.50:0/4205763087 >> v2:172.21.15.31:3300/0 conn(0x7f6fb0067180 0x7f6fb0067820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:44.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.933+0000 7f6faffff640 1 -- 172.21.15.50:0/4205763087 >> v1:172.21.15.50:6789/0 conn(0x7f6fb0141000 legacy=0x7f6fb0141450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:44.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.933+0000 7f6faf7fe640 1 -- 172.21.15.50:0/4205763087 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2036946574 0 0) 0x7f6fb0067560 con 0x7f6fb0141000 2024-04-15T00:20:44.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.933+0000 7f6faffff640 1 -- 172.21.15.50:0/4205763087 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb0067d90 con 0x7f6fb014ac80 2024-04-15T00:20:44.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.934+0000 7f6faffff640 1 --2- 172.21.15.50:0/4205763087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fb014ac80 0x7f6fb014b0c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0070680 tx=0x7f6f9c02b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a2b8c5f396c8323 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:20:44.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.934+0000 7f6faf7fe640 1 -- 172.21.15.50:0/4205763087 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c035020 con 0x7f6fb014ac80 2024-04-15T00:20:44.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.934+0000 7f6faf7fe640 1 -- 172.21.15.50:0/4205763087 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f9c031870 con 0x7f6fb014ac80 2024-04-15T00:20:44.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.934+0000 7f6faf7fe640 1 -- 172.21.15.50:0/4205763087 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c031c40 con 0x7f6fb014ac80 2024-04-15T00:20:44.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.935+0000 7f6fb6bbb640 1 -- 172.21.15.50:0/4205763087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fb014ac80 msgr2=0x7f6fb014b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:44.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.935+0000 7f6fb6bbb640 1 --2- 172.21.15.50:0/4205763087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fb014ac80 0x7f6fb014b0c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0070680 tx=0x7f6f9c02b910 comp rx=0 tx=0).stop 2024-04-15T00:20:44.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.935+0000 7f6fb6bbb640 1 -- 172.21.15.50:0/4205763087 shutdown_connections 2024-04-15T00:20:44.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.935+0000 7f6fb6bbb640 1 --2- 172.21.15.50:0/4205763087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fb014ac80 0x7f6fb014b0c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.935+0000 7f6fb6bbb640 1 --2- 172.21.15.50:0/4205763087 >> v2:172.21.15.31:3300/0 conn(0x7f6fb0067180 0x7f6fb0067820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.935+0000 7f6fb6bbb640 1 -- 172.21.15.50:0/4205763087 >> 172.21.15.50:0/4205763087 conn(0x7f6fb006b200 msgr2=0x7f6fb006b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:20:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.935+0000 7f6fb6bbb640 1 -- 172.21.15.50:0/4205763087 shutdown_connections 2024-04-15T00:20:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.935+0000 7f6fb6bbb640 1 -- 172.21.15.50:0/4205763087 wait complete. 2024-04-15T00:20:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.936+0000 7f6fb6bbb640 1 Processor -- start 2024-04-15T00:20:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.936+0000 7f6fb6bbb640 1 -- start start 2024-04-15T00:20:44.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.937+0000 7f6fb6bbb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fb0067180 0x7f6fb0149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:44.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.937+0000 7f6fb6bbb640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6fb0141000 0x7f6fb0140650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:44.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.937+0000 7f6fb6bbb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fb014ac80 0x7f6fb013f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:44.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.937+0000 7f6fb6bbb640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb0141b60 con 0x7f6fb014ac80 2024-04-15T00:20:44.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.937+0000 7f6fb6bbb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb00b0c50 con 0x7f6fb0067180 2024-04-15T00:20:44.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.937+0000 7f6fb6bbb640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f6fb0141ce0 con 0x7f6fb0141000 2024-04-15T00:20:44.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.937+0000 7f6fb4957640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fb0067180 0x7f6fb0149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.937+0000 7f6faffff640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6fb0141000 0x7f6fb0140650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.937+0000 7f6fb4957640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fb0067180 0x7f6fb0149d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44760/0 (socket says 172.21.15.50:44760) 2024-04-15T00:20:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.937+0000 7f6fb4957640 1 -- 172.21.15.50:0/251156849 learned_addr learned my addr 172.21.15.50:0/251156849 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-15T00:20:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.937+0000 7f6fb5158640 1 --2- 172.21.15.50:0/251156849 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fb014ac80 0x7f6fb013f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.937+0000 7f6faffff640 1 -- 172.21.15.50:0/251156849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fb0067180 msgr2=0x7f6fb0149d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.937+0000 7f6faffff640 1 --2- 172.21.15.50:0/251156849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fb0067180 0x7f6fb0149d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.937+0000 7f6faffff640 1 -- 172.21.15.50:0/251156849 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fb014ac80 msgr2=0x7f6fb013f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.937+0000 7f6faffff640 1 --2- 172.21.15.50:0/251156849 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fb014ac80 0x7f6fb013f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.937+0000 7f6faffff640 1 -- 172.21.15.50:0/251156849 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb0140d30 con 0x7f6fb0141000 2024-04-15T00:20:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.937+0000 7f6fb4957640 1 --2- 172.21.15.50:0/251156849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fb0067180 0x7f6fb0149d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:20:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.937+0000 7f6fb5158640 1 --2- 172.21.15.50:0/251156849 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fb014ac80 0x7f6fb013f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:20:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.937+0000 7f6faffff640 1 --2- 172.21.15.50:0/251156849 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6fb0141000 0x7f6fb0140650 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c033000 tx=0x7f6f9c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:20:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.937+0000 7f6fad7fa640 1 -- 172.21.15.50:0/251156849 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c040070 con 0x7f6fb0141000 2024-04-15T00:20:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.937+0000 7f6fad7fa640 1 -- 172.21.15.50:0/251156849 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f9c030d00 con 0x7f6fb0141000 2024-04-15T00:20:44.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.937+0000 7f6fb6bbb640 1 -- 172.21.15.50:0/251156849 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fb00b8fe0 con 0x7f6fb0141000 2024-04-15T00:20:44.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.937+0000 7f6fad7fa640 1 -- 172.21.15.50:0/251156849 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c035040 con 0x7f6fb0141000 2024-04-15T00:20:44.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.938+0000 7f6fb6bbb640 1 -- 172.21.15.50:0/251156849 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fb014a6b0 con 0x7f6fb0141000 2024-04-15T00:20:44.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.938+0000 7f6fad7fa640 1 -- 172.21.15.50:0/251156849 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6f9c04b060 con 0x7f6fb0141000 2024-04-15T00:20:44.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.938+0000 7f6fad7fa640 1 -- 172.21.15.50:0/251156849 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f6f9c04d920 con 0x7f6fb0141000 2024-04-15T00:20:44.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.938+0000 7f6fb6bbb640 1 -- 172.21.15.50:0/251156849 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fb004f540 con 0x7f6fb0141000 2024-04-15T00:20:44.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:44.941+0000 7f6fad7fa640 1 -- 172.21.15.50:0/251156849 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f6f9c052020 con 0x7f6fb0141000 2024-04-15T00:20:45.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.014+0000 7f6fb6bbb640 1 -- 172.21.15.50:0/251156849 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0f751557-3f18-464f-8b78-614d19549f0f", "id": 1} v 0) -- 0x7f6fb006d020 con 0x7f6fb0141000 2024-04-15T00:20:45.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.017+0000 7f6fad7fa640 1 -- 172.21.15.50:0/251156849 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0f751557-3f18-464f-8b78-614d19549f0f", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f6f9c03ab80 con 0x7f6fb0141000 2024-04-15T00:20:45.025 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-04-15T00:20:45.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.018+0000 7f6fb6bbb640 1 -- 172.21.15.50:0/251156849 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6fb0141000 msgr2=0x7f6fb0140650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:45.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.018+0000 7f6fb6bbb640 1 --2- 172.21.15.50:0/251156849 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6fb0141000 0x7f6fb0140650 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c033000 tx=0x7f6f9c0046c0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.018+0000 7f6fb6bbb640 1 -- 172.21.15.50:0/251156849 shutdown_connections 2024-04-15T00:20:45.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.018+0000 7f6fb6bbb640 1 --2- 172.21.15.50:0/251156849 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fb014ac80 0x7f6fb013f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.018+0000 7f6fb6bbb640 1 --2- 172.21.15.50:0/251156849 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6fb0141000 0x7f6fb0140650 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.018+0000 7f6fb6bbb640 1 --2- 172.21.15.50:0/251156849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fb0067180 0x7f6fb0149d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.018+0000 7f6fb6bbb640 1 -- 172.21.15.50:0/251156849 >> 172.21.15.50:0/251156849 conn(0x7f6fb006b200 msgr2=0x7f6fb00b4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:20:45.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.019+0000 7f6fb6bbb640 1 -- 172.21.15.50:0/251156849 shutdown_connections 2024-04-15T00:20:45.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.019+0000 7f6fb6bbb640 1 -- 172.21.15.50:0/251156849 wait complete. 2024-04-15T00:20:45.036 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 17371b09-2bd7-4ef7-926f-e7706319f064 2 2024-04-15T00:20:45.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.130+0000 7fdd45ea6640 1 Processor -- start 2024-04-15T00:20:45.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.130+0000 7fdd45ea6640 1 -- start start 2024-04-15T00:20:45.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.131+0000 7fdd45ea6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdd401413c0 0x7fdd40141870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:45.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.131+0000 7fdd45ea6640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd4006e7d0 con 0x7fdd40147850 2024-04-15T00:20:45.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.131+0000 7fdd45ea6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd40072a40 con 0x7fdd40072660 2024-04-15T00:20:45.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.131+0000 7fdd45ea6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fdd4006ea40 con 0x7fdd401413c0 2024-04-15T00:20:45.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.131+0000 7fdd3effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdd401413c0 0x7fdd40141870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:45.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.131+0000 7fdd3f7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdd40072660 0x7fdd4014ab30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35836/0 (socket says 172.21.15.50:35836) 2024-04-15T00:20:45.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.131+0000 7fdd3f7fe640 1 -- 172.21.15.50:0/2211097893 learned_addr learned my addr 172.21.15.50:0/2211097893 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-15T00:20:45.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.131+0000 7fdd3effd640 1 -- 172.21.15.50:0/2211097893 >> v1:172.21.15.50:6789/0 conn(0x7fdd40072660 legacy=0x7fdd4014ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:45.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.131+0000 7fdd3effd640 1 -- 172.21.15.50:0/2211097893 >> v1:172.21.15.31:6789/0 conn(0x7fdd40147850 legacy=0x7fdd40147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:45.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.131+0000 7fdd3effd640 1 -- 172.21.15.50:0/2211097893 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4014b420 con 0x7fdd401413c0 2024-04-15T00:20:45.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.132+0000 7fdd3effd640 1 --2- 172.21.15.50:0/2211097893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd401413c0 0x7fdd40141870 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdd340097a0 tx=0x7fdd3402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec64f6f8ff949398 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:20:45.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.132+0000 7fdd3e7fc640 1 -- 172.21.15.50:0/2211097893 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd34035020 con 0x7fdd401413c0 2024-04-15T00:20:45.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.132+0000 7fdd3e7fc640 1 -- 172.21.15.50:0/2211097893 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd34031830 con 0x7fdd401413c0 2024-04-15T00:20:45.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.132+0000 7fdd3e7fc640 1 -- 172.21.15.50:0/2211097893 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd34031c00 con 0x7fdd401413c0 2024-04-15T00:20:45.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.133+0000 7fdd45ea6640 1 -- 172.21.15.50:0/2211097893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd401413c0 msgr2=0x7fdd40141870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:45.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.133+0000 7fdd45ea6640 1 --2- 172.21.15.50:0/2211097893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd401413c0 0x7fdd40141870 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdd340097a0 tx=0x7fdd3402b8d0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.133+0000 7fdd45ea6640 1 -- 172.21.15.50:0/2211097893 shutdown_connections 2024-04-15T00:20:45.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.133+0000 7fdd45ea6640 1 --2- 172.21.15.50:0/2211097893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd401413c0 0x7fdd40141870 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.133+0000 7fdd45ea6640 1 -- 172.21.15.50:0/2211097893 >> 172.21.15.50:0/2211097893 conn(0x7fdd400b7840 msgr2=0x7fdd400b7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:20:45.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.133+0000 7fdd45ea6640 1 -- 172.21.15.50:0/2211097893 shutdown_connections 2024-04-15T00:20:45.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.133+0000 7fdd45ea6640 1 -- 172.21.15.50:0/2211097893 wait complete. 2024-04-15T00:20:45.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.134+0000 7fdd45ea6640 1 Processor -- start 2024-04-15T00:20:45.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.134+0000 7fdd45ea6640 1 -- start start 2024-04-15T00:20:45.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.135+0000 7fdd45ea6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd40072660 0x7fdd40138f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:45.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.135+0000 7fdd45ea6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd401413c0 0x7fdd400b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:45.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.135+0000 7fdd45ea6640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd40147850 0x7fdd401dd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:45.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.135+0000 7fdd45ea6640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdd40152ed0 con 0x7fdd40072660 2024-04-15T00:20:45.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.135+0000 7fdd45ea6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4014b9e0 con 0x7fdd401413c0 2024-04-15T00:20:45.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.135+0000 7fdd45ea6640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fdd40153050 con 0x7fdd40147850 2024-04-15T00:20:45.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.135+0000 7fdd3effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd401413c0 0x7fdd400b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:45.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.135+0000 7fdd3effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd401413c0 0x7fdd400b16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44778/0 (socket says 172.21.15.50:44778) 2024-04-15T00:20:45.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.135+0000 7fdd3effd640 1 -- 172.21.15.50:0/668709609 learned_addr learned my addr 172.21.15.50:0/668709609 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-15T00:20:45.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.135+0000 7fdd3ffff640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd40147850 0x7fdd401dd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:45.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.135+0000 7fdd3f7fe640 1 --2- 172.21.15.50:0/668709609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd40072660 0x7fdd40138f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:45.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.135+0000 7fdd3effd640 1 -- 172.21.15.50:0/668709609 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd40147850 msgr2=0x7fdd401dd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:45.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.135+0000 7fdd3effd640 1 --2- 172.21.15.50:0/668709609 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd40147850 0x7fdd401dd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.135+0000 7fdd3effd640 1 -- 172.21.15.50:0/668709609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd40072660 msgr2=0x7fdd40138f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:45.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.135+0000 7fdd3effd640 1 --2- 172.21.15.50:0/668709609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd40072660 0x7fdd40138f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.135+0000 7fdd3effd640 1 -- 172.21.15.50:0/668709609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd40135930 con 0x7fdd401413c0 2024-04-15T00:20:45.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.135+0000 7fdd3effd640 1 --2- 172.21.15.50:0/668709609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd401413c0 0x7fdd400b16f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fdd3402bee0 tx=0x7fdd340046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:20:45.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.135+0000 7fdd27fff640 1 -- 172.21.15.50:0/668709609 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd34041070 con 0x7fdd401413c0 2024-04-15T00:20:45.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.135+0000 7fdd27fff640 1 -- 172.21.15.50:0/668709609 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd3403a950 con 0x7fdd401413c0 2024-04-15T00:20:45.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.136+0000 7fdd45ea6640 1 -- 172.21.15.50:0/668709609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd40139740 con 0x7fdd401413c0 2024-04-15T00:20:45.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.136+0000 7fdd27fff640 1 -- 172.21.15.50:0/668709609 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd34035040 con 0x7fdd401413c0 2024-04-15T00:20:45.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.136+0000 7fdd45ea6640 1 -- 172.21.15.50:0/668709609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd40139d00 con 0x7fdd401413c0 2024-04-15T00:20:45.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.136+0000 7fdd27fff640 1 -- 172.21.15.50:0/668709609 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdd34038020 con 0x7fdd401413c0 2024-04-15T00:20:45.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.136+0000 7fdd27fff640 1 -- 172.21.15.50:0/668709609 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fdd34045400 con 0x7fdd401413c0 2024-04-15T00:20:45.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.136+0000 7fdd45ea6640 1 -- 172.21.15.50:0/668709609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd4004f540 con 0x7fdd401413c0 2024-04-15T00:20:45.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.139+0000 7fdd27fff640 1 -- 172.21.15.50:0/668709609 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fdd3403ad40 con 0x7fdd401413c0 2024-04-15T00:20:45.192 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-15T00:20:45.185+0000 7fb73ec11040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-15T00:20:45.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.213+0000 7fdd45ea6640 1 -- 172.21.15.50:0/668709609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd new", "uuid": "17371b09-2bd7-4ef7-926f-e7706319f064", "id": 2} v 0) -- 0x7fdd400b5240 con 0x7fdd401413c0 2024-04-15T00:20:45.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.216+0000 7fdd27fff640 1 -- 172.21.15.50:0/668709609 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "17371b09-2bd7-4ef7-926f-e7706319f064", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fdd3403bb60 con 0x7fdd401413c0 2024-04-15T00:20:45.223 INFO:teuthology.orchestra.run.smithi050.stdout:2 2024-04-15T00:20:45.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.217+0000 7fdd45ea6640 1 -- 172.21.15.50:0/668709609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd401413c0 msgr2=0x7fdd400b16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:45.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.217+0000 7fdd45ea6640 1 --2- 172.21.15.50:0/668709609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd401413c0 0x7fdd400b16f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fdd3402bee0 tx=0x7fdd340046c0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.217+0000 7fdd45ea6640 1 -- 172.21.15.50:0/668709609 shutdown_connections 2024-04-15T00:20:45.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.217+0000 7fdd45ea6640 1 --2- 172.21.15.50:0/668709609 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdd40147850 0x7fdd401dd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.217+0000 7fdd45ea6640 1 --2- 172.21.15.50:0/668709609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd401413c0 0x7fdd400b16f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.217+0000 7fdd45ea6640 1 --2- 172.21.15.50:0/668709609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd40072660 0x7fdd40138f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.217+0000 7fdd45ea6640 1 -- 172.21.15.50:0/668709609 >> 172.21.15.50:0/668709609 conn(0x7fdd400b7840 msgr2=0x7fdd4009ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:20:45.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.217+0000 7fdd45ea6640 1 -- 172.21.15.50:0/668709609 shutdown_connections 2024-04-15T00:20:45.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.217+0000 7fdd45ea6640 1 -- 172.21.15.50:0/668709609 wait complete. 2024-04-15T00:20:45.235 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 315b6949-f009-4291-9581-aa4912642dd5 3 2024-04-15T00:20:45.249 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-15T00:20:45.241+0000 7fb73ec11040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-15T00:20:45.284 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-04-15T00:20:45.276+0000 7f544403e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-15T00:20:45.295 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-15T00:20:45.288+0000 7fb73ec11040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-15T00:20:45.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.328+0000 7fb6fbaa2640 1 Processor -- start 2024-04-15T00:20:45.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.328+0000 7fb6fbaa2640 1 -- start start 2024-04-15T00:20:45.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.329+0000 7fb6fbaa2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb6f4070e10 0x7fb6f4144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:45.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.329+0000 7fb6fbaa2640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6f4145100 con 0x7fb6f4144cd0 2024-04-15T00:20:45.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.329+0000 7fb6fbaa2640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6f40703e0 con 0x7fb6f4071680 2024-04-15T00:20:45.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.329+0000 7fb6fbaa2640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fb6f4071270 con 0x7fb6f4070e10 2024-04-15T00:20:45.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.329+0000 7fb6f903d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb6f4070e10 0x7fb6f4144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:45.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.329+0000 7fb6f903d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb6f4070e10 0x7fb6f4144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44794/0 (socket says 172.21.15.50:44794) 2024-04-15T00:20:45.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.329+0000 7fb6f983e640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb6f4071680 0x7fb6f413e290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35848/0 (socket says 172.21.15.50:35848) 2024-04-15T00:20:45.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.329+0000 7fb6f903d640 1 -- 172.21.15.50:0/1684101946 learned_addr learned my addr 172.21.15.50:0/1684101946 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-15T00:20:45.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.329+0000 7fb6f903d640 1 -- 172.21.15.50:0/1684101946 >> v1:172.21.15.50:6789/0 conn(0x7fb6f4071680 legacy=0x7fb6f413e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:45.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.329+0000 7fb6f903d640 1 -- 172.21.15.50:0/1684101946 >> v1:172.21.15.31:6789/0 conn(0x7fb6f4144cd0 legacy=0x7fb6f414ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:45.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.329+0000 7fb6f903d640 1 -- 172.21.15.50:0/1684101946 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6f40706c0 con 0x7fb6f4070e10 2024-04-15T00:20:45.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.330+0000 7fb6f903d640 1 --2- 172.21.15.50:0/1684101946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6f4070e10 0x7fb6f4144790 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0009870 tx=0x7fb6f002dbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d2830903e78bd4d server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:20:45.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.330+0000 7fb6f883c640 1 -- 172.21.15.50:0/1684101946 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f003b070 con 0x7fb6f4070e10 2024-04-15T00:20:45.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.330+0000 7fb6f883c640 1 -- 172.21.15.50:0/1684101946 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f002e960 con 0x7fb6f4070e10 2024-04-15T00:20:45.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.330+0000 7fb6f883c640 1 -- 172.21.15.50:0/1684101946 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f002ed30 con 0x7fb6f4070e10 2024-04-15T00:20:45.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.331+0000 7fb6fbaa2640 1 -- 172.21.15.50:0/1684101946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6f4070e10 msgr2=0x7fb6f4144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:45.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.331+0000 7fb6fbaa2640 1 --2- 172.21.15.50:0/1684101946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6f4070e10 0x7fb6f4144790 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0009870 tx=0x7fb6f002dbb0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.331+0000 7fb6fbaa2640 1 -- 172.21.15.50:0/1684101946 shutdown_connections 2024-04-15T00:20:45.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.331+0000 7fb6fbaa2640 1 --2- 172.21.15.50:0/1684101946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6f4070e10 0x7fb6f4144790 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.331+0000 7fb6fbaa2640 1 -- 172.21.15.50:0/1684101946 >> 172.21.15.50:0/1684101946 conn(0x7fb6f406b200 msgr2=0x7fb6f406b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:20:45.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.331+0000 7fb6fbaa2640 1 -- 172.21.15.50:0/1684101946 shutdown_connections 2024-04-15T00:20:45.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.331+0000 7fb6fbaa2640 1 -- 172.21.15.50:0/1684101946 wait complete. 2024-04-15T00:20:45.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.332+0000 7fb6fbaa2640 1 Processor -- start 2024-04-15T00:20:45.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.332+0000 7fb6fbaa2640 1 -- start start 2024-04-15T00:20:45.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.333+0000 7fb6fbaa2640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb6f4070e10 0x7fb6f40b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:45.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.333+0000 7fb6fbaa2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6f4071680 0x7fb6f40b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:45.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.333+0000 7fb6fbaa2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6f4144cd0 0x7fb6f40afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:45.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.333+0000 7fb6fbaa2640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f406e150 con 0x7fb6f4144cd0 2024-04-15T00:20:45.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.333+0000 7fb6fbaa2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f4071a60 con 0x7fb6f4071680 2024-04-15T00:20:45.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.333+0000 7fb6fbaa2640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fb6f413e9a0 con 0x7fb6f4070e10 2024-04-15T00:20:45.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.333+0000 7fb6f983e640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb6f4070e10 0x7fb6f40b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:45.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.333+0000 7fb6f903d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6f4071680 0x7fb6f40b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:45.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.333+0000 7fb6f903d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6f4071680 0x7fb6f40b3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44810/0 (socket says 172.21.15.50:44810) 2024-04-15T00:20:45.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.333+0000 7fb6f903d640 1 -- 172.21.15.50:0/2014635896 learned_addr learned my addr 172.21.15.50:0/2014635896 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-15T00:20:45.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.333+0000 7fb6fa03f640 1 --2- 172.21.15.50:0/2014635896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6f4144cd0 0x7fb6f40afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:45.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.333+0000 7fb6f983e640 1 -- 172.21.15.50:0/2014635896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6f4071680 msgr2=0x7fb6f40b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:45.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.333+0000 7fb6f983e640 1 --2- 172.21.15.50:0/2014635896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6f4071680 0x7fb6f40b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.333+0000 7fb6f983e640 1 -- 172.21.15.50:0/2014635896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6f4144cd0 msgr2=0x7fb6f40afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:45.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.333+0000 7fb6f983e640 1 --2- 172.21.15.50:0/2014635896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6f4144cd0 0x7fb6f40afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.333+0000 7fb6f983e640 1 -- 172.21.15.50:0/2014635896 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6f40a95a0 con 0x7fb6f4070e10 2024-04-15T00:20:45.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.333+0000 7fb6f903d640 1 --2- 172.21.15.50:0/2014635896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6f4071680 0x7fb6f40b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:20:45.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.333+0000 7fb6f983e640 1 --2- 172.21.15.50:0/2014635896 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb6f4070e10 0x7fb6f40b1a00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb6e400c460 tx=0x7fb6e400c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:20:45.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.333+0000 7fb6ea7fc640 1 -- 172.21.15.50:0/2014635896 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e40074e0 con 0x7fb6f4070e10 2024-04-15T00:20:45.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.333+0000 7fb6ea7fc640 1 -- 172.21.15.50:0/2014635896 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6e4007680 con 0x7fb6f4070e10 2024-04-15T00:20:45.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.333+0000 7fb6fbaa2640 1 -- 172.21.15.50:0/2014635896 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6f40b2120 con 0x7fb6f4070e10 2024-04-15T00:20:45.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.333+0000 7fb6ea7fc640 1 -- 172.21.15.50:0/2014635896 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e40049e0 con 0x7fb6f4070e10 2024-04-15T00:20:45.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.334+0000 7fb6fbaa2640 1 -- 172.21.15.50:0/2014635896 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6f4141be0 con 0x7fb6f4070e10 2024-04-15T00:20:45.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.334+0000 7fb6ea7fc640 1 -- 172.21.15.50:0/2014635896 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb6e401a020 con 0x7fb6f4070e10 2024-04-15T00:20:45.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.334+0000 7fb6ea7fc640 1 -- 172.21.15.50:0/2014635896 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fb6e4013890 con 0x7fb6f4070e10 2024-04-15T00:20:45.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.335+0000 7fb6fbaa2640 1 -- 172.21.15.50:0/2014635896 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6f40b1f40 con 0x7fb6f4070e10 2024-04-15T00:20:45.344 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-04-15T00:20:45.336+0000 7f544403e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-15T00:20:45.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.337+0000 7fb6ea7fc640 1 -- 172.21.15.50:0/2014635896 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fb6f40b1f40 con 0x7fb6f4070e10 2024-04-15T00:20:45.351 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-15T00:20:45.344+0000 7fb73ec11040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-15T00:20:45.395 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-15T00:20:45.388+0000 7fb73ec11040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-15T00:20:45.402 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-04-15T00:20:45.395+0000 7f544403e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-15T00:20:45.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.428+0000 7fb6fbaa2640 1 -- 172.21.15.50:0/2014635896 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd new", "uuid": "315b6949-f009-4291-9581-aa4912642dd5", "id": 3} v 0) -- 0x7fb6f404f540 con 0x7fb6f4070e10 2024-04-15T00:20:45.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.431+0000 7fb6ea7fc640 1 -- 172.21.15.50:0/2014635896 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "315b6949-f009-4291-9581-aa4912642dd5", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fb6e4021070 con 0x7fb6f4070e10 2024-04-15T00:20:45.438 INFO:teuthology.orchestra.run.smithi050.stdout:3 2024-04-15T00:20:45.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.432+0000 7fb6fbaa2640 1 -- 172.21.15.50:0/2014635896 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb6f4070e10 msgr2=0x7fb6f40b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:45.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.432+0000 7fb6fbaa2640 1 --2- 172.21.15.50:0/2014635896 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb6f4070e10 0x7fb6f40b1a00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb6e400c460 tx=0x7fb6e400c920 comp rx=0 tx=0).stop 2024-04-15T00:20:45.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.432+0000 7fb6fbaa2640 1 -- 172.21.15.50:0/2014635896 shutdown_connections 2024-04-15T00:20:45.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.432+0000 7fb6fbaa2640 1 --2- 172.21.15.50:0/2014635896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6f4144cd0 0x7fb6f40afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.432+0000 7fb6fbaa2640 1 --2- 172.21.15.50:0/2014635896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6f4071680 0x7fb6f40b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.432+0000 7fb6fbaa2640 1 --2- 172.21.15.50:0/2014635896 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb6f4070e10 0x7fb6f40b1a00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.432+0000 7fb6fbaa2640 1 -- 172.21.15.50:0/2014635896 >> 172.21.15.50:0/2014635896 conn(0x7fb6f406b200 msgr2=0x7fb6f40b4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:20:45.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.432+0000 7fb6fbaa2640 1 -- 172.21.15.50:0/2014635896 shutdown_connections 2024-04-15T00:20:45.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.432+0000 7fb6fbaa2640 1 -- 172.21.15.50:0/2014635896 wait complete. 2024-04-15T00:20:45.449 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new e3659369-cc78-4aa8-bd10-a199d4a1569d 4 2024-04-15T00:20:45.459 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-04-15T00:20:45.452+0000 7f544403e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-15T00:20:45.505 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-04-15T00:20:45.498+0000 7f544403e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-15T00:20:45.515 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-15T00:20:45.508+0000 7fb73ec11040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-15T00:20:45.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.544+0000 7f93f1884640 1 Processor -- start 2024-04-15T00:20:45.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.544+0000 7f93f1884640 1 -- start start 2024-04-15T00:20:45.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.544+0000 7f93f1884640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f93ec13f890 0x7f93ec0b5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:45.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.544+0000 7f93f1884640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93ec06e2e0 0x7f93ec0b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:45.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.544+0000 7f93f1884640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93ec072af0 con 0x7f93ec072710 2024-04-15T00:20:45.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.544+0000 7f93f1884640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f93ec0b4520 con 0x7f93ec13f890 2024-04-15T00:20:45.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.544+0000 7f93f1884640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f93ec0b4770 con 0x7f93ec06e2e0 2024-04-15T00:20:45.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.544+0000 7f93eb7fe640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93ec06e2e0 0x7f93ec0b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:45.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.544+0000 7f93eb7fe640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93ec06e2e0 0x7f93ec0b58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:51986/0 (socket says 172.21.15.50:51986) 2024-04-15T00:20:45.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.544+0000 7f93eb7fe640 1 -- 172.21.15.50:0/3261757852 learned_addr learned my addr 172.21.15.50:0/3261757852 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-15T00:20:45.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.544+0000 7f93ea7fc640 1 --2- 172.21.15.50:0/3261757852 >> v2:172.21.15.31:3300/0 conn(0x7f93ec13f890 0x7f93ec0b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:45.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.545+0000 7f93eb7fe640 1 -- 172.21.15.50:0/3261757852 >> v2:172.21.15.31:3300/0 conn(0x7f93ec13f890 msgr2=0x7f93ec0b5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:20:45.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.545+0000 7f93eb7fe640 1 --2- 172.21.15.50:0/3261757852 >> v2:172.21.15.31:3300/0 conn(0x7f93ec13f890 0x7f93ec0b5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.545+0000 7f93eb7fe640 1 -- 172.21.15.50:0/3261757852 >> v1:172.21.15.31:6789/0 conn(0x7f93ec072710 legacy=0x7f93ec13f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:45.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.545+0000 7f93eb7fe640 1 -- 172.21.15.50:0/3261757852 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93ec0b4c00 con 0x7f93ec06e2e0 2024-04-15T00:20:45.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.545+0000 7f93ea7fc640 1 --2- 172.21.15.50:0/3261757852 >> v2:172.21.15.31:3300/0 conn(0x7f93ec13f890 0x7f93ec0b5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:20:45.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.545+0000 7f93eb7fe640 1 --2- 172.21.15.50:0/3261757852 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93ec06e2e0 0x7f93ec0b58d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f93e4009e50 tx=0x7f93e402bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1bd526001e45761 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:20:45.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.546+0000 7f93e9ffb640 1 -- 172.21.15.50:0/3261757852 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e402ca70 con 0x7f93ec06e2e0 2024-04-15T00:20:45.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.546+0000 7f93e9ffb640 1 -- 172.21.15.50:0/3261757852 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e402cc10 con 0x7f93ec06e2e0 2024-04-15T00:20:45.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.546+0000 7f93e9ffb640 1 -- 172.21.15.50:0/3261757852 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e40343f0 con 0x7f93ec06e2e0 2024-04-15T00:20:45.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.546+0000 7f93f1884640 1 -- 172.21.15.50:0/3261757852 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93ec06e2e0 msgr2=0x7f93ec0b58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:45.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.546+0000 7f93f1884640 1 --2- 172.21.15.50:0/3261757852 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93ec06e2e0 0x7f93ec0b58d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f93e4009e50 tx=0x7f93e402bed0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.546+0000 7f93f1884640 1 -- 172.21.15.50:0/3261757852 shutdown_connections 2024-04-15T00:20:45.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.546+0000 7f93f1884640 1 --2- 172.21.15.50:0/3261757852 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93ec06e2e0 0x7f93ec0b58d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.546+0000 7f93f1884640 1 --2- 172.21.15.50:0/3261757852 >> v2:172.21.15.31:3300/0 conn(0x7f93ec13f890 0x7f93ec0b5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.546+0000 7f93f1884640 1 -- 172.21.15.50:0/3261757852 >> 172.21.15.50:0/3261757852 conn(0x7f93ec06b200 msgr2=0x7f93ec06b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:20:45.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.547+0000 7f93f1884640 1 -- 172.21.15.50:0/3261757852 shutdown_connections 2024-04-15T00:20:45.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.547+0000 7f93f1884640 1 -- 172.21.15.50:0/3261757852 wait complete. 2024-04-15T00:20:45.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.548+0000 7f93f1884640 1 Processor -- start 2024-04-15T00:20:45.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.548+0000 7f93f1884640 1 -- start start 2024-04-15T00:20:45.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.549+0000 7f93f1884640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93ec06e2e0 0x7f93ec13d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:45.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.549+0000 7f93f1884640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93ec072710 0x7f93ec1e0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:45.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.549+0000 7f93f1884640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93ec13f890 0x7f93ec070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:45.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.549+0000 7f93f1884640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f93ec14fe10 con 0x7f93ec06e2e0 2024-04-15T00:20:45.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.549+0000 7f93f1884640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f93ec14fc90 con 0x7f93ec13f890 2024-04-15T00:20:45.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.549+0000 7f93f1884640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f93ec14ff90 con 0x7f93ec072710 2024-04-15T00:20:45.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.549+0000 7f93ea7fc640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93ec072710 0x7f93ec1e0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:45.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.549+0000 7f93eb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93ec13f890 0x7f93ec070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:45.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.549+0000 7f93ea7fc640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93ec072710 0x7f93ec1e0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:52000/0 (socket says 172.21.15.50:52000) 2024-04-15T00:20:45.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.549+0000 7f93eaffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93ec06e2e0 0x7f93ec13d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:45.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.549+0000 7f93ea7fc640 1 -- 172.21.15.50:0/3420843418 learned_addr learned my addr 172.21.15.50:0/3420843418 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-15T00:20:45.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.550+0000 7f93ea7fc640 1 -- 172.21.15.50:0/3420843418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93ec13f890 msgr2=0x7f93ec070290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:45.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.550+0000 7f93ea7fc640 1 --2- 172.21.15.50:0/3420843418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93ec13f890 0x7f93ec070290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.550+0000 7f93ea7fc640 1 -- 172.21.15.50:0/3420843418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93ec06e2e0 msgr2=0x7f93ec13d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:45.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.550+0000 7f93ea7fc640 1 --2- 172.21.15.50:0/3420843418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93ec06e2e0 0x7f93ec13d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.550+0000 7f93ea7fc640 1 -- 172.21.15.50:0/3420843418 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93ec141b00 con 0x7f93ec072710 2024-04-15T00:20:45.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.550+0000 7f93ea7fc640 1 --2- 172.21.15.50:0/3420843418 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93ec072710 0x7f93ec1e0250 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f93e000d830 tx=0x7f93e000dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:20:45.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.550+0000 7f93d3fff640 1 -- 172.21.15.50:0/3420843418 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e000b6c0 con 0x7f93ec072710 2024-04-15T00:20:45.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.550+0000 7f93d3fff640 1 -- 172.21.15.50:0/3420843418 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e0019070 con 0x7f93ec072710 2024-04-15T00:20:45.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.550+0000 7f93d3fff640 1 -- 172.21.15.50:0/3420843418 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e000ba80 con 0x7f93ec072710 2024-04-15T00:20:45.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.550+0000 7f93f1884640 1 -- 172.21.15.50:0/3420843418 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93ec141de0 con 0x7f93ec072710 2024-04-15T00:20:45.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.550+0000 7f93f1884640 1 -- 172.21.15.50:0/3420843418 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f93ec0719c0 con 0x7f93ec072710 2024-04-15T00:20:45.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.550+0000 7f93d3fff640 1 -- 172.21.15.50:0/3420843418 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f93e001e460 con 0x7f93ec072710 2024-04-15T00:20:45.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.550+0000 7f93d3fff640 1 -- 172.21.15.50:0/3420843418 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f93e0014b20 con 0x7f93ec072710 2024-04-15T00:20:45.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.551+0000 7f93f1884640 1 -- 172.21.15.50:0/3420843418 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93ec06c350 con 0x7f93ec072710 2024-04-15T00:20:45.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.553+0000 7f93d3fff640 1 -- 172.21.15.50:0/3420843418 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f93ec141b00 con 0x7f93ec072710 2024-04-15T00:20:45.589 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-15T00:20:45.582+0000 7fb73ec11040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-15T00:20:45.630 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-04-15T00:20:45.623+0000 7f544403e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-15T00:20:45.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.627+0000 7f93f1884640 1 -- 172.21.15.50:0/3420843418 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e3659369-cc78-4aa8-bd10-a199d4a1569d", "id": 4} v 0) -- 0x7f93ec0b14a0 con 0x7f93ec072710 2024-04-15T00:20:45.636 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-15T00:20:45.630+0000 7fb73ec11040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-15T00:20:45.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.630+0000 7f93d3fff640 1 -- 172.21.15.50:0/3420843418 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e3659369-cc78-4aa8-bd10-a199d4a1569d", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f93e0014e00 con 0x7f93ec072710 2024-04-15T00:20:45.637 INFO:teuthology.orchestra.run.smithi050.stdout:4 2024-04-15T00:20:45.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.631+0000 7f93f1884640 1 -- 172.21.15.50:0/3420843418 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93ec072710 msgr2=0x7f93ec1e0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:45.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.631+0000 7f93f1884640 1 --2- 172.21.15.50:0/3420843418 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93ec072710 0x7f93ec1e0250 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f93e000d830 tx=0x7f93e000dcf0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.631+0000 7f93f1884640 1 -- 172.21.15.50:0/3420843418 shutdown_connections 2024-04-15T00:20:45.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.631+0000 7f93f1884640 1 --2- 172.21.15.50:0/3420843418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93ec13f890 0x7f93ec070290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.631+0000 7f93f1884640 1 --2- 172.21.15.50:0/3420843418 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93ec072710 0x7f93ec1e0250 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.631+0000 7f93f1884640 1 --2- 172.21.15.50:0/3420843418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93ec06e2e0 0x7f93ec13d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.631+0000 7f93f1884640 1 -- 172.21.15.50:0/3420843418 >> 172.21.15.50:0/3420843418 conn(0x7f93ec06b200 msgr2=0x7f93ec0b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:20:45.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.631+0000 7f93f1884640 1 -- 172.21.15.50:0/3420843418 shutdown_connections 2024-04-15T00:20:45.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.631+0000 7f93f1884640 1 -- 172.21.15.50:0/3420843418 wait complete. 2024-04-15T00:20:45.648 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 35c3a4c0-0b45-45d2-85b9-301c347602f6 5 2024-04-15T00:20:45.692 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-15T00:20:45.684+0000 7fb73ec11040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-15T00:20:45.705 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-04-15T00:20:45.698+0000 7f544403e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-15T00:20:45.740 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-15T00:20:45.733+0000 7fb73ec11040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-15T00:20:45.754 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-04-15T00:20:45.747+0000 7f544403e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-15T00:20:45.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.784+0000 7f23c0ede640 1 Processor -- start 2024-04-15T00:20:45.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.784+0000 7f23c0ede640 1 -- start start 2024-04-15T00:20:45.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.784+0000 7f23c0ede640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f23bc06e9a0 0x7f23bc06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:45.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.784+0000 7f23c0ede640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f23bc145700 0x7f23bc145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:45.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.784+0000 7f23c0ede640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23bc072a40 con 0x7f23bc072660 2024-04-15T00:20:45.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.784+0000 7f23c0ede640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f23bc0b6fd0 con 0x7f23bc06e9a0 2024-04-15T00:20:45.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.784+0000 7f23c0ede640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f23bc1460f0 con 0x7f23bc145700 2024-04-15T00:20:45.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.784+0000 7f23bad9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f23bc145700 0x7f23bc145bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:45.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.784+0000 7f23bad9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f23bc145700 0x7f23bc145bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44826/0 (socket says 172.21.15.50:44826) 2024-04-15T00:20:45.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.784+0000 7f23bad9d640 1 -- 172.21.15.50:0/2872648018 learned_addr learned my addr 172.21.15.50:0/2872648018 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-15T00:20:45.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.785+0000 7f23b3fff640 1 --2- 172.21.15.50:0/2872648018 >> v2:172.21.15.31:3300/0 conn(0x7f23bc06e9a0 0x7f23bc06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:45.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.785+0000 7f23bad9d640 1 -- 172.21.15.50:0/2872648018 >> v2:172.21.15.31:3300/0 conn(0x7f23bc06e9a0 msgr2=0x7f23bc06ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:20:45.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.785+0000 7f23bad9d640 1 --2- 172.21.15.50:0/2872648018 >> v2:172.21.15.31:3300/0 conn(0x7f23bc06e9a0 0x7f23bc06ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.785+0000 7f23bad9d640 1 -- 172.21.15.50:0/2872648018 >> v1:172.21.15.31:6789/0 conn(0x7f23bc072660 legacy=0x7f23bc0b17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:45.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.785+0000 7f23bad9d640 1 -- 172.21.15.50:0/2872648018 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23bc06e210 con 0x7f23bc145700 2024-04-15T00:20:45.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.785+0000 7f23bad9d640 1 --2- 172.21.15.50:0/2872648018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23bc145700 0x7f23bc145bb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f23bc0a0510 tx=0x7f23b402bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6a912e7318e63ea server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:20:45.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.786+0000 7f23b9d9b640 1 -- 172.21.15.50:0/2872648018 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b402ca80 con 0x7f23bc145700 2024-04-15T00:20:45.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.786+0000 7f23b9d9b640 1 -- 172.21.15.50:0/2872648018 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b402cc20 con 0x7f23bc145700 2024-04-15T00:20:45.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.786+0000 7f23b9d9b640 1 -- 172.21.15.50:0/2872648018 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b40343f0 con 0x7f23bc145700 2024-04-15T00:20:45.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.786+0000 7f23c0ede640 1 -- 172.21.15.50:0/2872648018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23bc145700 msgr2=0x7f23bc145bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:45.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.786+0000 7f23c0ede640 1 --2- 172.21.15.50:0/2872648018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23bc145700 0x7f23bc145bb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f23bc0a0510 tx=0x7f23b402bee0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.786+0000 7f23c0ede640 1 -- 172.21.15.50:0/2872648018 shutdown_connections 2024-04-15T00:20:45.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.786+0000 7f23c0ede640 1 --2- 172.21.15.50:0/2872648018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23bc145700 0x7f23bc145bb0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.786+0000 7f23c0ede640 1 --2- 172.21.15.50:0/2872648018 >> v2:172.21.15.31:3300/0 conn(0x7f23bc06e9a0 0x7f23bc06ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.786+0000 7f23c0ede640 1 -- 172.21.15.50:0/2872648018 >> 172.21.15.50:0/2872648018 conn(0x7f23bc0b7840 msgr2=0x7f23bc0b7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:20:45.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.786+0000 7f23c0ede640 1 -- 172.21.15.50:0/2872648018 shutdown_connections 2024-04-15T00:20:45.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.786+0000 7f23c0ede640 1 -- 172.21.15.50:0/2872648018 wait complete. 2024-04-15T00:20:45.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.787+0000 7f23c0ede640 1 Processor -- start 2024-04-15T00:20:45.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.787+0000 7f23c0ede640 1 -- start start 2024-04-15T00:20:45.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.788+0000 7f23c0ede640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f23bc06e9a0 0x7f23bc1419c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:45.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.788+0000 7f23c0ede640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23bc072660 0x7f23bc0b3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:45.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.788+0000 7f23c0ede640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23bc145700 0x7f23bc142750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:45.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.788+0000 7f23c0ede640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc0b1ec0 con 0x7f23bc072660 2024-04-15T00:20:45.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.788+0000 7f23c0ede640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc0b6c60 con 0x7f23bc145700 2024-04-15T00:20:45.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.788+0000 7f23c0ede640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f23bc14fcd0 con 0x7f23bc06e9a0 2024-04-15T00:20:45.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.788+0000 7f23bad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23bc145700 0x7f23bc142750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:45.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.788+0000 7f23bad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23bc145700 0x7f23bc142750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44838/0 (socket says 172.21.15.50:44838) 2024-04-15T00:20:45.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.788+0000 7f23bad9d640 1 -- 172.21.15.50:0/4090046589 learned_addr learned my addr 172.21.15.50:0/4090046589 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-15T00:20:45.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.788+0000 7f23ba59c640 1 --2- 172.21.15.50:0/4090046589 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f23bc06e9a0 0x7f23bc1419c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:45.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.788+0000 7f23b3fff640 1 --2- 172.21.15.50:0/4090046589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23bc072660 0x7f23bc0b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:45.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.788+0000 7f23bad9d640 1 -- 172.21.15.50:0/4090046589 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f23bc06e9a0 msgr2=0x7f23bc1419c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:45.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.788+0000 7f23bad9d640 1 --2- 172.21.15.50:0/4090046589 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f23bc06e9a0 0x7f23bc1419c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.788+0000 7f23bad9d640 1 -- 172.21.15.50:0/4090046589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23bc072660 msgr2=0x7f23bc0b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:45.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.788+0000 7f23bad9d640 1 --2- 172.21.15.50:0/4090046589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23bc072660 0x7f23bc0b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.789+0000 7f23bad9d640 1 -- 172.21.15.50:0/4090046589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23bc0b35d0 con 0x7f23bc145700 2024-04-15T00:20:45.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.789+0000 7f23ba59c640 1 --2- 172.21.15.50:0/4090046589 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f23bc06e9a0 0x7f23bc1419c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:20:45.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.789+0000 7f23b3fff640 1 --2- 172.21.15.50:0/4090046589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23bc072660 0x7f23bc0b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:20:45.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.789+0000 7f23bad9d640 1 --2- 172.21.15.50:0/4090046589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23bc145700 0x7f23bc142750 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f23b4036040 tx=0x7f23b4004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:20:45.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.789+0000 7f23b2ffd640 1 -- 172.21.15.50:0/4090046589 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4043020 con 0x7f23bc145700 2024-04-15T00:20:45.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.789+0000 7f23b2ffd640 1 -- 172.21.15.50:0/4090046589 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b403e450 con 0x7f23bc145700 2024-04-15T00:20:45.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.789+0000 7f23b2ffd640 1 -- 172.21.15.50:0/4090046589 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4009510 con 0x7f23bc145700 2024-04-15T00:20:45.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.789+0000 7f23c0ede640 1 -- 172.21.15.50:0/4090046589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23bc09aba0 con 0x7f23bc145700 2024-04-15T00:20:45.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.789+0000 7f23c0ede640 1 -- 172.21.15.50:0/4090046589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23bc142c90 con 0x7f23bc145700 2024-04-15T00:20:45.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.789+0000 7f23b2ffd640 1 -- 172.21.15.50:0/4090046589 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f23b4046020 con 0x7f23bc145700 2024-04-15T00:20:45.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.789+0000 7f23b2ffd640 1 -- 172.21.15.50:0/4090046589 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f23b4048980 con 0x7f23bc145700 2024-04-15T00:20:45.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.790+0000 7f23c0ede640 1 -- 172.21.15.50:0/4090046589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23bc04f540 con 0x7f23bc145700 2024-04-15T00:20:45.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.792+0000 7f23b2ffd640 1 -- 172.21.15.50:0/4090046589 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f23b404d030 con 0x7f23bc145700 2024-04-15T00:20:45.814 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-04-15T00:20:45.804+0000 7f544403e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-15T00:20:45.861 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-04-15T00:20:45.854+0000 7f544403e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-15T00:20:45.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.866+0000 7f23c0ede640 1 -- 172.21.15.50:0/4090046589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd new", "uuid": "35c3a4c0-0b45-45d2-85b9-301c347602f6", "id": 5} v 0) -- 0x7f23bc143b30 con 0x7f23bc145700 2024-04-15T00:20:45.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.871+0000 7f23b2ffd640 1 -- 172.21.15.50:0/4090046589 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "35c3a4c0-0b45-45d2-85b9-301c347602f6", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f23b402ca90 con 0x7f23bc145700 2024-04-15T00:20:45.879 INFO:teuthology.orchestra.run.smithi050.stdout:5 2024-04-15T00:20:45.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.872+0000 7f23c0ede640 1 -- 172.21.15.50:0/4090046589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23bc145700 msgr2=0x7f23bc142750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:45.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.872+0000 7f23c0ede640 1 --2- 172.21.15.50:0/4090046589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23bc145700 0x7f23bc142750 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f23b4036040 tx=0x7f23b4004a40 comp rx=0 tx=0).stop 2024-04-15T00:20:45.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.872+0000 7f23c0ede640 1 -- 172.21.15.50:0/4090046589 shutdown_connections 2024-04-15T00:20:45.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.872+0000 7f23c0ede640 1 --2- 172.21.15.50:0/4090046589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23bc145700 0x7f23bc142750 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.872+0000 7f23c0ede640 1 --2- 172.21.15.50:0/4090046589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23bc072660 0x7f23bc0b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.872+0000 7f23c0ede640 1 --2- 172.21.15.50:0/4090046589 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f23bc06e9a0 0x7f23bc1419c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:45.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.872+0000 7f23c0ede640 1 -- 172.21.15.50:0/4090046589 >> 172.21.15.50:0/4090046589 conn(0x7f23bc0b7840 msgr2=0x7f23bc143320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:20:45.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.872+0000 7f23c0ede640 1 -- 172.21.15.50:0/4090046589 shutdown_connections 2024-04-15T00:20:45.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:45.872+0000 7f23c0ede640 1 -- 172.21.15.50:0/4090046589 wait complete. 2024-04-15T00:20:45.890 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 20df7a76-245f-4946-9624-6ca9e949227b 6 2024-04-15T00:20:46.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.024+0000 7f28d9bbb640 1 Processor -- start 2024-04-15T00:20:46.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.024+0000 7f28d9bbb640 1 -- start start 2024-04-15T00:20:46.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.025+0000 7f28d9bbb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f28d406d260 0x7f28d40b94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:46.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.025+0000 7f28d9bbb640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f28d40726b0 0x7f28d4147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:46.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.025+0000 7f28d9bbb640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f28d4072b40 0x7f28d4148410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:46.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.025+0000 7f28d9bbb640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f28d40b0600 con 0x7f28d40726b0 2024-04-15T00:20:46.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.025+0000 7f28d9bbb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f28d406d640 con 0x7f28d406d260 2024-04-15T00:20:46.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.025+0000 7f28d9bbb640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f28d40af4d0 con 0x7f28d4072b40 2024-04-15T00:20:46.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.025+0000 7f28d37fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f28d406d260 0x7f28d40b94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.025+0000 7f28d3fff640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f28d4072b40 0x7f28d4148410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.025+0000 7f28d37fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f28d406d260 0x7f28d40b94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44848/0 (socket says 172.21.15.50:44848) 2024-04-15T00:20:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.025+0000 7f28d3fff640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f28d4072b40 0x7f28d4148410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:52020/0 (socket says 172.21.15.50:52020) 2024-04-15T00:20:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.025+0000 7f28d37fe640 1 -- 172.21.15.50:0/2114098913 learned_addr learned my addr 172.21.15.50:0/2114098913 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-15T00:20:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.025+0000 7f28d2ffd640 1 --2- 172.21.15.50:0/2114098913 >> v2:172.21.15.31:3300/0 conn(0x7f28d40726b0 0x7f28d4147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.025+0000 7f28d37fe640 1 -- 172.21.15.50:0/2114098913 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f28d4072b40 msgr2=0x7f28d4148410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:20:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.025+0000 7f28d37fe640 1 --2- 172.21.15.50:0/2114098913 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f28d4072b40 0x7f28d4148410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.025+0000 7f28d37fe640 1 -- 172.21.15.50:0/2114098913 >> v2:172.21.15.31:3300/0 conn(0x7f28d40726b0 msgr2=0x7f28d4147ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:20:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.025+0000 7f28d37fe640 1 --2- 172.21.15.50:0/2114098913 >> v2:172.21.15.31:3300/0 conn(0x7f28d40726b0 0x7f28d4147ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.025+0000 7f28d37fe640 1 -- 172.21.15.50:0/2114098913 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d41479b0 con 0x7f28d406d260 2024-04-15T00:20:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.026+0000 7f28d37fe640 1 --2- 172.21.15.50:0/2114098913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28d406d260 0x7f28d40b94a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f28d40b76e0 tx=0x7f28c402b7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41fa39211d91b0d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:20:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.026+0000 7f28d27fc640 1 -- 172.21.15.50:0/2114098913 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c4038070 con 0x7f28d406d260 2024-04-15T00:20:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.026+0000 7f28d27fc640 1 -- 172.21.15.50:0/2114098913 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28c402f050 con 0x7f28d406d260 2024-04-15T00:20:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.026+0000 7f28d27fc640 1 -- 172.21.15.50:0/2114098913 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c4031970 con 0x7f28d406d260 2024-04-15T00:20:46.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.027+0000 7f28d9bbb640 1 -- 172.21.15.50:0/2114098913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28d406d260 msgr2=0x7f28d40b94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:46.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.027+0000 7f28d9bbb640 1 --2- 172.21.15.50:0/2114098913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28d406d260 0x7f28d40b94a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f28d40b76e0 tx=0x7f28c402b7f0 comp rx=0 tx=0).stop 2024-04-15T00:20:46.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.027+0000 7f28d9bbb640 1 -- 172.21.15.50:0/2114098913 shutdown_connections 2024-04-15T00:20:46.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.027+0000 7f28d9bbb640 1 --2- 172.21.15.50:0/2114098913 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f28d4072b40 0x7f28d4148410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:46.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.027+0000 7f28d9bbb640 1 --2- 172.21.15.50:0/2114098913 >> v2:172.21.15.31:3300/0 conn(0x7f28d40726b0 0x7f28d4147ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:46.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.027+0000 7f28d9bbb640 1 --2- 172.21.15.50:0/2114098913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28d406d260 0x7f28d40b94a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:46.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.027+0000 7f28d9bbb640 1 -- 172.21.15.50:0/2114098913 >> 172.21.15.50:0/2114098913 conn(0x7f28d40b9ba0 msgr2=0x7f28d40b9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:20:46.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.027+0000 7f28d9bbb640 1 -- 172.21.15.50:0/2114098913 shutdown_connections 2024-04-15T00:20:46.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.027+0000 7f28d9bbb640 1 -- 172.21.15.50:0/2114098913 wait complete. 2024-04-15T00:20:46.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.028+0000 7f28d9bbb640 1 Processor -- start 2024-04-15T00:20:46.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.029+0000 7f28d9bbb640 1 -- start start 2024-04-15T00:20:46.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.030+0000 7f28d9bbb640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f28d406d260 0x7f28d40b6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:46.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.030+0000 7f28d9bbb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28d40726b0 0x7f28d41dd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:46.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.030+0000 7f28d9bbb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28d4072b40 0x7f28d4137c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:46.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.030+0000 7f28d9bbb640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f28d4144490 con 0x7f28d40726b0 2024-04-15T00:20:46.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.030+0000 7f28d9bbb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f28d4144310 con 0x7f28d4072b40 2024-04-15T00:20:46.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.030+0000 7f28d9bbb640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f28d4144610 con 0x7f28d406d260 2024-04-15T00:20:46.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.030+0000 7f28d37fe640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f28d406d260 0x7f28d40b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:46.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.030+0000 7f28d37fe640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f28d406d260 0x7f28d40b6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:52028/0 (socket says 172.21.15.50:52028) 2024-04-15T00:20:46.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.030+0000 7f28d37fe640 1 -- 172.21.15.50:0/3765572426 learned_addr learned my addr 172.21.15.50:0/3765572426 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-15T00:20:46.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.030+0000 7f28d3fff640 1 --2- 172.21.15.50:0/3765572426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28d4072b40 0x7f28d4137c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:46.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.030+0000 7f28d2ffd640 1 --2- 172.21.15.50:0/3765572426 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28d40726b0 0x7f28d41dd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:46.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.030+0000 7f28d37fe640 1 -- 172.21.15.50:0/3765572426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28d4072b40 msgr2=0x7f28d4137c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:46.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.030+0000 7f28d37fe640 1 --2- 172.21.15.50:0/3765572426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28d4072b40 0x7f28d4137c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:46.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.030+0000 7f28d37fe640 1 -- 172.21.15.50:0/3765572426 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28d40726b0 msgr2=0x7f28d41dd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:46.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.030+0000 7f28d37fe640 1 --2- 172.21.15.50:0/3765572426 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28d40726b0 0x7f28d41dd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:46.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.030+0000 7f28d37fe640 1 -- 172.21.15.50:0/3765572426 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d40b0fc0 con 0x7f28d406d260 2024-04-15T00:20:46.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.030+0000 7f28d3fff640 1 --2- 172.21.15.50:0/3765572426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28d4072b40 0x7f28d4137c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:20:46.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.030+0000 7f28d37fe640 1 --2- 172.21.15.50:0/3765572426 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f28d406d260 0x7f28d40b6610 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f28c402b830 tx=0x7f28c40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:20:46.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.030+0000 7f28bbfff640 1 -- 172.21.15.50:0/3765572426 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c4042020 con 0x7f28d406d260 2024-04-15T00:20:46.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.030+0000 7f28bbfff640 1 -- 172.21.15.50:0/3765572426 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28c403d680 con 0x7f28d406d260 2024-04-15T00:20:46.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.030+0000 7f28d9bbb640 1 -- 172.21.15.50:0/3765572426 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28d40b22e0 con 0x7f28d406d260 2024-04-15T00:20:46.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.030+0000 7f28bbfff640 1 -- 172.21.15.50:0/3765572426 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c4038040 con 0x7f28d406d260 2024-04-15T00:20:46.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.030+0000 7f28d9bbb640 1 -- 172.21.15.50:0/3765572426 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f28d40b1230 con 0x7f28d406d260 2024-04-15T00:20:46.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.031+0000 7f28bbfff640 1 -- 172.21.15.50:0/3765572426 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f28c4045020 con 0x7f28d406d260 2024-04-15T00:20:46.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.031+0000 7f28bbfff640 1 -- 172.21.15.50:0/3765572426 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f28c403e410 con 0x7f28d406d260 2024-04-15T00:20:46.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.032+0000 7f28d9bbb640 1 -- 172.21.15.50:0/3765572426 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28d404f540 con 0x7f28d406d260 2024-04-15T00:20:46.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.034+0000 7f28bbfff640 1 -- 172.21.15.50:0/3765572426 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f28c404c030 con 0x7f28d406d260 2024-04-15T00:20:46.136 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-15T00:20:46.129+0000 7fb73ec11040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-15T00:20:46.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.162+0000 7f28d9bbb640 1 -- 172.21.15.50:0/3765572426 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd new", "uuid": "20df7a76-245f-4946-9624-6ca9e949227b", "id": 6} v 0) -- 0x7f28d40ba3d0 con 0x7f28d406d260 2024-04-15T00:20:46.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.167+0000 7f28bbfff640 1 -- 172.21.15.50:0/3765572426 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "20df7a76-245f-4946-9624-6ca9e949227b", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f28c4033440 con 0x7f28d406d260 2024-04-15T00:20:46.175 INFO:teuthology.orchestra.run.smithi050.stdout:6 2024-04-15T00:20:46.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.168+0000 7f28d9bbb640 1 -- 172.21.15.50:0/3765572426 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f28d406d260 msgr2=0x7f28d40b6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:46.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.168+0000 7f28d9bbb640 1 --2- 172.21.15.50:0/3765572426 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f28d406d260 0x7f28d40b6610 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f28c402b830 tx=0x7f28c40046c0 comp rx=0 tx=0).stop 2024-04-15T00:20:46.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.168+0000 7f28d9bbb640 1 -- 172.21.15.50:0/3765572426 shutdown_connections 2024-04-15T00:20:46.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.168+0000 7f28d9bbb640 1 --2- 172.21.15.50:0/3765572426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28d4072b40 0x7f28d4137c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:46.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.168+0000 7f28d9bbb640 1 --2- 172.21.15.50:0/3765572426 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28d40726b0 0x7f28d41dd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:46.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.168+0000 7f28d9bbb640 1 --2- 172.21.15.50:0/3765572426 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f28d406d260 0x7f28d40b6610 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:46.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.168+0000 7f28d9bbb640 1 -- 172.21.15.50:0/3765572426 >> 172.21.15.50:0/3765572426 conn(0x7f28d40b9ba0 msgr2=0x7f28d40b8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:20:46.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.168+0000 7f28d9bbb640 1 -- 172.21.15.50:0/3765572426 shutdown_connections 2024-04-15T00:20:46.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.168+0000 7f28d9bbb640 1 -- 172.21.15.50:0/3765572426 wait complete. 2024-04-15T00:20:46.186 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 95a504b7-e13a-49e6-8484-9dff4d5fc048 7 2024-04-15T00:20:46.278 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-15T00:20:46.271+0000 7fb73ec11040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-15T00:20:46.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.280+0000 7f111c2c8640 1 Processor -- start 2024-04-15T00:20:46.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.280+0000 7f111c2c8640 1 -- start start 2024-04-15T00:20:46.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.281+0000 7f111c2c8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1114070e10 0x7f1114144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:46.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.281+0000 7f111c2c8640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1114145100 con 0x7f1114144cd0 2024-04-15T00:20:46.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.281+0000 7f111c2c8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11140703e0 con 0x7f1114071680 2024-04-15T00:20:46.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.281+0000 7f111c2c8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f1114071270 con 0x7f1114070e10 2024-04-15T00:20:46.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.281+0000 7f111a064640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1114071680 0x7f111413e290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35854/0 (socket says 172.21.15.50:35854) 2024-04-15T00:20:46.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.281+0000 7f111a064640 1 -- 172.21.15.50:0/2873993063 learned_addr learned my addr 172.21.15.50:0/2873993063 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-04-15T00:20:46.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.281+0000 7f1119863640 1 --2- 172.21.15.50:0/2873993063 >> v2:172.21.15.31:3300/0 conn(0x7f1114070e10 0x7f1114144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:46.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.281+0000 7f1119062640 1 -- 172.21.15.50:0/2873993063 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2035097197 0 0) 0x7f11140703e0 con 0x7f1114071680 2024-04-15T00:20:46.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.281+0000 7f1119062640 1 -- 172.21.15.50:0/2873993063 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1100003520 con 0x7f1114071680 2024-04-15T00:20:46.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.281+0000 7f1119863640 1 -- 172.21.15.50:0/2873993063 >> v1:172.21.15.50:6789/0 conn(0x7f1114071680 legacy=0x7f111413e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:46.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.281+0000 7f1119863640 1 -- 172.21.15.50:0/2873993063 >> v1:172.21.15.31:6789/0 conn(0x7f1114144cd0 legacy=0x7f111414ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:46.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.281+0000 7f1119863640 1 -- 172.21.15.50:0/2873993063 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11140706c0 con 0x7f1114070e10 2024-04-15T00:20:46.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.282+0000 7f1119863640 1 --2- 172.21.15.50:0/2873993063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1114070e10 0x7f1114144790 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f11100097a0 tx=0x7f111002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=215245683b4ced8a server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:20:46.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.282+0000 7f1119062640 1 -- 172.21.15.50:0/2873993063 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1110035020 con 0x7f1114070e10 2024-04-15T00:20:46.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.282+0000 7f1119062640 1 -- 172.21.15.50:0/2873993063 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1110031830 con 0x7f1114070e10 2024-04-15T00:20:46.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.282+0000 7f1119062640 1 -- 172.21.15.50:0/2873993063 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1110031c00 con 0x7f1114070e10 2024-04-15T00:20:46.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.283+0000 7f111c2c8640 1 -- 172.21.15.50:0/2873993063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1114070e10 msgr2=0x7f1114144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:46.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.283+0000 7f111c2c8640 1 --2- 172.21.15.50:0/2873993063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1114070e10 0x7f1114144790 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f11100097a0 tx=0x7f111002b8d0 comp rx=0 tx=0).stop 2024-04-15T00:20:46.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.283+0000 7f111c2c8640 1 -- 172.21.15.50:0/2873993063 shutdown_connections 2024-04-15T00:20:46.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.283+0000 7f111c2c8640 1 --2- 172.21.15.50:0/2873993063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1114070e10 0x7f1114144790 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:46.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.283+0000 7f111c2c8640 1 -- 172.21.15.50:0/2873993063 >> 172.21.15.50:0/2873993063 conn(0x7f111406b200 msgr2=0x7f111406b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:20:46.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.283+0000 7f111c2c8640 1 -- 172.21.15.50:0/2873993063 shutdown_connections 2024-04-15T00:20:46.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.283+0000 7f111c2c8640 1 -- 172.21.15.50:0/2873993063 wait complete. 2024-04-15T00:20:46.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.284+0000 7f111c2c8640 1 Processor -- start 2024-04-15T00:20:46.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.284+0000 7f111c2c8640 1 -- start start 2024-04-15T00:20:46.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.285+0000 7f111c2c8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1114070e10 0x7f11141cead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:46.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.285+0000 7f111c2c8640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1114071680 0x7f11140b8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:46.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.285+0000 7f111c2c8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1114144cd0 0x7f11140b7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:46.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.285+0000 7f111c2c8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f111406e150 con 0x7f1114070e10 2024-04-15T00:20:46.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.285+0000 7f111c2c8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1114071a60 con 0x7f1114144cd0 2024-04-15T00:20:46.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.285+0000 7f111c2c8640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f111413e9a0 con 0x7f1114071680 2024-04-15T00:20:46.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.285+0000 7f1119863640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1114071680 0x7f11140b8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:46.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.285+0000 7f111a865640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1114144cd0 0x7f11140b7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:46.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.285+0000 7f1119863640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1114071680 0x7f11140b8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.50:52034/0 (socket says 172.21.15.50:52034) 2024-04-15T00:20:46.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.285+0000 7f1119863640 1 -- 172.21.15.50:0/188096945 learned_addr learned my addr 172.21.15.50:0/188096945 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-04-15T00:20:46.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.285+0000 7f111a064640 1 --2- 172.21.15.50:0/188096945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1114070e10 0x7f11141cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:46.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.285+0000 7f1119863640 1 -- 172.21.15.50:0/188096945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1114144cd0 msgr2=0x7f11140b7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:46.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.285+0000 7f1119863640 1 --2- 172.21.15.50:0/188096945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1114144cd0 0x7f11140b7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:46.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.285+0000 7f1119863640 1 -- 172.21.15.50:0/188096945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1114070e10 msgr2=0x7f11141cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:46.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.285+0000 7f1119863640 1 --2- 172.21.15.50:0/188096945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1114070e10 0x7f11141cead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:46.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.285+0000 7f1119863640 1 -- 172.21.15.50:0/188096945 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1114141cc0 con 0x7f1114071680 2024-04-15T00:20:46.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.285+0000 7f111a865640 1 --2- 172.21.15.50:0/188096945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1114144cd0 0x7f11140b7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:20:46.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.285+0000 7f111a064640 1 --2- 172.21.15.50:0/188096945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1114070e10 0x7f11141cead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:20:46.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.285+0000 7f1119863640 1 --2- 172.21.15.50:0/188096945 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1114071680 0x7f11140b8e10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f111002bee0 tx=0x7f11100046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:20:46.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.286+0000 7f110affd640 1 -- 172.21.15.50:0/188096945 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1110035040 con 0x7f1114071680 2024-04-15T00:20:46.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.286+0000 7f110affd640 1 -- 172.21.15.50:0/188096945 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f111003b920 con 0x7f1114071680 2024-04-15T00:20:46.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.286+0000 7f111c2c8640 1 -- 172.21.15.50:0/188096945 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1114140410 con 0x7f1114071680 2024-04-15T00:20:46.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.286+0000 7f110affd640 1 -- 172.21.15.50:0/188096945 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111003bd10 con 0x7f1114071680 2024-04-15T00:20:46.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.286+0000 7f111c2c8640 1 -- 172.21.15.50:0/188096945 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f11141409d0 con 0x7f1114071680 2024-04-15T00:20:46.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.286+0000 7f110affd640 1 -- 172.21.15.50:0/188096945 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1110038020 con 0x7f1114071680 2024-04-15T00:20:46.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.286+0000 7f110affd640 1 -- 172.21.15.50:0/188096945 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f111004fa50 con 0x7f1114071680 2024-04-15T00:20:46.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.287+0000 7f111c2c8640 1 -- 172.21.15.50:0/188096945 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11140b3260 con 0x7f1114071680 2024-04-15T00:20:46.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.289+0000 7f110affd640 1 -- 172.21.15.50:0/188096945 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f1110054020 con 0x7f1114071680 2024-04-15T00:20:46.308 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-04-15T00:20:46.301+0000 7f544403e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-15T00:20:46.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.362+0000 7f111c2c8640 1 -- 172.21.15.50:0/188096945 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd new", "uuid": "95a504b7-e13a-49e6-8484-9dff4d5fc048", "id": 7} v 0) -- 0x7f1114140ba0 con 0x7f1114071680 2024-04-15T00:20:46.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.368+0000 7f110affd640 1 -- 172.21.15.50:0/188096945 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "95a504b7-e13a-49e6-8484-9dff4d5fc048", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f11100469a0 con 0x7f1114071680 2024-04-15T00:20:46.375 INFO:teuthology.orchestra.run.smithi050.stdout:7 2024-04-15T00:20:46.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.368+0000 7f111c2c8640 1 -- 172.21.15.50:0/188096945 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1114071680 msgr2=0x7f11140b8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:46.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.368+0000 7f111c2c8640 1 --2- 172.21.15.50:0/188096945 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1114071680 0x7f11140b8e10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f111002bee0 tx=0x7f11100046c0 comp rx=0 tx=0).stop 2024-04-15T00:20:46.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.368+0000 7f111c2c8640 1 -- 172.21.15.50:0/188096945 shutdown_connections 2024-04-15T00:20:46.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.368+0000 7f111c2c8640 1 --2- 172.21.15.50:0/188096945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1114144cd0 0x7f11140b7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:46.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.368+0000 7f111c2c8640 1 --2- 172.21.15.50:0/188096945 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1114071680 0x7f11140b8e10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:46.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.368+0000 7f111c2c8640 1 --2- 172.21.15.50:0/188096945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1114070e10 0x7f11141cead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:46.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.368+0000 7f111c2c8640 1 -- 172.21.15.50:0/188096945 >> 172.21.15.50:0/188096945 conn(0x7f111406b200 msgr2=0x7f1114142860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:20:46.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.369+0000 7f111c2c8640 1 -- 172.21.15.50:0/188096945 shutdown_connections 2024-04-15T00:20:46.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-04-15T00:20:46.369+0000 7f111c2c8640 1 -- 172.21.15.50:0/188096945 wait complete. 2024-04-15T00:20:46.387 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-15T00:20:46.387 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-15T00:20:46.391 INFO:tasks.ceph.osd.0:Started 2024-04-15T00:20:46.391 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-15T00:20:46.391 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-15T00:20:46.395 INFO:tasks.ceph.osd.1:Started 2024-04-15T00:20:46.395 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-15T00:20:46.395 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-15T00:20:46.397 INFO:tasks.ceph.osd.2:Started 2024-04-15T00:20:46.397 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-15T00:20:46.397 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-15T00:20:46.400 INFO:tasks.ceph.osd.3:Started 2024-04-15T00:20:46.400 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-15T00:20:46.400 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-15T00:20:46.402 INFO:tasks.ceph.osd.4:Started 2024-04-15T00:20:46.402 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-15T00:20:46.402 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-15T00:20:46.404 INFO:tasks.ceph.osd.5:Started 2024-04-15T00:20:46.404 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-15T00:20:46.404 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-15T00:20:46.406 INFO:tasks.ceph.osd.6:Started 2024-04-15T00:20:46.406 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-15T00:20:46.407 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-15T00:20:46.408 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-15T00:20:46.401+0000 7fb73ec11040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-15T00:20:46.409 INFO:tasks.ceph.osd.7:Started 2024-04-15T00:20:46.409 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:20:46.480 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-04-15T00:20:46.472+0000 7f544403e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-15T00:20:46.485 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-15T00:20:46.478+0000 7fb73ec11040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-15T00:20:46.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.523+0000 7fcdf63cf640 1 Processor -- start 2024-04-15T00:20:46.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.523+0000 7fcdf63cf640 1 -- start start 2024-04-15T00:20:46.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.524+0000 7fcdf63cf640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdf00b8be0 0x7fcdf0072570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:46.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.524+0000 7fcdf63cf640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcdf014b4c0 0x7fcdf01449c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:46.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.524+0000 7fcdf63cf640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdf0072c90 con 0x7fcdf00b80d0 2024-04-15T00:20:46.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.524+0000 7fcdf63cf640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fcdf009c0e0 con 0x7fcdf014b4c0 2024-04-15T00:20:46.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.524+0000 7fcdf63cf640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fcdf00b84b0 con 0x7fcdf00b8be0 2024-04-15T00:20:46.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.524+0000 7fcdf496c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcdf014b4c0 0x7fcdf01449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:46.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.524+0000 7fcdef7fe640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdf00b8be0 0x7fcdf0072570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:46.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.524+0000 7fcdeffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcdf00b80d0 0x7fcdf014adb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.31:53948/0 (socket says 172.21.15.31:53948) 2024-04-15T00:20:46.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.524+0000 7fcdeffff640 1 -- 172.21.15.31:0/2387735247 learned_addr learned my addr 172.21.15.31:0/2387735247 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:20:46.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.524+0000 7fcdeeffd640 1 -- 172.21.15.31:0/2387735247 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4244456919 0 0) 0x7fcdf0072c90 con 0x7fcdf00b80d0 2024-04-15T00:20:46.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.524+0000 7fcdef7fe640 1 -- 172.21.15.31:0/2387735247 >> v2:172.21.15.31:3300/0 conn(0x7fcdf014b4c0 msgr2=0x7fcdf01449c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:20:46.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.524+0000 7fcdef7fe640 1 --2- 172.21.15.31:0/2387735247 >> v2:172.21.15.31:3300/0 conn(0x7fcdf014b4c0 0x7fcdf01449c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:46.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.524+0000 7fcdef7fe640 1 -- 172.21.15.31:0/2387735247 >> v1:172.21.15.50:6789/0 conn(0x7fcdf00b80d0 legacy=0x7fcdf014adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:46.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.524+0000 7fcdef7fe640 1 -- 172.21.15.31:0/2387735247 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdf009c380 con 0x7fcdf00b8be0 2024-04-15T00:20:46.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.525+0000 7fcdef7fe640 1 --2- 172.21.15.31:0/2387735247 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdf00b8be0 0x7fcdf0072570 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcde00097a0 tx=0x7fcde002b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68101dee53fae23 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:20:46.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.525+0000 7fcdeeffd640 1 -- 172.21.15.31:0/2387735247 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde0038070 con 0x7fcdf00b8be0 2024-04-15T00:20:46.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.525+0000 7fcdeeffd640 1 -- 172.21.15.31:0/2387735247 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcde0031700 con 0x7fcdf00b8be0 2024-04-15T00:20:46.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.525+0000 7fcdeeffd640 1 -- 172.21.15.31:0/2387735247 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde0031ad0 con 0x7fcdf00b8be0 2024-04-15T00:20:46.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.526+0000 7fcdf63cf640 1 -- 172.21.15.31:0/2387735247 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdf00b8be0 msgr2=0x7fcdf0072570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:46.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.526+0000 7fcdf63cf640 1 --2- 172.21.15.31:0/2387735247 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdf00b8be0 0x7fcdf0072570 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcde00097a0 tx=0x7fcde002b7a0 comp rx=0 tx=0).stop 2024-04-15T00:20:46.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.526+0000 7fcdf63cf640 1 -- 172.21.15.31:0/2387735247 shutdown_connections 2024-04-15T00:20:46.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.526+0000 7fcdf63cf640 1 --2- 172.21.15.31:0/2387735247 >> v2:172.21.15.31:3300/0 conn(0x7fcdf014b4c0 0x7fcdf01449c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:46.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.526+0000 7fcdf63cf640 1 --2- 172.21.15.31:0/2387735247 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdf00b8be0 0x7fcdf0072570 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:46.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.526+0000 7fcdf63cf640 1 -- 172.21.15.31:0/2387735247 >> 172.21.15.31:0/2387735247 conn(0x7fcdf00bd020 msgr2=0x7fcdf00bd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:20:46.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.526+0000 7fcdf63cf640 1 -- 172.21.15.31:0/2387735247 shutdown_connections 2024-04-15T00:20:46.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.526+0000 7fcdf63cf640 1 -- 172.21.15.31:0/2387735247 wait complete. 2024-04-15T00:20:46.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.527+0000 7fcdf63cf640 1 Processor -- start 2024-04-15T00:20:46.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.527+0000 7fcdf63cf640 1 -- start start 2024-04-15T00:20:46.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.528+0000 7fcdf63cf640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdf00b80d0 0x7fcdf01e08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:46.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.528+0000 7fcdf63cf640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdf00b8be0 0x7fcdf01d1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:46.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.528+0000 7fcdf63cf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdf014b4c0 0x7fcdf01d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:46.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.528+0000 7fcdf63cf640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf0145080 con 0x7fcdf00b80d0 2024-04-15T00:20:46.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.528+0000 7fcdf63cf640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf0144f00 con 0x7fcdf014b4c0 2024-04-15T00:20:46.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.528+0000 7fcdf63cf640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fcdf0145200 con 0x7fcdf00b8be0 2024-04-15T00:20:46.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.528+0000 7fcdeffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdf00b80d0 0x7fcdf01e08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:46.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.528+0000 7fcdeffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdf00b80d0 0x7fcdf01e08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52662/0 (socket says 172.21.15.31:52662) 2024-04-15T00:20:46.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.528+0000 7fcdef7fe640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdf00b8be0 0x7fcdf01d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:46.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.528+0000 7fcdeffff640 1 -- 172.21.15.31:0/481777120 learned_addr learned my addr 172.21.15.31:0/481777120 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:20:46.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.528+0000 7fcdf496c640 1 --2- 172.21.15.31:0/481777120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdf014b4c0 0x7fcdf01d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:46.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.528+0000 7fcdeffff640 1 -- 172.21.15.31:0/481777120 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdf00b8be0 msgr2=0x7fcdf01d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:46.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.528+0000 7fcdeffff640 1 --2- 172.21.15.31:0/481777120 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdf00b8be0 0x7fcdf01d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:46.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.528+0000 7fcdeffff640 1 -- 172.21.15.31:0/481777120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdf014b4c0 msgr2=0x7fcdf01d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:46.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.528+0000 7fcdeffff640 1 --2- 172.21.15.31:0/481777120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdf014b4c0 0x7fcdf01d16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:46.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.528+0000 7fcdeffff640 1 -- 172.21.15.31:0/481777120 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdf00b6730 con 0x7fcdf00b80d0 2024-04-15T00:20:46.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.528+0000 7fcdef7fe640 1 --2- 172.21.15.31:0/481777120 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdf00b8be0 0x7fcdf01d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:20:46.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.528+0000 7fcdeffff640 1 --2- 172.21.15.31:0/481777120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdf00b80d0 0x7fcdf01e08b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcde400c4a0 tx=0x7fcde400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:20:46.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.528+0000 7fcdecff9640 1 -- 172.21.15.31:0/481777120 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde4018070 con 0x7fcdf00b80d0 2024-04-15T00:20:46.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.528+0000 7fcdecff9640 1 -- 172.21.15.31:0/481777120 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcde40074e0 con 0x7fcdf00b80d0 2024-04-15T00:20:46.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.528+0000 7fcdecff9640 1 -- 172.21.15.31:0/481777120 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde4004a20 con 0x7fcdf00b80d0 2024-04-15T00:20:46.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.528+0000 7fcdf63cf640 1 -- 172.21.15.31:0/481777120 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdf01d3980 con 0x7fcdf00b80d0 2024-04-15T00:20:46.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.529+0000 7fcdf63cf640 1 -- 172.21.15.31:0/481777120 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdf00b6ea0 con 0x7fcdf00b80d0 2024-04-15T00:20:46.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.529+0000 7fcdecff9640 1 -- 172.21.15.31:0/481777120 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcde4004bc0 con 0x7fcdf00b80d0 2024-04-15T00:20:46.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.529+0000 7fcdecff9640 1 -- 172.21.15.31:0/481777120 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fcde401ba30 con 0x7fcdf00b80d0 2024-04-15T00:20:46.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.529+0000 7fcdf63cf640 1 -- 172.21.15.31:0/481777120 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdf009f730 con 0x7fcdf00b80d0 2024-04-15T00:20:46.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.532+0000 7fcdecff9640 1 -- 172.21.15.31:0/481777120 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fcde4021070 con 0x7fcdf00b80d0 2024-04-15T00:20:46.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.593+0000 7fcdf63cf640 1 -- 172.21.15.31:0/481777120 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcdf004f620 con 0x7fcdf00b80d0 2024-04-15T00:20:46.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.594+0000 7fcdecff9640 1 -- 172.21.15.31:0/481777120 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fcde401bd00 con 0x7fcdf00b80d0 2024-04-15T00:20:46.602 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:20:46.602 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":10,"fsid":"b57c03ab-2810-4ea5-b233-6164468328c0","created":"2024-04-15T00:20:44.073217+0000","modified":"2024-04-15T00:20:46.364541+0000","last_up_change":"0.000000","last_in_change":"2024-04-15T00:20:46.364541+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b085a2f4-5565-4ccc-a98e-e56180791550","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0f751557-3f18-464f-8b78-614d19549f0f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"17371b09-2bd7-4ef7-926f-e7706319f064","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"315b6949-f009-4291-9581-aa4912642dd5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e3659369-cc78-4aa8-bd10-a199d4a1569d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"35c3a4c0-0b45-45d2-85b9-301c347602f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"20df7a76-245f-4946-9624-6ca9e949227b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"95a504b7-e13a-49e6-8484-9dff4d5fc048","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:20:46.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.595+0000 7fcdf63cf640 1 -- 172.21.15.31:0/481777120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdf00b80d0 msgr2=0x7fcdf01e08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:46.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.595+0000 7fcdf63cf640 1 --2- 172.21.15.31:0/481777120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdf00b80d0 0x7fcdf01e08b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcde400c4a0 tx=0x7fcde400c960 comp rx=0 tx=0).stop 2024-04-15T00:20:46.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.595+0000 7fcdf63cf640 1 -- 172.21.15.31:0/481777120 shutdown_connections 2024-04-15T00:20:46.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.595+0000 7fcdf63cf640 1 --2- 172.21.15.31:0/481777120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdf014b4c0 0x7fcdf01d16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:46.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.595+0000 7fcdf63cf640 1 --2- 172.21.15.31:0/481777120 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcdf00b8be0 0x7fcdf01d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:46.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.595+0000 7fcdf63cf640 1 --2- 172.21.15.31:0/481777120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdf00b80d0 0x7fcdf01e08b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:46.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.595+0000 7fcdf63cf640 1 -- 172.21.15.31:0/481777120 >> 172.21.15.31:0/481777120 conn(0x7fcdf00bd020 msgr2=0x7fcdf00b9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:20:46.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.595+0000 7fcdf63cf640 1 -- 172.21.15.31:0/481777120 shutdown_connections 2024-04-15T00:20:46.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:20:46.595+0000 7fcdf63cf640 1 -- 172.21.15.31:0/481777120 wait complete. 2024-04-15T00:20:46.605 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-04-15T00:20:46.598+0000 7f544403e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-15T00:20:46.607 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-15T00:20:46.600+0000 7fb73ec11040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-15T00:20:46.613 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-15T00:20:46.613 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-15T00:20:46.652 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-04-15T00:20:46.645+0000 7f544403e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-15T00:20:46.707 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-15T00:20:46.700+0000 7fb73ec11040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-15T00:20:46.769 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-04-15T00:20:46.762+0000 7f544403e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-15T00:20:46.868 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-04-15T00:20:46.861+0000 7f544403e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-15T00:20:46.869 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-15T00:20:46.862+0000 7fb73ec11040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-15T00:20:46.913 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-15T00:20:46.906+0000 7fb73ec11040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-15T00:20:47.001 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-04-15T00:20:46.994+0000 7f51134f9640 -1 Falling back to public interface 2024-04-15T00:20:47.005 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-04-15T00:20:46.998+0000 7f3d803bd640 -1 Falling back to public interface 2024-04-15T00:20:47.010 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-04-15T00:20:47.003+0000 7f5ad5593640 -1 Falling back to public interface 2024-04-15T00:20:47.017 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-04-15T00:20:47.010+0000 7f1b8d689640 -1 Falling back to public interface 2024-04-15T00:20:47.018 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-04-15T00:20:47.010+0000 7f16e3d6b640 -1 Falling back to public interface 2024-04-15T00:20:47.020 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-15T00:20:47.013+0000 7f597ae21640 -1 Falling back to public interface 2024-04-15T00:20:47.029 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-04-15T00:20:47.022+0000 7f544403e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-15T00:20:47.030 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-15T00:20:47.023+0000 7fab2b773640 -1 Falling back to public interface 2024-04-15T00:20:47.034 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-04-15T00:20:47.027+0000 7fb353668640 -1 Falling back to public interface 2024-04-15T00:20:47.077 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-15T00:20:47.069+0000 7fb73ec11040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-15T00:20:47.077 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-04-15T00:20:47.070+0000 7f544403e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-15T00:20:47.240 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-04-15T00:20:47.233+0000 7f544403e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-15T00:20:47.419 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-15T00:20:47.510 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.503+0000 7f8809e84640 1 Processor -- start 2024-04-15T00:20:47.511 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.503+0000 7f8809e84640 1 -- start start 2024-04-15T00:20:47.512 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.504+0000 7f8809e84640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f88040b4000 0x7f88040726f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:47.513 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.504+0000 7f8809e84640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88040b4c80 0x7f88040b5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:47.513 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.504+0000 7f8809e84640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f880413fd10 con 0x7f88040b62a0 2024-04-15T00:20:47.513 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.504+0000 7f8809e84640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f88040b0ec0 con 0x7f88040b4000 2024-04-15T00:20:47.513 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.504+0000 7f8809e84640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f88040b0870 con 0x7f88040b4c80 2024-04-15T00:20:47.513 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.504+0000 7f8802ffd640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88040b4c80 0x7f88040b5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:47.513 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.504+0000 7f88037fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f88040b4000 0x7f88040726f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:47.513 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.504+0000 7f8802ffd640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88040b4c80 0x7f88040b5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.31:41026/0 (socket says 172.21.15.31:41026) 2024-04-15T00:20:47.513 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.504+0000 7f8802ffd640 1 -- 172.21.15.31:0/2044326168 learned_addr learned my addr 172.21.15.31:0/2044326168 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:20:47.513 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.504+0000 7f8803fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f88040b62a0 0x7f880406b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.31:53952/0 (socket says 172.21.15.31:53952) 2024-04-15T00:20:47.513 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.504+0000 7f8802ffd640 1 -- 172.21.15.31:0/2044326168 >> v2:172.21.15.50:3300/0 conn(0x7f88040b4000 msgr2=0x7f88040726f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:20:47.513 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.504+0000 7f8802ffd640 1 --2- 172.21.15.31:0/2044326168 >> v2:172.21.15.50:3300/0 conn(0x7f88040b4000 0x7f88040726f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:47.513 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.504+0000 7f8802ffd640 1 -- 172.21.15.31:0/2044326168 >> v1:172.21.15.50:6789/0 conn(0x7f88040b62a0 legacy=0x7f880406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:47.513 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.504+0000 7f8802ffd640 1 -- 172.21.15.31:0/2044326168 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88040b0b50 con 0x7f88040b4c80 2024-04-15T00:20:47.513 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.504+0000 7f88037fe640 1 --2- 172.21.15.31:0/2044326168 >> v2:172.21.15.50:3300/0 conn(0x7f88040b4000 0x7f88040726f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:20:47.514 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.505+0000 7f8802ffd640 1 --2- 172.21.15.31:0/2044326168 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88040b4c80 0x7f88040b5d60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009870 tx=0x7f87f402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e67aa30360e124d server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:20:47.514 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.505+0000 7f88027fc640 1 -- 172.21.15.31:0/2044326168 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f4034070 con 0x7f88040b4c80 2024-04-15T00:20:47.514 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.505+0000 7f88027fc640 1 -- 172.21.15.31:0/2044326168 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87f4030840 con 0x7f88040b4c80 2024-04-15T00:20:47.514 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.505+0000 7f88027fc640 1 -- 172.21.15.31:0/2044326168 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f4030c10 con 0x7f88040b4c80 2024-04-15T00:20:47.517 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.506+0000 7f8809e84640 1 -- 172.21.15.31:0/2044326168 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88040b4c80 msgr2=0x7f88040b5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:47.517 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.506+0000 7f8809e84640 1 --2- 172.21.15.31:0/2044326168 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88040b4c80 0x7f88040b5d60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009870 tx=0x7f87f402b980 comp rx=0 tx=0).stop 2024-04-15T00:20:47.517 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.506+0000 7f8809e84640 1 -- 172.21.15.31:0/2044326168 shutdown_connections 2024-04-15T00:20:47.517 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.506+0000 7f8809e84640 1 --2- 172.21.15.31:0/2044326168 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88040b4c80 0x7f88040b5d60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:47.517 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.506+0000 7f8809e84640 1 --2- 172.21.15.31:0/2044326168 >> v2:172.21.15.50:3300/0 conn(0x7f88040b4000 0x7f88040726f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:47.517 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.506+0000 7f8809e84640 1 -- 172.21.15.31:0/2044326168 >> 172.21.15.31:0/2044326168 conn(0x7f88040b68c0 msgr2=0x7f88040b6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:20:47.517 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.506+0000 7f8809e84640 1 -- 172.21.15.31:0/2044326168 shutdown_connections 2024-04-15T00:20:47.517 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.506+0000 7f8809e84640 1 -- 172.21.15.31:0/2044326168 wait complete. 2024-04-15T00:20:47.517 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.507+0000 7f8809e84640 1 Processor -- start 2024-04-15T00:20:47.517 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.507+0000 7f8809e84640 1 -- start start 2024-04-15T00:20:47.518 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.508+0000 7f8809e84640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88040b4000 0x7f88040afd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:47.518 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.508+0000 7f8809e84640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88040b4c80 0x7f88041dc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:47.518 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.508+0000 7f8809e84640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88040b62a0 0x7f8804144a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:47.518 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.508+0000 7f8809e84640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8804072c30 con 0x7f88040b62a0 2024-04-15T00:20:47.518 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.508+0000 7f8809e84640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f88040b55b0 con 0x7f88040b4000 2024-04-15T00:20:47.518 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.508+0000 7f8809e84640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f8804072db0 con 0x7f88040b4c80 2024-04-15T00:20:47.518 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.508+0000 7f8803fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88040b62a0 0x7f8804144a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:47.518 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.508+0000 7f8802ffd640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88040b4c80 0x7f88041dc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:47.518 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.508+0000 7f88037fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88040b4000 0x7f88040afd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:47.518 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.508+0000 7f8802ffd640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88040b4c80 0x7f88041dc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.31:41042/0 (socket says 172.21.15.31:41042) 2024-04-15T00:20:47.518 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.508+0000 7f8803fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88040b62a0 0x7f8804144a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52668/0 (socket says 172.21.15.31:52668) 2024-04-15T00:20:47.518 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.508+0000 7f8802ffd640 1 -- 172.21.15.31:0/2716358766 learned_addr learned my addr 172.21.15.31:0/2716358766 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:20:47.518 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.508+0000 7f8802ffd640 1 -- 172.21.15.31:0/2716358766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88040b4000 msgr2=0x7f88040afd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:47.518 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.508+0000 7f8802ffd640 1 --2- 172.21.15.31:0/2716358766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88040b4000 0x7f88040afd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:47.519 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.508+0000 7f8802ffd640 1 -- 172.21.15.31:0/2716358766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88040b62a0 msgr2=0x7f8804144a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:47.519 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.508+0000 7f8802ffd640 1 --2- 172.21.15.31:0/2716358766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88040b62a0 0x7f8804144a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:47.519 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.508+0000 7f8802ffd640 1 -- 172.21.15.31:0/2716358766 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88040ae580 con 0x7f88040b4c80 2024-04-15T00:20:47.519 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.508+0000 7f88037fe640 1 --2- 172.21.15.31:0/2716358766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88040b4000 0x7f88040afd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:20:47.519 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.509+0000 7f8802ffd640 1 --2- 172.21.15.31:0/2716358766 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88040b4c80 0x7f88041dc950 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f87f4000c00 tx=0x7f87f4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:20:47.519 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.509+0000 7f87fbfff640 1 -- 172.21.15.31:0/2716358766 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f4048070 con 0x7f88040b4c80 2024-04-15T00:20:47.519 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.509+0000 7f87fbfff640 1 -- 172.21.15.31:0/2716358766 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87f4030640 con 0x7f88040b4c80 2024-04-15T00:20:47.519 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.509+0000 7f8809e84640 1 -- 172.21.15.31:0/2716358766 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88040ae860 con 0x7f88040b4c80 2024-04-15T00:20:47.519 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.509+0000 7f87fbfff640 1 -- 172.21.15.31:0/2716358766 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f4034040 con 0x7f88040b4c80 2024-04-15T00:20:47.519 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.509+0000 7f8809e84640 1 -- 172.21.15.31:0/2716358766 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f88041dd3c0 con 0x7f88040b4c80 2024-04-15T00:20:47.519 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.509+0000 7f87fbfff640 1 -- 172.21.15.31:0/2716358766 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f87f404b070 con 0x7f88040b4c80 2024-04-15T00:20:47.519 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.509+0000 7f87fbfff640 1 -- 172.21.15.31:0/2716358766 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f87f4043ae0 con 0x7f88040b4c80 2024-04-15T00:20:47.519 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.510+0000 7f8809e84640 1 -- 172.21.15.31:0/2716358766 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f880404f540 con 0x7f88040b4c80 2024-04-15T00:20:47.520 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.512+0000 7f87fbfff640 1 -- 172.21.15.31:0/2716358766 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f87f4030810 con 0x7f88040b4c80 2024-04-15T00:20:47.582 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.575+0000 7f8809e84640 1 -- 172.21.15.31:0/2716358766 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f88040747f0 con 0x7f88040b4c80 2024-04-15T00:20:47.583 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.575+0000 7f87fbfff640 1 -- 172.21.15.31:0/2716358766 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f87f404d440 con 0x7f88040b4c80 2024-04-15T00:20:47.583 INFO:teuthology.misc.health.smithi031.stdout: 2024-04-15T00:20:47.583 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":10,"fsid":"b57c03ab-2810-4ea5-b233-6164468328c0","created":"2024-04-15T00:20:44.073217+0000","modified":"2024-04-15T00:20:46.364541+0000","last_up_change":"0.000000","last_in_change":"2024-04-15T00:20:46.364541+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b085a2f4-5565-4ccc-a98e-e56180791550","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0f751557-3f18-464f-8b78-614d19549f0f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"17371b09-2bd7-4ef7-926f-e7706319f064","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"315b6949-f009-4291-9581-aa4912642dd5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e3659369-cc78-4aa8-bd10-a199d4a1569d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"35c3a4c0-0b45-45d2-85b9-301c347602f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"20df7a76-245f-4946-9624-6ca9e949227b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"95a504b7-e13a-49e6-8484-9dff4d5fc048","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:20:47.584 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.576+0000 7f8809e84640 1 -- 172.21.15.31:0/2716358766 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88040b4c80 msgr2=0x7f88041dc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:47.584 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.576+0000 7f8809e84640 1 --2- 172.21.15.31:0/2716358766 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88040b4c80 0x7f88041dc950 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f87f4000c00 tx=0x7f87f4004730 comp rx=0 tx=0).stop 2024-04-15T00:20:47.585 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.576+0000 7f8809e84640 1 -- 172.21.15.31:0/2716358766 shutdown_connections 2024-04-15T00:20:47.585 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.576+0000 7f8809e84640 1 --2- 172.21.15.31:0/2716358766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88040b62a0 0x7f8804144a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:47.585 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.576+0000 7f8809e84640 1 --2- 172.21.15.31:0/2716358766 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f88040b4c80 0x7f88041dc950 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:47.585 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.576+0000 7f8809e84640 1 --2- 172.21.15.31:0/2716358766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88040b4000 0x7f88040afd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:47.585 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.576+0000 7f8809e84640 1 -- 172.21.15.31:0/2716358766 >> 172.21.15.31:0/2716358766 conn(0x7f88040b68c0 msgr2=0x7f88040b8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:20:47.585 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.576+0000 7f8809e84640 1 -- 172.21.15.31:0/2716358766 shutdown_connections 2024-04-15T00:20:47.585 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:47.576+0000 7f8809e84640 1 -- 172.21.15.31:0/2716358766 wait complete. 2024-04-15T00:20:47.593 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-15T00:20:47.923 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-15T00:20:47.916+0000 7fb73ec11040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-15T00:20:48.090 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-04-15T00:20:48.083+0000 7f544403e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-15T00:20:48.213 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-15T00:20:48.206+0000 7fb73ec11040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-15T00:20:48.266 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-15T00:20:48.259+0000 7fb73ec11040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-15T00:20:48.380 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-04-15T00:20:48.373+0000 7f544403e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-15T00:20:48.387 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-15T00:20:48.379+0000 7fb73ec11040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-15T00:20:48.437 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-04-15T00:20:48.430+0000 7f544403e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-15T00:20:48.557 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-04-15T00:20:48.550+0000 7f544403e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-15T00:20:49.402 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-15T00:20:49.395+0000 7fb6dfe64640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-15T00:20:49.403 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-15T00:20:49.396+0000 7fb6dfe64640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-15T00:20:50.474 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-04-15T00:20:50.467+0000 7f3d803bd640 -1 osd.4 0 log_to_monitors true 2024-04-15T00:20:50.519 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-04-15T00:20:50.512+0000 7f5ad5593640 -1 osd.5 0 log_to_monitors true 2024-04-15T00:20:50.529 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-04-15T00:20:50.521+0000 7f1b8d689640 -1 osd.6 0 log_to_monitors true 2024-04-15T00:20:50.531 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-04-15T00:20:50.523+0000 7f16e3d6b640 -1 osd.1 0 log_to_monitors true 2024-04-15T00:20:50.531 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-15T00:20:50.524+0000 7f597ae21640 -1 osd.0 0 log_to_monitors true 2024-04-15T00:20:50.532 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-04-15T00:20:50.525+0000 7f51134f9640 -1 osd.2 0 log_to_monitors true 2024-04-15T00:20:50.535 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-04-15T00:20:50.528+0000 7fb353668640 -1 osd.7 0 log_to_monitors true 2024-04-15T00:20:50.538 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-15T00:20:50.531+0000 7fab2b773640 -1 osd.3 0 log_to_monitors true 2024-04-15T00:20:53.811 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-04-15T00:20:53.804+0000 7f1b893f7640 -1 osd.6 0 waiting for initial osdmap 2024-04-15T00:20:53.826 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-04-15T00:20:53.819+0000 7f1b81228640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T00:20:53.867 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-04-15T00:20:53.860+0000 7f5ad11f7640 -1 osd.5 0 waiting for initial osdmap 2024-04-15T00:20:53.876 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-04-15T00:20:53.869+0000 7fb34f3f7640 -1 osd.7 0 waiting for initial osdmap 2024-04-15T00:20:53.878 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-04-15T00:20:53.871+0000 7f5ac9080640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T00:20:53.883 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-04-15T00:20:53.876+0000 7f3d7c7f8640 -1 osd.4 0 waiting for initial osdmap 2024-04-15T00:20:53.887 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-04-15T00:20:53.880+0000 7fb347217640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T00:20:53.900 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-04-15T00:20:53.893+0000 7f3d73e80640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T00:20:54.351 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-04-15T00:20:54.343+0000 7f16df9f7640 -1 osd.1 0 waiting for initial osdmap 2024-04-15T00:20:54.365 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-04-15T00:20:54.358+0000 7f16d7880640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T00:20:54.400 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-15T00:20:54.522 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-15T00:20:54.513+0000 7fab273f7640 -1 osd.3 0 waiting for initial osdmap 2024-04-15T00:20:54.535 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.528+0000 7f53106b7640 1 Processor -- start 2024-04-15T00:20:54.536 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.528+0000 7f53106b7640 1 -- start start 2024-04-15T00:20:54.537 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.529+0000 7f53106b7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5308141c20 0x7f5308153000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:54.537 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.529+0000 7f53106b7640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53080b52f0 con 0x7f53080b3c90 2024-04-15T00:20:54.537 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.529+0000 7f53106b7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53080b61b0 con 0x7f53080b5dd0 2024-04-15T00:20:54.537 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.529+0000 7f53106b7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f53080b5590 con 0x7f5308141c20 2024-04-15T00:20:54.537 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.529+0000 7f530dc52640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f53080b3c90 0x7f5308141510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:44738/0 (socket says 172.21.15.31:44738) 2024-04-15T00:20:54.537 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.529+0000 7f530dc52640 1 -- 172.21.15.31:0/2639378657 learned_addr learned my addr 172.21.15.31:0/2639378657 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:20:54.538 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.529+0000 7f530ec54640 1 --2- 172.21.15.31:0/2639378657 >> v2:172.21.15.50:3300/0 conn(0x7f5308141c20 0x7f5308153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:54.538 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.530+0000 7f530d451640 1 -- 172.21.15.31:0/2639378657 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 721802836 0 0) 0x7f53080b52f0 con 0x7f53080b3c90 2024-04-15T00:20:54.538 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.530+0000 7f530d451640 1 -- 172.21.15.31:0/2639378657 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52f4003520 con 0x7f53080b3c90 2024-04-15T00:20:54.538 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.530+0000 7f530ec54640 1 -- 172.21.15.31:0/2639378657 >> v1:172.21.15.50:6789/0 conn(0x7f53080b5dd0 legacy=0x7f53080b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:54.538 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.530+0000 7f530ec54640 1 -- 172.21.15.31:0/2639378657 >> v1:172.21.15.31:6789/0 conn(0x7f53080b3c90 legacy=0x7f5308141510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:54.538 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.530+0000 7f530ec54640 1 -- 172.21.15.31:0/2639378657 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53080b3490 con 0x7f5308141c20 2024-04-15T00:20:54.538 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-15T00:20:54.530+0000 7fab1f280640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T00:20:54.540 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.531+0000 7f530ec54640 1 --2- 172.21.15.31:0/2639378657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5308141c20 0x7f5308153000 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5300009d90 tx=0x7f530002bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8df95429a025edab server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:20:54.540 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.531+0000 7f530d451640 1 -- 172.21.15.31:0/2639378657 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5300039070 con 0x7f5308141c20 2024-04-15T00:20:54.540 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.531+0000 7f530d451640 1 -- 172.21.15.31:0/2639378657 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f530002cc70 con 0x7f5308141c20 2024-04-15T00:20:54.540 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.531+0000 7f530d451640 1 -- 172.21.15.31:0/2639378657 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5300034660 con 0x7f5308141c20 2024-04-15T00:20:54.540 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.532+0000 7f53106b7640 1 -- 172.21.15.31:0/2639378657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5308141c20 msgr2=0x7f5308153000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:54.540 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.532+0000 7f53106b7640 1 --2- 172.21.15.31:0/2639378657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5308141c20 0x7f5308153000 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5300009d90 tx=0x7f530002bec0 comp rx=0 tx=0).stop 2024-04-15T00:20:54.540 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.532+0000 7f53106b7640 1 -- 172.21.15.31:0/2639378657 shutdown_connections 2024-04-15T00:20:54.540 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.532+0000 7f53106b7640 1 --2- 172.21.15.31:0/2639378657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5308141c20 0x7f5308153000 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:54.540 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.532+0000 7f53106b7640 1 -- 172.21.15.31:0/2639378657 >> 172.21.15.31:0/2639378657 conn(0x7f5308073040 msgr2=0x7f53080b99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:20:54.540 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.532+0000 7f53106b7640 1 -- 172.21.15.31:0/2639378657 shutdown_connections 2024-04-15T00:20:54.540 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.532+0000 7f53106b7640 1 -- 172.21.15.31:0/2639378657 wait complete. 2024-04-15T00:20:54.541 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-04-15T00:20:54.532+0000 7f510f1f7640 -1 osd.2 0 waiting for initial osdmap 2024-04-15T00:20:54.541 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.533+0000 7f53106b7640 1 Processor -- start 2024-04-15T00:20:54.541 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.534+0000 7f53106b7640 1 -- start start 2024-04-15T00:20:54.544 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.534+0000 7f53106b7640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f53080b3c90 0x7f5308142850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:54.544 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.534+0000 7f53106b7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53080b5dd0 0x7f53081dd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:54.544 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.534+0000 7f53106b7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5308141c20 0x7f53081dd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:54.544 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.535+0000 7f53106b7640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f53080b4110 con 0x7f53080b5dd0 2024-04-15T00:20:54.544 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.535+0000 7f53106b7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f53080b3800 con 0x7f5308141c20 2024-04-15T00:20:54.544 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.535+0000 7f53106b7640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f53080b4f00 con 0x7f53080b3c90 2024-04-15T00:20:54.544 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.535+0000 7f530dc52640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53080b5dd0 0x7f53081dd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:54.544 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.535+0000 7f530dc52640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53080b5dd0 0x7f53081dd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35338/0 (socket says 172.21.15.31:35338) 2024-04-15T00:20:54.544 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.535+0000 7f530dc52640 1 -- 172.21.15.31:0/2540686324 learned_addr learned my addr 172.21.15.31:0/2540686324 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:20:54.544 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.535+0000 7f530ec54640 1 --2- 172.21.15.31:0/2540686324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5308141c20 0x7f53081dd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:54.544 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.535+0000 7f530e453640 1 --2- 172.21.15.31:0/2540686324 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f53080b3c90 0x7f5308142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:54.544 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.535+0000 7f530ec54640 1 -- 172.21.15.31:0/2540686324 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f53080b3c90 msgr2=0x7f5308142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:54.545 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.535+0000 7f530ec54640 1 --2- 172.21.15.31:0/2540686324 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f53080b3c90 0x7f5308142850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:54.545 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.535+0000 7f530ec54640 1 -- 172.21.15.31:0/2540686324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53080b5dd0 msgr2=0x7f53081dd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:54.545 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.535+0000 7f530ec54640 1 --2- 172.21.15.31:0/2540686324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53080b5dd0 0x7f53081dd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:54.545 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.535+0000 7f530ec54640 1 -- 172.21.15.31:0/2540686324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53081439a0 con 0x7f5308141c20 2024-04-15T00:20:54.545 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.535+0000 7f530dc52640 1 --2- 172.21.15.31:0/2540686324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53080b5dd0 0x7f53081dd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:20:54.545 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.535+0000 7f530e453640 1 --2- 172.21.15.31:0/2540686324 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f53080b3c90 0x7f5308142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:20:54.545 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.535+0000 7f530ec54640 1 --2- 172.21.15.31:0/2540686324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5308141c20 0x7f53081dd560 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5300033000 tx=0x7f5300004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:20:54.545 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.536+0000 7f52feffd640 1 -- 172.21.15.31:0/2540686324 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5300039050 con 0x7f5308141c20 2024-04-15T00:20:54.545 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.536+0000 7f52feffd640 1 -- 172.21.15.31:0/2540686324 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5300045070 con 0x7f5308141c20 2024-04-15T00:20:54.545 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.536+0000 7f52feffd640 1 -- 172.21.15.31:0/2540686324 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5300009450 con 0x7f5308141c20 2024-04-15T00:20:54.545 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.536+0000 7f53106b7640 1 -- 172.21.15.31:0/2540686324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53081446f0 con 0x7f5308141c20 2024-04-15T00:20:54.545 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.536+0000 7f53106b7640 1 -- 172.21.15.31:0/2540686324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5308143130 con 0x7f5308141c20 2024-04-15T00:20:54.546 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.538+0000 7f53106b7640 1 -- 172.21.15.31:0/2540686324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f530804f540 con 0x7f5308141c20 2024-04-15T00:20:54.546 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.538+0000 7f52feffd640 1 -- 172.21.15.31:0/2540686324 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) ==== 90098+0+0 (secure 0 0 0) 0x7f530003e850 con 0x7f5308141c20 2024-04-15T00:20:54.546 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.538+0000 7f52feffd640 1 --2- 172.21.15.31:0/2540686324 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f52ec06b950 0x7f52ec06de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:20:54.546 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.538+0000 7f52feffd640 1 -- 172.21.15.31:0/2540686324 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3631+0+0 (secure 0 0 0) 0x7f53000acc10 con 0x7f5308141c20 2024-04-15T00:20:54.547 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.538+0000 7f530e453640 1 --2- 172.21.15.31:0/2540686324 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f52ec06b950 0x7f52ec06de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:20:54.547 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.539+0000 7f530e453640 1 --2- 172.21.15.31:0/2540686324 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f52ec06b950 0x7f52ec06de10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5304000f60 tx=0x7f5304009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:20:54.550 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.543+0000 7f52feffd640 1 -- 172.21.15.31:0/2540686324 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f530002ce20 con 0x7f5308141c20 2024-04-15T00:20:54.554 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-04-15T00:20:54.547+0000 7f5107080640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T00:20:54.596 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-15T00:20:54.588+0000 7f59765f7640 -1 osd.0 0 waiting for initial osdmap 2024-04-15T00:20:54.609 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-15T00:20:54.602+0000 7f596e417640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T00:20:54.734 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.727+0000 7f53106b7640 1 -- 172.21.15.31:0/2540686324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f53080b43c0 con 0x7f5308141c20 2024-04-15T00:20:54.735 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.728+0000 7f52feffd640 1 -- 172.21.15.31:0/2540686324 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+9439 (secure 0 0 0) 0x7f530007c3b0 con 0x7f5308141c20 2024-04-15T00:20:54.735 INFO:teuthology.misc.health.smithi031.stdout: 2024-04-15T00:20:54.735 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":13,"fsid":"b57c03ab-2810-4ea5-b233-6164468328c0","created":"2024-04-15T00:20:44.073217+0000","modified":"2024-04-15T00:20:54.467755+0000","last_up_change":"2024-04-15T00:20:54.467755+0000","last_in_change":"2024-04-15T00:20:46.364541+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b085a2f4-5565-4ccc-a98e-e56180791550","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0f751557-3f18-464f-8b78-614d19549f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6809","nonce":2705297130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6811","nonce":2705297130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6815","nonce":2705297130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6813","nonce":2705297130}]},"public_addr":"172.21.15.31:6809/2705297130","cluster_addr":"172.21.15.31:6811/2705297130","heartbeat_back_addr":"172.21.15.31:6815/2705297130","heartbeat_front_addr":"172.21.15.31:6813/2705297130","state":["exists","up"]},{"osd":2,"uuid":"17371b09-2bd7-4ef7-926f-e7706319f064","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"315b6949-f009-4291-9581-aa4912642dd5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e3659369-cc78-4aa8-bd10-a199d4a1569d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6801","nonce":1279970071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6803","nonce":1279970071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6807","nonce":1279970071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6805","nonce":1279970071}]},"public_addr":"172.21.15.50:6801/1279970071","cluster_addr":"172.21.15.50:6803/1279970071","heartbeat_back_addr":"172.21.15.50:6807/1279970071","heartbeat_front_addr":"172.21.15.50:6805/1279970071","state":["exists","up"]},{"osd":5,"uuid":"35c3a4c0-0b45-45d2-85b9-301c347602f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6809","nonce":1589417182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6811","nonce":1589417182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6815","nonce":1589417182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6813","nonce":1589417182}]},"public_addr":"172.21.15.50:6809/1589417182","cluster_addr":"172.21.15.50:6811/1589417182","heartbeat_back_addr":"172.21.15.50:6815/1589417182","heartbeat_front_addr":"172.21.15.50:6813/1589417182","state":["exists","up"]},{"osd":6,"uuid":"20df7a76-245f-4946-9624-6ca9e949227b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6817","nonce":682288274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6819","nonce":682288274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6823","nonce":682288274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6821","nonce":682288274}]},"public_addr":"172.21.15.50:6817/682288274","cluster_addr":"172.21.15.50:6819/682288274","heartbeat_back_addr":"172.21.15.50:6823/682288274","heartbeat_front_addr":"172.21.15.50:6821/682288274","state":["exists","up"]},{"osd":7,"uuid":"95a504b7-e13a-49e6-8484-9dff4d5fc048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6825","nonce":4129060906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6827","nonce":4129060906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6831","nonce":4129060906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6829","nonce":4129060906}]},"public_addr":"172.21.15.50:6825/4129060906","cluster_addr":"172.21.15.50:6827/4129060906","heartbeat_back_addr":"172.21.15.50:6831/4129060906","heartbeat_front_addr":"172.21.15.50:6829/4129060906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:20:54.737 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.730+0000 7f53106b7640 1 -- 172.21.15.31:0/2540686324 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f52ec06b950 msgr2=0x7f52ec06de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:54.737 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.730+0000 7f53106b7640 1 --2- 172.21.15.31:0/2540686324 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f52ec06b950 0x7f52ec06de10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5304000f60 tx=0x7f5304009040 comp rx=0 tx=0).stop 2024-04-15T00:20:54.737 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.730+0000 7f53106b7640 1 -- 172.21.15.31:0/2540686324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5308141c20 msgr2=0x7f53081dd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:20:54.737 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.730+0000 7f53106b7640 1 --2- 172.21.15.31:0/2540686324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5308141c20 0x7f53081dd560 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5300033000 tx=0x7f5300004a40 comp rx=0 tx=0).stop 2024-04-15T00:20:54.738 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.730+0000 7f53106b7640 1 -- 172.21.15.31:0/2540686324 shutdown_connections 2024-04-15T00:20:54.738 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.730+0000 7f53106b7640 1 --2- 172.21.15.31:0/2540686324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5308141c20 0x7f53081dd560 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:54.738 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.730+0000 7f53106b7640 1 --2- 172.21.15.31:0/2540686324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53080b5dd0 0x7f53081dd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:54.738 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.730+0000 7f53106b7640 1 --2- 172.21.15.31:0/2540686324 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f52ec06b950 0x7f52ec06de10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:54.738 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.730+0000 7f53106b7640 1 --2- 172.21.15.31:0/2540686324 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f53080b3c90 0x7f5308142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:20:54.738 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.730+0000 7f53106b7640 1 -- 172.21.15.31:0/2540686324 >> 172.21.15.31:0/2540686324 conn(0x7f5308073040 msgr2=0x7f53080b45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:20:54.738 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.730+0000 7f53106b7640 1 -- 172.21.15.31:0/2540686324 shutdown_connections 2024-04-15T00:20:54.738 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:20:54.730+0000 7f53106b7640 1 -- 172.21.15.31:0/2540686324 wait complete. 2024-04-15T00:20:54.746 DEBUG:teuthology.misc:5 of 8 OSDs are up 2024-04-15T00:21:01.554 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-15T00:21:01.654 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.647+0000 7fb700f1e640 1 Processor -- start 2024-04-15T00:21:01.655 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.647+0000 7fb700f1e640 1 -- start start 2024-04-15T00:21:01.656 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.648+0000 7fb700f1e640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb6fc0b3c90 0x7fb6fc141510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:01.656 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.648+0000 7fb700f1e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6fc0b52f0 con 0x7fb6fc0b5dd0 2024-04-15T00:21:01.656 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.648+0000 7fb700f1e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6fc0b61b0 con 0x7fb6fc141a50 2024-04-15T00:21:01.656 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.648+0000 7fb700f1e640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fb6fc0b5590 con 0x7fb6fc0b3c90 2024-04-15T00:21:01.656 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.648+0000 7fb6fa59c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb6fc0b5dd0 0x7fb6fc0b47f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:44746/0 (socket says 172.21.15.31:44746) 2024-04-15T00:21:01.656 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.648+0000 7fb6fa59c640 1 -- 172.21.15.31:0/2861574919 learned_addr learned my addr 172.21.15.31:0/2861574919 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:01.657 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.648+0000 7fb6f9d9b640 1 --2- 172.21.15.31:0/2861574919 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb6fc0b3c90 0x7fb6fc141510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:01.657 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.648+0000 7fb6f959a640 1 -- 172.21.15.31:0/2861574919 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3507412662 0 0) 0x7fb6fc0b52f0 con 0x7fb6fc0b5dd0 2024-04-15T00:21:01.657 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.649+0000 7fb6f959a640 1 -- 172.21.15.31:0/2861574919 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6e8003520 con 0x7fb6fc0b5dd0 2024-04-15T00:21:01.657 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.649+0000 7fb6f959a640 1 -- 172.21.15.31:0/2861574919 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1683220525 0 0) 0x7fb6fc0b61b0 con 0x7fb6fc141a50 2024-04-15T00:21:01.657 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.649+0000 7fb6f959a640 1 -- 172.21.15.31:0/2861574919 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6fc0b52f0 con 0x7fb6fc141a50 2024-04-15T00:21:01.657 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.649+0000 7fb6f959a640 1 -- 172.21.15.31:0/2861574919 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1218901516 0 0) 0x7fb6e8003520 con 0x7fb6fc0b5dd0 2024-04-15T00:21:01.657 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.649+0000 7fb6f9d9b640 1 -- 172.21.15.31:0/2861574919 >> v1:172.21.15.50:6789/0 conn(0x7fb6fc141a50 legacy=0x7fb6fc151ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:01.657 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.649+0000 7fb6f9d9b640 1 -- 172.21.15.31:0/2861574919 >> v1:172.21.15.31:6789/0 conn(0x7fb6fc0b5dd0 legacy=0x7fb6fc0b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:01.657 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.649+0000 7fb6f9d9b640 1 -- 172.21.15.31:0/2861574919 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6fc0b3490 con 0x7fb6fc0b3c90 2024-04-15T00:21:01.658 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.650+0000 7fb6f9d9b640 1 --2- 172.21.15.31:0/2861574919 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb6fc0b3c90 0x7fb6fc141510 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40097d0 tx=0x7fb6e402b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65edeab735e32eb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:01.658 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.650+0000 7fb6f959a640 1 -- 172.21.15.31:0/2861574919 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e4037070 con 0x7fb6fc0b3c90 2024-04-15T00:21:01.658 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.650+0000 7fb6f959a640 1 -- 172.21.15.31:0/2861574919 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6e4030510 con 0x7fb6fc0b3c90 2024-04-15T00:21:01.658 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.650+0000 7fb6f959a640 1 -- 172.21.15.31:0/2861574919 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f4001670 con 0x7fb6fc0b3c90 2024-04-15T00:21:01.659 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.650+0000 7fb700f1e640 1 -- 172.21.15.31:0/2861574919 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb6fc0b3c90 msgr2=0x7fb6fc141510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:01.659 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.650+0000 7fb700f1e640 1 --2- 172.21.15.31:0/2861574919 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb6fc0b3c90 0x7fb6fc141510 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40097d0 tx=0x7fb6e402b770 comp rx=0 tx=0).stop 2024-04-15T00:21:01.659 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.650+0000 7fb700f1e640 1 -- 172.21.15.31:0/2861574919 shutdown_connections 2024-04-15T00:21:01.659 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.650+0000 7fb700f1e640 1 --2- 172.21.15.31:0/2861574919 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb6fc0b3c90 0x7fb6fc141510 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:01.659 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.650+0000 7fb700f1e640 1 -- 172.21.15.31:0/2861574919 >> 172.21.15.31:0/2861574919 conn(0x7fb6fc073040 msgr2=0x7fb6fc0b99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:01.659 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.651+0000 7fb700f1e640 1 -- 172.21.15.31:0/2861574919 shutdown_connections 2024-04-15T00:21:01.659 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.651+0000 7fb700f1e640 1 -- 172.21.15.31:0/2861574919 wait complete. 2024-04-15T00:21:01.661 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.652+0000 7fb700f1e640 1 Processor -- start 2024-04-15T00:21:01.661 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.652+0000 7fb700f1e640 1 -- start start 2024-04-15T00:21:01.661 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.652+0000 7fb700f1e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6fc0b3c90 0x7fb6fc143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:01.661 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.652+0000 7fb700f1e640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb6fc0b5dd0 0x7fb6fc142b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:01.661 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.652+0000 7fb700f1e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6fc141a50 0x7fb6fc1dcd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:01.661 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.652+0000 7fb700f1e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb6fc0b4110 con 0x7fb6fc141a50 2024-04-15T00:21:01.661 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.652+0000 7fb700f1e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb6fc0b3800 con 0x7fb6fc0b3c90 2024-04-15T00:21:01.662 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.652+0000 7fb700f1e640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fb6fc0b4f00 con 0x7fb6fc0b5dd0 2024-04-15T00:21:01.662 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.652+0000 7fb6fad9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6fc141a50 0x7fb6fc1dcd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:01.662 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.653+0000 7fb6fad9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6fc141a50 0x7fb6fc1dcd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35370/0 (socket says 172.21.15.31:35370) 2024-04-15T00:21:01.662 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.653+0000 7fb6fad9d640 1 -- 172.21.15.31:0/2983724833 learned_addr learned my addr 172.21.15.31:0/2983724833 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:01.662 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.653+0000 7fb6f9d9b640 1 --2- 172.21.15.31:0/2983724833 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb6fc0b5dd0 0x7fb6fc142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:01.662 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.653+0000 7fb6fa59c640 1 --2- 172.21.15.31:0/2983724833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6fc0b3c90 0x7fb6fc143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:01.662 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.653+0000 7fb6fad9d640 1 -- 172.21.15.31:0/2983724833 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb6fc0b5dd0 msgr2=0x7fb6fc142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:01.662 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.653+0000 7fb6fad9d640 1 --2- 172.21.15.31:0/2983724833 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb6fc0b5dd0 0x7fb6fc142b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:01.662 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.653+0000 7fb6fad9d640 1 -- 172.21.15.31:0/2983724833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6fc0b3c90 msgr2=0x7fb6fc143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:01.662 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.653+0000 7fb6fad9d640 1 --2- 172.21.15.31:0/2983724833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6fc0b3c90 0x7fb6fc143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:01.662 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.653+0000 7fb6fad9d640 1 -- 172.21.15.31:0/2983724833 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6fc1445a0 con 0x7fb6fc141a50 2024-04-15T00:21:01.662 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.653+0000 7fb6fad9d640 1 --2- 172.21.15.31:0/2983724833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6fc141a50 0x7fb6fc1dcd30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec00c7c0 tx=0x7fb6ec00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:01.662 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.653+0000 7fb6f2ffd640 1 -- 172.21.15.31:0/2983724833 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec003b70 con 0x7fb6fc141a50 2024-04-15T00:21:01.662 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.653+0000 7fb6f2ffd640 1 -- 172.21.15.31:0/2983724833 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6ec003d10 con 0x7fb6fc141a50 2024-04-15T00:21:01.662 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.653+0000 7fb700f1e640 1 -- 172.21.15.31:0/2983724833 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6fc143310 con 0x7fb6fc141a50 2024-04-15T00:21:01.663 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.653+0000 7fb6f2ffd640 1 -- 172.21.15.31:0/2983724833 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec00aa50 con 0x7fb6fc141a50 2024-04-15T00:21:01.663 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.653+0000 7fb700f1e640 1 -- 172.21.15.31:0/2983724833 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6fc1dd270 con 0x7fb6fc141a50 2024-04-15T00:21:01.663 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.654+0000 7fb700f1e640 1 -- 172.21.15.31:0/2983724833 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6fc04f540 con 0x7fb6fc141a50 2024-04-15T00:21:01.664 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.655+0000 7fb6f2ffd640 1 -- 172.21.15.31:0/2983724833 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fb6ec00abf0 con 0x7fb6fc141a50 2024-04-15T00:21:01.664 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.655+0000 7fb6f2ffd640 1 --2- 172.21.15.31:0/2983724833 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb6dc06b990 0x7fb6dc06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:01.664 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.655+0000 7fb6f2ffd640 1 -- 172.21.15.31:0/2983724833 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fb6ec08a2d0 con 0x7fb6fc141a50 2024-04-15T00:21:01.664 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.655+0000 7fb6fa59c640 1 --2- 172.21.15.31:0/2983724833 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb6dc06b990 0x7fb6dc06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:01.664 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.656+0000 7fb6fa59c640 1 --2- 172.21.15.31:0/2983724833 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb6dc06b990 0x7fb6dc06de50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb6f40011e0 tx=0x7fb6f4001690 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:01.667 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.660+0000 7fb6f2ffd640 1 -- 172.21.15.31:0/2983724833 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb6ec058c70 con 0x7fb6fc141a50 2024-04-15T00:21:01.850 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.843+0000 7fb700f1e640 1 -- 172.21.15.31:0/2983724833 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb6fc13f500 con 0x7fb6fc141a50 2024-04-15T00:21:01.851 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.844+0000 7fb6f2ffd640 1 -- 172.21.15.31:0/2983724833 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12824 (secure 0 0 0) 0x7fb6ec05cd10 con 0x7fb6fc141a50 2024-04-15T00:21:01.851 INFO:teuthology.misc.health.smithi031.stdout: 2024-04-15T00:21:01.851 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":17,"fsid":"b57c03ab-2810-4ea5-b233-6164468328c0","created":"2024-04-15T00:20:44.073217+0000","modified":"2024-04-15T00:20:58.531703+0000","last_up_change":"2024-04-15T00:20:55.515596+0000","last_in_change":"2024-04-15T00:20:46.364541+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:20:56.423161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b085a2f4-5565-4ccc-a98e-e56180791550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6817","nonce":2355720818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6819","nonce":2355720818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6823","nonce":2355720818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6821","nonce":2355720818}]},"public_addr":"172.21.15.31:6817/2355720818","cluster_addr":"172.21.15.31:6819/2355720818","heartbeat_back_addr":"172.21.15.31:6823/2355720818","heartbeat_front_addr":"172.21.15.31:6821/2355720818","state":["exists","up"]},{"osd":1,"uuid":"0f751557-3f18-464f-8b78-614d19549f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6809","nonce":2705297130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6811","nonce":2705297130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6815","nonce":2705297130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6813","nonce":2705297130}]},"public_addr":"172.21.15.31:6809/2705297130","cluster_addr":"172.21.15.31:6811/2705297130","heartbeat_back_addr":"172.21.15.31:6815/2705297130","heartbeat_front_addr":"172.21.15.31:6813/2705297130","state":["exists","up"]},{"osd":2,"uuid":"17371b09-2bd7-4ef7-926f-e7706319f064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6801","nonce":225061474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6803","nonce":225061474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6807","nonce":225061474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6805","nonce":225061474}]},"public_addr":"172.21.15.31:6801/225061474","cluster_addr":"172.21.15.31:6803/225061474","heartbeat_back_addr":"172.21.15.31:6807/225061474","heartbeat_front_addr":"172.21.15.31:6805/225061474","state":["exists","up"]},{"osd":3,"uuid":"315b6949-f009-4291-9581-aa4912642dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6825","nonce":3722449780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6827","nonce":3722449780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6831","nonce":3722449780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6829","nonce":3722449780}]},"public_addr":"172.21.15.31:6825/3722449780","cluster_addr":"172.21.15.31:6827/3722449780","heartbeat_back_addr":"172.21.15.31:6831/3722449780","heartbeat_front_addr":"172.21.15.31:6829/3722449780","state":["exists","up"]},{"osd":4,"uuid":"e3659369-cc78-4aa8-bd10-a199d4a1569d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6801","nonce":1279970071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6803","nonce":1279970071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6807","nonce":1279970071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6805","nonce":1279970071}]},"public_addr":"172.21.15.50:6801/1279970071","cluster_addr":"172.21.15.50:6803/1279970071","heartbeat_back_addr":"172.21.15.50:6807/1279970071","heartbeat_front_addr":"172.21.15.50:6805/1279970071","state":["exists","up"]},{"osd":5,"uuid":"35c3a4c0-0b45-45d2-85b9-301c347602f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6809","nonce":1589417182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6811","nonce":1589417182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6815","nonce":1589417182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6813","nonce":1589417182}]},"public_addr":"172.21.15.50:6809/1589417182","cluster_addr":"172.21.15.50:6811/1589417182","heartbeat_back_addr":"172.21.15.50:6815/1589417182","heartbeat_front_addr":"172.21.15.50:6813/1589417182","state":["exists","up"]},{"osd":6,"uuid":"20df7a76-245f-4946-9624-6ca9e949227b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6817","nonce":682288274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6819","nonce":682288274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6823","nonce":682288274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6821","nonce":682288274}]},"public_addr":"172.21.15.50:6817/682288274","cluster_addr":"172.21.15.50:6819/682288274","heartbeat_back_addr":"172.21.15.50:6823/682288274","heartbeat_front_addr":"172.21.15.50:6821/682288274","state":["exists","up"]},{"osd":7,"uuid":"95a504b7-e13a-49e6-8484-9dff4d5fc048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6825","nonce":4129060906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6827","nonce":4129060906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6831","nonce":4129060906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6829","nonce":4129060906}]},"public_addr":"172.21.15.50:6825/4129060906","cluster_addr":"172.21.15.50:6827/4129060906","heartbeat_back_addr":"172.21.15.50:6831/4129060906","heartbeat_front_addr":"172.21.15.50:6829/4129060906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.501980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.529961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.540913+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.521396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.448364+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.514136+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.527229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.508950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:21:01.853 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.845+0000 7fb700f1e640 1 -- 172.21.15.31:0/2983724833 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb6dc06b990 msgr2=0x7fb6dc06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:01.853 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.845+0000 7fb700f1e640 1 --2- 172.21.15.31:0/2983724833 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb6dc06b990 0x7fb6dc06de50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb6f40011e0 tx=0x7fb6f4001690 comp rx=0 tx=0).stop 2024-04-15T00:21:01.853 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.845+0000 7fb700f1e640 1 -- 172.21.15.31:0/2983724833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6fc141a50 msgr2=0x7fb6fc1dcd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:01.853 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.845+0000 7fb700f1e640 1 --2- 172.21.15.31:0/2983724833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6fc141a50 0x7fb6fc1dcd30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec00c7c0 tx=0x7fb6ec00cc80 comp rx=0 tx=0).stop 2024-04-15T00:21:01.853 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.845+0000 7fb700f1e640 1 -- 172.21.15.31:0/2983724833 shutdown_connections 2024-04-15T00:21:01.853 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.845+0000 7fb700f1e640 1 --2- 172.21.15.31:0/2983724833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6fc141a50 0x7fb6fc1dcd30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:01.853 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.845+0000 7fb700f1e640 1 --2- 172.21.15.31:0/2983724833 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb6dc06b990 0x7fb6dc06de50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:01.853 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.845+0000 7fb700f1e640 1 --2- 172.21.15.31:0/2983724833 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb6fc0b5dd0 0x7fb6fc142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:01.853 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.845+0000 7fb700f1e640 1 --2- 172.21.15.31:0/2983724833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6fc0b3c90 0x7fb6fc143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:01.854 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.845+0000 7fb700f1e640 1 -- 172.21.15.31:0/2983724833 >> 172.21.15.31:0/2983724833 conn(0x7fb6fc073040 msgr2=0x7fb6fc0b4750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:01.854 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.846+0000 7fb700f1e640 1 -- 172.21.15.31:0/2983724833 shutdown_connections 2024-04-15T00:21:01.854 INFO:teuthology.misc.health.smithi031.stderr:2024-04-15T00:21:01.846+0000 7fb700f1e640 1 -- 172.21.15.31:0/2983724833 wait complete. 2024-04-15T00:21:01.862 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-15T00:21:01.862 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-15T00:21:01.863 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-15T00:21:01.863 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-15T00:21:01.865 INFO:tasks.ceph.mds.a:Started 2024-04-15T00:21:01.865 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-15T00:21:01.865 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-15T00:21:01.868 INFO:tasks.ceph.mds.b:Started 2024-04-15T00:21:01.868 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-15T00:21:01.868 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:21:01.942 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-04-15T00:21:01.954 INFO:tasks.ceph.mds.b.smithi050.stdout:starting mds.b at 2024-04-15T00:21:01.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.965+0000 7f2733b84640 1 Processor -- start 2024-04-15T00:21:01.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.965+0000 7f2733b84640 1 -- start start 2024-04-15T00:21:01.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.966+0000 7f2733b84640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f272c150f90 0x7f272c153380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:01.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.966+0000 7f2733b84640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f272c1476d0 con 0x7f272c0af6a0 2024-04-15T00:21:01.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.966+0000 7f2733b84640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f272c0ba050 con 0x7f272c0b9c70 2024-04-15T00:21:01.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.966+0000 7f2733b84640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f272c0b54b0 con 0x7f272c150f90 2024-04-15T00:21:01.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.966+0000 7f2732121640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f272c150f90 0x7f272c153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:01.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.966+0000 7f273111f640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f272c0af6a0 0x7f272c147e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:44766/0 (socket says 172.21.15.31:44766) 2024-04-15T00:21:01.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.966+0000 7f273111f640 1 -- 172.21.15.31:0/464209380 learned_addr learned my addr 172.21.15.31:0/464209380 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:01.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.966+0000 7f2732121640 1 -- 172.21.15.31:0/464209380 >> v1:172.21.15.50:6789/0 conn(0x7f272c0b9c70 legacy=0x7f272c0ae7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:01.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.966+0000 7f2732121640 1 -- 172.21.15.31:0/464209380 >> v1:172.21.15.31:6789/0 conn(0x7f272c0af6a0 legacy=0x7f272c147e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:01.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.966+0000 7f2732121640 1 -- 172.21.15.31:0/464209380 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f272c0afd00 con 0x7f272c150f90 2024-04-15T00:21:01.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.966+0000 7f273091e640 1 -- 172.21.15.31:0/464209380 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1343740361 0 0) 0x7f272c1476d0 con 0x7f272c0af6a0 2024-04-15T00:21:01.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.967+0000 7f2732121640 1 --2- 172.21.15.31:0/464209380 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f272c150f90 0x7f272c153380 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2724009d90 tx=0x7f272402bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f79a47cf86dced server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:01.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.967+0000 7f273091e640 1 -- 172.21.15.31:0/464209380 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2724039070 con 0x7f272c150f90 2024-04-15T00:21:01.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.967+0000 7f273091e640 1 -- 172.21.15.31:0/464209380 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f272402cb40 con 0x7f272c150f90 2024-04-15T00:21:01.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.967+0000 7f273091e640 1 -- 172.21.15.31:0/464209380 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2724034440 con 0x7f272c150f90 2024-04-15T00:21:01.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.968+0000 7f2733b84640 1 -- 172.21.15.31:0/464209380 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f272c150f90 msgr2=0x7f272c153380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:01.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.968+0000 7f2733b84640 1 --2- 172.21.15.31:0/464209380 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f272c150f90 0x7f272c153380 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2724009d90 tx=0x7f272402bd90 comp rx=0 tx=0).stop 2024-04-15T00:21:01.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.968+0000 7f2733b84640 1 -- 172.21.15.31:0/464209380 shutdown_connections 2024-04-15T00:21:01.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.968+0000 7f2733b84640 1 --2- 172.21.15.31:0/464209380 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f272c150f90 0x7f272c153380 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:01.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.968+0000 7f2733b84640 1 -- 172.21.15.31:0/464209380 >> 172.21.15.31:0/464209380 conn(0x7f272c06b970 msgr2=0x7f272c0b92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:01.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.968+0000 7f2733b84640 1 -- 172.21.15.31:0/464209380 shutdown_connections 2024-04-15T00:21:01.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.968+0000 7f2733b84640 1 -- 172.21.15.31:0/464209380 wait complete. 2024-04-15T00:21:01.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.969+0000 7f2733b84640 1 Processor -- start 2024-04-15T00:21:01.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.969+0000 7f2733b84640 1 -- start start 2024-04-15T00:21:01.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.969+0000 7f2733b84640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f272c0af6a0 0x7f272c06fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:01.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.969+0000 7f2733b84640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f272c0b9c70 0x7f272c1e0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:01.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.969+0000 7f2733b84640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f272c150f90 0x7f272c1e1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:01.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.969+0000 7f2733b84640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f272c0aeee0 con 0x7f272c0af6a0 2024-04-15T00:21:01.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.969+0000 7f2733b84640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f272c0b5700 con 0x7f272c150f90 2024-04-15T00:21:01.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.969+0000 7f2733b84640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f272c148540 con 0x7f272c0b9c70 2024-04-15T00:21:01.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.969+0000 7f2731920640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f272c0af6a0 0x7f272c06fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:01.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.970+0000 7f2731920640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f272c0af6a0 0x7f272c06fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35378/0 (socket says 172.21.15.31:35378) 2024-04-15T00:21:01.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.970+0000 7f2731920640 1 -- 172.21.15.31:0/1255855730 learned_addr learned my addr 172.21.15.31:0/1255855730 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:01.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.970+0000 7f2732121640 1 --2- 172.21.15.31:0/1255855730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f272c150f90 0x7f272c1e1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:01.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.970+0000 7f273111f640 1 --2- 172.21.15.31:0/1255855730 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f272c0b9c70 0x7f272c1e0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:01.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.970+0000 7f2731920640 1 -- 172.21.15.31:0/1255855730 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f272c0b9c70 msgr2=0x7f272c1e0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:01.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.970+0000 7f2731920640 1 --2- 172.21.15.31:0/1255855730 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f272c0b9c70 0x7f272c1e0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:01.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.970+0000 7f2731920640 1 -- 172.21.15.31:0/1255855730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f272c150f90 msgr2=0x7f272c1e1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:01.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.970+0000 7f2731920640 1 --2- 172.21.15.31:0/1255855730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f272c150f90 0x7f272c1e1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:01.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.970+0000 7f2731920640 1 -- 172.21.15.31:0/1255855730 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f272c070ed0 con 0x7f272c0af6a0 2024-04-15T00:21:01.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.970+0000 7f2732121640 1 --2- 172.21.15.31:0/1255855730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f272c150f90 0x7f272c1e1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:01.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.970+0000 7f2731920640 1 --2- 172.21.15.31:0/1255855730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f272c0af6a0 0x7f272c06fb50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f272000c430 tx=0x7f272000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:01.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.970+0000 7f271e7fc640 1 -- 172.21.15.31:0/1255855730 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2720011790 con 0x7f272c0af6a0 2024-04-15T00:21:01.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.970+0000 7f271e7fc640 1 -- 172.21.15.31:0/1255855730 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2720017070 con 0x7f272c0af6a0 2024-04-15T00:21:01.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.970+0000 7f271e7fc640 1 -- 172.21.15.31:0/1255855730 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2720011bb0 con 0x7f272c0af6a0 2024-04-15T00:21:01.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.970+0000 7f2733b84640 1 -- 172.21.15.31:0/1255855730 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f272c13e550 con 0x7f272c0af6a0 2024-04-15T00:21:01.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.970+0000 7f2733b84640 1 -- 172.21.15.31:0/1255855730 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f272c14b8d0 con 0x7f272c0af6a0 2024-04-15T00:21:01.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.971+0000 7f2733b84640 1 -- 172.21.15.31:0/1255855730 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f272c146650 con 0x7f272c0af6a0 2024-04-15T00:21:01.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.971+0000 7f271e7fc640 1 -- 172.21.15.31:0/1255855730 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f272001c460 con 0x7f272c0af6a0 2024-04-15T00:21:01.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.972+0000 7f271e7fc640 1 --2- 172.21.15.31:0/1255855730 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f271006b990 0x7f271006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:01.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.972+0000 7f273111f640 1 --2- 172.21.15.31:0/1255855730 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f271006b990 0x7f271006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:01.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.972+0000 7f271e7fc640 1 -- 172.21.15.31:0/1255855730 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f272008a330 con 0x7f272c0af6a0 2024-04-15T00:21:01.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.972+0000 7f273111f640 1 --2- 172.21.15.31:0/1255855730 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f271006b990 0x7f271006de50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f272c13f6a0 tx=0x7f2728009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:01.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:01.976+0000 7f271e7fc640 1 -- 172.21.15.31:0/1255855730 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2720059320 con 0x7f272c0af6a0 2024-04-15T00:21:02.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.158+0000 7f2733b84640 1 -- 172.21.15.31:0/1255855730 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f272c04f620 con 0x7f272c0af6a0 2024-04-15T00:21:02.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.159+0000 7f271e7fc640 1 -- 172.21.15.31:0/1255855730 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12824 (secure 0 0 0) 0x7f2720058c20 con 0x7f272c0af6a0 2024-04-15T00:21:02.167 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:21:02.167 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":17,"fsid":"b57c03ab-2810-4ea5-b233-6164468328c0","created":"2024-04-15T00:20:44.073217+0000","modified":"2024-04-15T00:20:58.531703+0000","last_up_change":"2024-04-15T00:20:55.515596+0000","last_in_change":"2024-04-15T00:20:46.364541+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:20:56.423161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b085a2f4-5565-4ccc-a98e-e56180791550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6817","nonce":2355720818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6819","nonce":2355720818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6823","nonce":2355720818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6821","nonce":2355720818}]},"public_addr":"172.21.15.31:6817/2355720818","cluster_addr":"172.21.15.31:6819/2355720818","heartbeat_back_addr":"172.21.15.31:6823/2355720818","heartbeat_front_addr":"172.21.15.31:6821/2355720818","state":["exists","up"]},{"osd":1,"uuid":"0f751557-3f18-464f-8b78-614d19549f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6809","nonce":2705297130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6811","nonce":2705297130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6815","nonce":2705297130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6813","nonce":2705297130}]},"public_addr":"172.21.15.31:6809/2705297130","cluster_addr":"172.21.15.31:6811/2705297130","heartbeat_back_addr":"172.21.15.31:6815/2705297130","heartbeat_front_addr":"172.21.15.31:6813/2705297130","state":["exists","up"]},{"osd":2,"uuid":"17371b09-2bd7-4ef7-926f-e7706319f064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6801","nonce":225061474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6803","nonce":225061474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6807","nonce":225061474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6805","nonce":225061474}]},"public_addr":"172.21.15.31:6801/225061474","cluster_addr":"172.21.15.31:6803/225061474","heartbeat_back_addr":"172.21.15.31:6807/225061474","heartbeat_front_addr":"172.21.15.31:6805/225061474","state":["exists","up"]},{"osd":3,"uuid":"315b6949-f009-4291-9581-aa4912642dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6825","nonce":3722449780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6827","nonce":3722449780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6831","nonce":3722449780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6829","nonce":3722449780}]},"public_addr":"172.21.15.31:6825/3722449780","cluster_addr":"172.21.15.31:6827/3722449780","heartbeat_back_addr":"172.21.15.31:6831/3722449780","heartbeat_front_addr":"172.21.15.31:6829/3722449780","state":["exists","up"]},{"osd":4,"uuid":"e3659369-cc78-4aa8-bd10-a199d4a1569d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6801","nonce":1279970071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6803","nonce":1279970071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6807","nonce":1279970071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6805","nonce":1279970071}]},"public_addr":"172.21.15.50:6801/1279970071","cluster_addr":"172.21.15.50:6803/1279970071","heartbeat_back_addr":"172.21.15.50:6807/1279970071","heartbeat_front_addr":"172.21.15.50:6805/1279970071","state":["exists","up"]},{"osd":5,"uuid":"35c3a4c0-0b45-45d2-85b9-301c347602f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6809","nonce":1589417182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6811","nonce":1589417182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6815","nonce":1589417182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6813","nonce":1589417182}]},"public_addr":"172.21.15.50:6809/1589417182","cluster_addr":"172.21.15.50:6811/1589417182","heartbeat_back_addr":"172.21.15.50:6815/1589417182","heartbeat_front_addr":"172.21.15.50:6813/1589417182","state":["exists","up"]},{"osd":6,"uuid":"20df7a76-245f-4946-9624-6ca9e949227b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6817","nonce":682288274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6819","nonce":682288274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6823","nonce":682288274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6821","nonce":682288274}]},"public_addr":"172.21.15.50:6817/682288274","cluster_addr":"172.21.15.50:6819/682288274","heartbeat_back_addr":"172.21.15.50:6823/682288274","heartbeat_front_addr":"172.21.15.50:6821/682288274","state":["exists","up"]},{"osd":7,"uuid":"95a504b7-e13a-49e6-8484-9dff4d5fc048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6825","nonce":4129060906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6827","nonce":4129060906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6831","nonce":4129060906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6829","nonce":4129060906}]},"public_addr":"172.21.15.50:6825/4129060906","cluster_addr":"172.21.15.50:6827/4129060906","heartbeat_back_addr":"172.21.15.50:6831/4129060906","heartbeat_front_addr":"172.21.15.50:6829/4129060906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.501980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.529961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.540913+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.521396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.448364+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.514136+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.527229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.508950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:21:02.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.161+0000 7f2733b84640 1 -- 172.21.15.31:0/1255855730 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f271006b990 msgr2=0x7f271006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:02.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.161+0000 7f2733b84640 1 --2- 172.21.15.31:0/1255855730 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f271006b990 0x7f271006de50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f272c13f6a0 tx=0x7f2728009040 comp rx=0 tx=0).stop 2024-04-15T00:21:02.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.161+0000 7f2733b84640 1 -- 172.21.15.31:0/1255855730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f272c0af6a0 msgr2=0x7f272c06fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:02.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.161+0000 7f2733b84640 1 --2- 172.21.15.31:0/1255855730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f272c0af6a0 0x7f272c06fb50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f272000c430 tx=0x7f272000c8f0 comp rx=0 tx=0).stop 2024-04-15T00:21:02.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.161+0000 7f2733b84640 1 -- 172.21.15.31:0/1255855730 shutdown_connections 2024-04-15T00:21:02.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.161+0000 7f2733b84640 1 --2- 172.21.15.31:0/1255855730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f272c150f90 0x7f272c1e1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:02.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.161+0000 7f2733b84640 1 --2- 172.21.15.31:0/1255855730 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f271006b990 0x7f271006de50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:02.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.161+0000 7f2733b84640 1 --2- 172.21.15.31:0/1255855730 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f272c0b9c70 0x7f272c1e0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:02.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.161+0000 7f2733b84640 1 --2- 172.21.15.31:0/1255855730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f272c0af6a0 0x7f272c06fb50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:02.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.161+0000 7f2733b84640 1 -- 172.21.15.31:0/1255855730 >> 172.21.15.31:0/1255855730 conn(0x7f272c06b970 msgr2=0x7f272c0ae7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:02.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.161+0000 7f2733b84640 1 -- 172.21.15.31:0/1255855730 shutdown_connections 2024-04-15T00:21:02.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.161+0000 7f2733b84640 1 -- 172.21.15.31:0/1255855730 wait complete. 2024-04-15T00:21:02.179 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T00:20:56.423161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-15T00:21:02.180 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T00:21:02.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.276+0000 7fdb8d2de640 1 Processor -- start 2024-04-15T00:21:02.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.276+0000 7fdb8d2de640 1 -- start start 2024-04-15T00:21:02.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.277+0000 7fdb8d2de640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb880b80d0 0x7fdb88072570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:02.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.277+0000 7fdb8d2de640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdb880b8be0 0x7fdb8814adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:02.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.277+0000 7fdb8d2de640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb88072c90 con 0x7fdb8814b2f0 2024-04-15T00:21:02.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.277+0000 7fdb8d2de640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fdb8809c0e0 con 0x7fdb880b8be0 2024-04-15T00:21:02.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.277+0000 7fdb8d2de640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fdb880b84b0 con 0x7fdb880b80d0 2024-04-15T00:21:02.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.277+0000 7fdb867fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdb880b8be0 0x7fdb8814adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:02.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.277+0000 7fdb86ffd640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb880b80d0 0x7fdb88072570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:02.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.277+0000 7fdb877fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdb8814b2f0 0x7fdb881449c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.31:39004/0 (socket says 172.21.15.31:39004) 2024-04-15T00:21:02.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.277+0000 7fdb867fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdb880b8be0 0x7fdb8814adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.31:41960/0 (socket says 172.21.15.31:41960) 2024-04-15T00:21:02.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.277+0000 7fdb877fe640 1 -- 172.21.15.31:0/1924203574 learned_addr learned my addr 172.21.15.31:0/1924203574 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:02.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.277+0000 7fdb86ffd640 1 --2- 172.21.15.31:0/1924203574 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb880b80d0 0x7fdb88072570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.31:47332/0 (socket says 172.21.15.31:47332) 2024-04-15T00:21:02.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.278+0000 7fdb867fc640 1 -- 172.21.15.31:0/1924203574 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb880b80d0 msgr2=0x7fdb88072570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:02.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.278+0000 7fdb867fc640 1 --2- 172.21.15.31:0/1924203574 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb880b80d0 0x7fdb88072570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:02.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.278+0000 7fdb867fc640 1 -- 172.21.15.31:0/1924203574 >> v1:172.21.15.50:6789/0 conn(0x7fdb8814b2f0 legacy=0x7fdb881449c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:02.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.278+0000 7fdb867fc640 1 -- 172.21.15.31:0/1924203574 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb8814b740 con 0x7fdb880b8be0 2024-04-15T00:21:02.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.278+0000 7fdb86ffd640 1 --2- 172.21.15.31:0/1924203574 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb880b80d0 0x7fdb88072570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:21:02.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.278+0000 7fdb867fc640 1 --2- 172.21.15.31:0/1924203574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb880b8be0 0x7fdb8814adb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdb700097a0 tx=0x7fdb7002b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=669b58c3a7556481 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:02.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.279+0000 7fdb85ffb640 1 -- 172.21.15.31:0/1924203574 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb70038070 con 0x7fdb880b8be0 2024-04-15T00:21:02.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.279+0000 7fdb85ffb640 1 -- 172.21.15.31:0/1924203574 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb70031700 con 0x7fdb880b8be0 2024-04-15T00:21:02.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.279+0000 7fdb85ffb640 1 -- 172.21.15.31:0/1924203574 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb70031ad0 con 0x7fdb880b8be0 2024-04-15T00:21:02.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.279+0000 7fdb8d2de640 1 -- 172.21.15.31:0/1924203574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb880b8be0 msgr2=0x7fdb8814adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:02.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.279+0000 7fdb8d2de640 1 --2- 172.21.15.31:0/1924203574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb880b8be0 0x7fdb8814adb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdb700097a0 tx=0x7fdb7002b7a0 comp rx=0 tx=0).stop 2024-04-15T00:21:02.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.279+0000 7fdb8d2de640 1 -- 172.21.15.31:0/1924203574 shutdown_connections 2024-04-15T00:21:02.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.279+0000 7fdb8d2de640 1 --2- 172.21.15.31:0/1924203574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb880b8be0 0x7fdb8814adb0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:02.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.279+0000 7fdb8d2de640 1 --2- 172.21.15.31:0/1924203574 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb880b80d0 0x7fdb88072570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:02.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.279+0000 7fdb8d2de640 1 -- 172.21.15.31:0/1924203574 >> 172.21.15.31:0/1924203574 conn(0x7fdb880bd020 msgr2=0x7fdb880bd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:02.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.279+0000 7fdb8d2de640 1 -- 172.21.15.31:0/1924203574 shutdown_connections 2024-04-15T00:21:02.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.279+0000 7fdb8d2de640 1 -- 172.21.15.31:0/1924203574 wait complete. 2024-04-15T00:21:02.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.280+0000 7fdb8d2de640 1 Processor -- start 2024-04-15T00:21:02.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.280+0000 7fdb8d2de640 1 -- start start 2024-04-15T00:21:02.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.281+0000 7fdb8d2de640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb880b80d0 0x7fdb880b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:02.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.281+0000 7fdb8d2de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb880b8be0 0x7fdb881dcff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:02.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.281+0000 7fdb8d2de640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb8814b2f0 0x7fdb88142e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:02.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.281+0000 7fdb8d2de640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdb881450d0 con 0x7fdb880b80d0 2024-04-15T00:21:02.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.281+0000 7fdb8d2de640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdb880b9620 con 0x7fdb880b8be0 2024-04-15T00:21:02.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.281+0000 7fdb8d2de640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fdb88145250 con 0x7fdb8814b2f0 2024-04-15T00:21:02.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.281+0000 7fdb86ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb880b80d0 0x7fdb880b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:02.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.281+0000 7fdb86ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb880b80d0 0x7fdb880b23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35382/0 (socket says 172.21.15.31:35382) 2024-04-15T00:21:02.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.281+0000 7fdb86ffd640 1 -- 172.21.15.31:0/4273264442 learned_addr learned my addr 172.21.15.31:0/4273264442 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:02.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.281+0000 7fdb867fc640 1 --2- 172.21.15.31:0/4273264442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb880b8be0 0x7fdb881dcff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:02.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.281+0000 7fdb877fe640 1 --2- 172.21.15.31:0/4273264442 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb8814b2f0 0x7fdb88142e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:02.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.281+0000 7fdb86ffd640 1 -- 172.21.15.31:0/4273264442 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb8814b2f0 msgr2=0x7fdb88142e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:02.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.281+0000 7fdb86ffd640 1 --2- 172.21.15.31:0/4273264442 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb8814b2f0 0x7fdb88142e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:02.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.281+0000 7fdb86ffd640 1 -- 172.21.15.31:0/4273264442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb880b8be0 msgr2=0x7fdb881dcff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:02.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.281+0000 7fdb86ffd640 1 --2- 172.21.15.31:0/4273264442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb880b8be0 0x7fdb881dcff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:02.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.281+0000 7fdb86ffd640 1 -- 172.21.15.31:0/4273264442 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb880b34d0 con 0x7fdb880b80d0 2024-04-15T00:21:02.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.281+0000 7fdb86ffd640 1 --2- 172.21.15.31:0/4273264442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb880b80d0 0x7fdb880b23e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdb8000ebe0 tx=0x7fdb8000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:02.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.282+0000 7fdb7f7fe640 1 -- 172.21.15.31:0/4273264442 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb80017070 con 0x7fdb880b80d0 2024-04-15T00:21:02.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.282+0000 7fdb7f7fe640 1 -- 172.21.15.31:0/4273264442 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb8000cc30 con 0x7fdb880b80d0 2024-04-15T00:21:02.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.282+0000 7fdb8d2de640 1 -- 172.21.15.31:0/4273264442 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb881dd950 con 0x7fdb880b80d0 2024-04-15T00:21:02.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.282+0000 7fdb7f7fe640 1 -- 172.21.15.31:0/4273264442 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb80013470 con 0x7fdb880b80d0 2024-04-15T00:21:02.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.282+0000 7fdb8d2de640 1 -- 172.21.15.31:0/4273264442 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb880b3740 con 0x7fdb880b80d0 2024-04-15T00:21:02.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.283+0000 7fdb8d2de640 1 -- 172.21.15.31:0/4273264442 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb881ddd40 con 0x7fdb880b80d0 2024-04-15T00:21:02.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.283+0000 7fdb7f7fe640 1 -- 172.21.15.31:0/4273264442 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fdb8001a070 con 0x7fdb880b80d0 2024-04-15T00:21:02.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.283+0000 7fdb7f7fe640 1 --2- 172.21.15.31:0/4273264442 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fdb6806b990 0x7fdb6806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:02.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.284+0000 7fdb7f7fe640 1 -- 172.21.15.31:0/4273264442 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fdb8008a330 con 0x7fdb880b80d0 2024-04-15T00:21:02.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.284+0000 7fdb867fc640 1 --2- 172.21.15.31:0/4273264442 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fdb6806b990 0x7fdb6806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:02.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.284+0000 7fdb867fc640 1 --2- 172.21.15.31:0/4273264442 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fdb6806b990 0x7fdb6806de50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdb70035000 tx=0x7fdb70008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:02.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.288+0000 7fdb7f7fe640 1 -- 172.21.15.31:0/4273264442 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fdb80058cd0 con 0x7fdb880b80d0 2024-04-15T00:21:02.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.470+0000 7fdb8d2de640 1 -- 172.21.15.31:0/4273264442 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdb881ddb20 con 0x7fdb880b80d0 2024-04-15T00:21:02.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.470+0000 7fdb7f7fe640 1 -- 172.21.15.31:0/4273264442 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7fdb8005cd70 con 0x7fdb880b80d0 2024-04-15T00:21:02.478 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-15T00:21:02.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.472+0000 7fdb8d2de640 1 -- 172.21.15.31:0/4273264442 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fdb6806b990 msgr2=0x7fdb6806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:02.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.472+0000 7fdb8d2de640 1 --2- 172.21.15.31:0/4273264442 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fdb6806b990 0x7fdb6806de50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdb70035000 tx=0x7fdb70008030 comp rx=0 tx=0).stop 2024-04-15T00:21:02.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.472+0000 7fdb8d2de640 1 -- 172.21.15.31:0/4273264442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb880b80d0 msgr2=0x7fdb880b23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:02.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.472+0000 7fdb8d2de640 1 --2- 172.21.15.31:0/4273264442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb880b80d0 0x7fdb880b23e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdb8000ebe0 tx=0x7fdb8000c520 comp rx=0 tx=0).stop 2024-04-15T00:21:02.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.472+0000 7fdb8d2de640 1 -- 172.21.15.31:0/4273264442 shutdown_connections 2024-04-15T00:21:02.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.472+0000 7fdb8d2de640 1 --2- 172.21.15.31:0/4273264442 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fdb6806b990 0x7fdb6806de50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:02.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.472+0000 7fdb8d2de640 1 --2- 172.21.15.31:0/4273264442 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdb8814b2f0 0x7fdb88142e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:02.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.472+0000 7fdb8d2de640 1 --2- 172.21.15.31:0/4273264442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb880b8be0 0x7fdb881dcff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:02.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.472+0000 7fdb8d2de640 1 --2- 172.21.15.31:0/4273264442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb880b80d0 0x7fdb880b23e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:02.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.472+0000 7fdb8d2de640 1 -- 172.21.15.31:0/4273264442 >> 172.21.15.31:0/4273264442 conn(0x7fdb880bd020 msgr2=0x7fdb881494e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:02.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.472+0000 7fdb8d2de640 1 -- 172.21.15.31:0/4273264442 shutdown_connections 2024-04-15T00:21:02.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.472+0000 7fdb8d2de640 1 -- 172.21.15.31:0/4273264442 wait complete. 2024-04-15T00:21:02.490 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T00:21:02.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.585+0000 7f5526aa6640 1 Processor -- start 2024-04-15T00:21:02.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.585+0000 7f5526aa6640 1 -- start start 2024-04-15T00:21:02.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.586+0000 7f5526aa6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f55200b5760 0x7f552006dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:02.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.586+0000 7f5526aa6640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f552006e250 con 0x7f55201485d0 2024-04-15T00:21:02.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.586+0000 7f5526aa6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f552009f980 con 0x7f55200af3c0 2024-04-15T00:21:02.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.586+0000 7f5526aa6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f552009fc60 con 0x7f55200b5760 2024-04-15T00:21:02.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.586+0000 7f5525043640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f55201485d0 0x7f5520151f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57404/0 (socket says 172.21.15.31:57404) 2024-04-15T00:21:02.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.586+0000 7f5525043640 1 -- 172.21.15.31:0/2118048172 learned_addr learned my addr 172.21.15.31:0/2118048172 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:02.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.586+0000 7f5524842640 1 --2- 172.21.15.31:0/2118048172 >> v2:172.21.15.50:3300/0 conn(0x7f55200b5760 0x7f552006dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:02.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.586+0000 7f551f7fe640 1 -- 172.21.15.31:0/2118048172 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 380965183 0 0) 0x7f552006e250 con 0x7f55201485d0 2024-04-15T00:21:02.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.586+0000 7f551f7fe640 1 -- 172.21.15.31:0/2118048172 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5508003520 con 0x7f55201485d0 2024-04-15T00:21:02.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.587+0000 7f551f7fe640 1 -- 172.21.15.31:0/2118048172 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 785714728 0 0) 0x7f5508003520 con 0x7f55201485d0 2024-04-15T00:21:02.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.587+0000 7f551f7fe640 1 -- 172.21.15.31:0/2118048172 >> v2:172.21.15.50:3300/0 conn(0x7f55200b5760 msgr2=0x7f552006dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:02.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.587+0000 7f551f7fe640 1 --2- 172.21.15.31:0/2118048172 >> v2:172.21.15.50:3300/0 conn(0x7f55200b5760 0x7f552006dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:02.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.587+0000 7f551f7fe640 1 -- 172.21.15.31:0/2118048172 >> v1:172.21.15.50:6789/0 conn(0x7f55200af3c0 legacy=0x7f5520147ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:02.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.587+0000 7f551f7fe640 1 -- 172.21.15.31:0/2118048172 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55200aef30 con 0x7f55201485d0 2024-04-15T00:21:02.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.587+0000 7f551f7fe640 1 -- 172.21.15.31:0/2118048172 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 697057150 0 0) 0x7f5510001670 con 0x7f55201485d0 2024-04-15T00:21:02.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.587+0000 7f551f7fe640 1 -- 172.21.15.31:0/2118048172 >> v1:172.21.15.31:6789/0 conn(0x7f55201485d0 legacy=0x7f5520151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:02.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.587+0000 7f551f7fe640 1 --2- 172.21.15.31:0/2118048172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55080039b0 0x7f5508003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:02.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.587+0000 7f551f7fe640 1 --2- 172.21.15.31:0/2118048172 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5508004800 0x7f5508004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:02.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.587+0000 7f551f7fe640 1 --2- 172.21.15.31:0/2118048172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55080051c0 0x7f550800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:02.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.587+0000 7f551f7fe640 1 -- 172.21.15.31:0/2118048172 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f552009fc60 con 0x7f55080039b0 2024-04-15T00:21:02.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.587+0000 7f551f7fe640 1 -- 172.21.15.31:0/2118048172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f550800c060 con 0x7f55080051c0 2024-04-15T00:21:02.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.587+0000 7f551f7fe640 1 -- 172.21.15.31:0/2118048172 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f550800c260 con 0x7f5508004800 2024-04-15T00:21:02.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.587+0000 7f5524842640 1 --2- 172.21.15.31:0/2118048172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55080039b0 0x7f5508003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:02.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.587+0000 7f5525043640 1 --2- 172.21.15.31:0/2118048172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55080051c0 0x7f550800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:02.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.587+0000 7f551ffff640 1 --2- 172.21.15.31:0/2118048172 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5508004800 0x7f5508004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:02.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.587+0000 7f5524842640 1 -- 172.21.15.31:0/2118048172 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5508004800 msgr2=0x7f5508004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:02.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.587+0000 7f5524842640 1 --2- 172.21.15.31:0/2118048172 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5508004800 0x7f5508004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:02.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.587+0000 7f5524842640 1 -- 172.21.15.31:0/2118048172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55080051c0 msgr2=0x7f550800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:02.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.587+0000 7f5524842640 1 --2- 172.21.15.31:0/2118048172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55080051c0 0x7f550800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:02.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.587+0000 7f5524842640 1 -- 172.21.15.31:0/2118048172 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5508003520 con 0x7f55080039b0 2024-04-15T00:21:02.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.587+0000 7f5525043640 1 --2- 172.21.15.31:0/2118048172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55080051c0 0x7f550800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:02.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.587+0000 7f551ffff640 1 --2- 172.21.15.31:0/2118048172 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5508004800 0x7f5508004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:02.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.587+0000 7f5525043640 1 -- 172.21.15.31:0/2118048172 reap_dead start 2024-04-15T00:21:02.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.588+0000 7f5524842640 1 --2- 172.21.15.31:0/2118048172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55080039b0 0x7f5508003dd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5518009fc0 tx=0x7f5508005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e95c6fdf41fb34f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:02.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.588+0000 7f551f7fe640 1 -- 172.21.15.31:0/2118048172 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5518039070 con 0x7f55080039b0 2024-04-15T00:21:02.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.588+0000 7f551f7fe640 1 -- 172.21.15.31:0/2118048172 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f551802cc20 con 0x7f55080039b0 2024-04-15T00:21:02.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.588+0000 7f551f7fe640 1 -- 172.21.15.31:0/2118048172 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5518009c10 con 0x7f55080039b0 2024-04-15T00:21:02.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.588+0000 7f5526aa6640 1 -- 172.21.15.31:0/2118048172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55080039b0 msgr2=0x7f5508003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:02.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.588+0000 7f5526aa6640 1 --2- 172.21.15.31:0/2118048172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55080039b0 0x7f5508003dd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5518009fc0 tx=0x7f5508005830 comp rx=0 tx=0).stop 2024-04-15T00:21:02.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.588+0000 7f5526aa6640 1 -- 172.21.15.31:0/2118048172 shutdown_connections 2024-04-15T00:21:02.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.588+0000 7f5526aa6640 1 --2- 172.21.15.31:0/2118048172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55080039b0 0x7f5508003dd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:02.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.588+0000 7f5526aa6640 1 -- 172.21.15.31:0/2118048172 >> 172.21.15.31:0/2118048172 conn(0x7f552006b200 msgr2=0x7f552006b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:02.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.588+0000 7f5526aa6640 1 -- 172.21.15.31:0/2118048172 shutdown_connections 2024-04-15T00:21:02.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.588+0000 7f5526aa6640 1 -- 172.21.15.31:0/2118048172 wait complete. 2024-04-15T00:21:02.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.589+0000 7f5526aa6640 1 Processor -- start 2024-04-15T00:21:02.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.589+0000 7f5526aa6640 1 -- start start 2024-04-15T00:21:02.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.590+0000 7f5526aa6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55080039b0 0x7f55201e0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:02.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.590+0000 7f5526aa6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55201e11e0 0x7f55201dd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:02.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.590+0000 7f5526aa6640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f55201dd570 0x7f55201dd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:02.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.590+0000 7f5526aa6640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f552009ee10 con 0x7f55201e11e0 2024-04-15T00:21:02.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.590+0000 7f5526aa6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f552009f610 con 0x7f55080039b0 2024-04-15T00:21:02.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.590+0000 7f5526aa6640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f552009ef90 con 0x7f55201dd570 2024-04-15T00:21:02.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.590+0000 7f551ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55201e11e0 0x7f55201dd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:02.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.590+0000 7f551ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55201e11e0 0x7f55201dd030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58520/0 (socket says 172.21.15.31:58520) 2024-04-15T00:21:02.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.590+0000 7f551ffff640 1 -- 172.21.15.31:0/1825761916 learned_addr learned my addr 172.21.15.31:0/1825761916 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:02.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.590+0000 7f5524842640 1 --2- 172.21.15.31:0/1825761916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55080039b0 0x7f55201e0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:02.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.590+0000 7f5525043640 1 --2- 172.21.15.31:0/1825761916 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f55201dd570 0x7f55201dd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:02.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.591+0000 7f551ffff640 1 -- 172.21.15.31:0/1825761916 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f55201dd570 msgr2=0x7f55201dd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:02.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.591+0000 7f551ffff640 1 --2- 172.21.15.31:0/1825761916 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f55201dd570 0x7f55201dd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:02.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.591+0000 7f551ffff640 1 -- 172.21.15.31:0/1825761916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55080039b0 msgr2=0x7f55201e0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:02.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.591+0000 7f551ffff640 1 --2- 172.21.15.31:0/1825761916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55080039b0 0x7f55201e0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:02.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.591+0000 7f551ffff640 1 -- 172.21.15.31:0/1825761916 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55201498f0 con 0x7f55201e11e0 2024-04-15T00:21:02.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.591+0000 7f5524842640 1 --2- 172.21.15.31:0/1825761916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55080039b0 0x7f55201e0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:21:02.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.591+0000 7f5525043640 1 --2- 172.21.15.31:0/1825761916 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f55201dd570 0x7f55201dd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:21:02.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.591+0000 7f551ffff640 1 --2- 172.21.15.31:0/1825761916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55201e11e0 0x7f55201dd030 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5514007fd0 tx=0x7f551400e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:02.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.591+0000 7f551d7fa640 1 -- 172.21.15.31:0/1825761916 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5514019070 con 0x7f55201e11e0 2024-04-15T00:21:02.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.591+0000 7f551d7fa640 1 -- 172.21.15.31:0/1825761916 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55140052e0 con 0x7f55201e11e0 2024-04-15T00:21:02.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.591+0000 7f5526aa6640 1 -- 172.21.15.31:0/1825761916 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5520149bd0 con 0x7f55201e11e0 2024-04-15T00:21:02.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.591+0000 7f551d7fa640 1 -- 172.21.15.31:0/1825761916 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5514003830 con 0x7f55201e11e0 2024-04-15T00:21:02.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.591+0000 7f5526aa6640 1 -- 172.21.15.31:0/1825761916 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55200722f0 con 0x7f55201e11e0 2024-04-15T00:21:02.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.592+0000 7f5526aa6640 1 -- 172.21.15.31:0/1825761916 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f552004f620 con 0x7f55201e11e0 2024-04-15T00:21:02.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.592+0000 7f551d7fa640 1 -- 172.21.15.31:0/1825761916 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f551401c070 con 0x7f55201e11e0 2024-04-15T00:21:02.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.593+0000 7f551d7fa640 1 --2- 172.21.15.31:0/1825761916 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f550c06b9c0 0x7f550c06de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:02.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.593+0000 7f5524842640 1 --2- 172.21.15.31:0/1825761916 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f550c06b9c0 0x7f550c06de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:02.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.593+0000 7f551d7fa640 1 -- 172.21.15.31:0/1825761916 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f5514089920 con 0x7f55201e11e0 2024-04-15T00:21:02.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.593+0000 7f5524842640 1 --2- 172.21.15.31:0/1825761916 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f550c06b9c0 0x7f550c06de80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5518036000 tx=0x7f551802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:02.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.597+0000 7f551d7fa640 1 -- 172.21.15.31:0/1825761916 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f55140582c0 con 0x7f55201e11e0 2024-04-15T00:21:02.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.814+0000 7f5526aa6640 1 -- 172.21.15.31:0/1825761916 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5520143a40 con 0x7f55201e11e0 2024-04-15T00:21:02.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.815+0000 7f551d7fa640 1 -- 172.21.15.31:0/1825761916 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1386 (secure 0 0 0) 0x7f551405c360 con 0x7f55201e11e0 2024-04-15T00:21:02.822 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:21:02.823 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/93464605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":93464605},{"type":"v1","addr":"172.21.15.31:6835","nonce":93464605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-15T00:21:02.823 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 2 2024-04-15T00:21:02.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.817+0000 7f5526aa6640 1 -- 172.21.15.31:0/1825761916 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f550c06b9c0 msgr2=0x7f550c06de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:02.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.817+0000 7f5526aa6640 1 --2- 172.21.15.31:0/1825761916 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f550c06b9c0 0x7f550c06de80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5518036000 tx=0x7f551802e000 comp rx=0 tx=0).stop 2024-04-15T00:21:02.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.817+0000 7f5526aa6640 1 -- 172.21.15.31:0/1825761916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55201e11e0 msgr2=0x7f55201dd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:02.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.817+0000 7f5526aa6640 1 --2- 172.21.15.31:0/1825761916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55201e11e0 0x7f55201dd030 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5514007fd0 tx=0x7f551400e8a0 comp rx=0 tx=0).stop 2024-04-15T00:21:02.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.817+0000 7f5526aa6640 1 -- 172.21.15.31:0/1825761916 shutdown_connections 2024-04-15T00:21:02.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.817+0000 7f5526aa6640 1 --2- 172.21.15.31:0/1825761916 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f550c06b9c0 0x7f550c06de80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:02.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.817+0000 7f5526aa6640 1 --2- 172.21.15.31:0/1825761916 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f55201dd570 0x7f55201dd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:02.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.817+0000 7f5526aa6640 1 --2- 172.21.15.31:0/1825761916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55201e11e0 0x7f55201dd030 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:02.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.817+0000 7f5526aa6640 1 --2- 172.21.15.31:0/1825761916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55080039b0 0x7f55201e0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:02.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.817+0000 7f5526aa6640 1 -- 172.21.15.31:0/1825761916 >> 172.21.15.31:0/1825761916 conn(0x7f552006b200 msgr2=0x7f5520145b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:02.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.817+0000 7f5526aa6640 1 -- 172.21.15.31:0/1825761916 shutdown_connections 2024-04-15T00:21:02.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:02.817+0000 7f5526aa6640 1 -- 172.21.15.31:0/1825761916 wait complete. 2024-04-15T00:21:04.835 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T00:21:04.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.941+0000 7f5c76511640 1 Processor -- start 2024-04-15T00:21:04.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.941+0000 7f5c76511640 1 -- start start 2024-04-15T00:21:04.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.941+0000 7f5c76511640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c7014b570 0x7f5c701414a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:04.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.941+0000 7f5c76511640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5c7006fde0 0x7f5c701419e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:04.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.941+0000 7f5c76511640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c70072a70 con 0x7f5c70072690 2024-04-15T00:21:04.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.941+0000 7f5c76511640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f5c7006efa0 con 0x7f5c7006fde0 2024-04-15T00:21:04.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.941+0000 7f5c76511640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f5c7006f820 con 0x7f5c7014b570 2024-04-15T00:21:04.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.942+0000 7f5c74aae640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5c7006fde0 0x7f5c701419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:04.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.942+0000 7f5c74aae640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5c7006fde0 0x7f5c701419e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58532/0 (socket says 172.21.15.31:58532) 2024-04-15T00:21:04.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.942+0000 7f5c74aae640 1 -- 172.21.15.31:0/4017936022 learned_addr learned my addr 172.21.15.31:0/4017936022 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:04.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.942+0000 7f5c6f7fe640 1 --2- 172.21.15.31:0/4017936022 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c7014b570 0x7f5c701414a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:04.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.942+0000 7f5c74aae640 1 -- 172.21.15.31:0/4017936022 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c7014b570 msgr2=0x7f5c701414a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:04.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.942+0000 7f5c74aae640 1 --2- 172.21.15.31:0/4017936022 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c7014b570 0x7f5c701414a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:04.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.942+0000 7f5c74aae640 1 -- 172.21.15.31:0/4017936022 >> v1:172.21.15.50:6789/0 conn(0x7f5c70072690 legacy=0x7f5c7014ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:04.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.942+0000 7f5c74aae640 1 -- 172.21.15.31:0/4017936022 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c7006f1d0 con 0x7f5c7006fde0 2024-04-15T00:21:04.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.943+0000 7f5c74aae640 1 --2- 172.21.15.31:0/4017936022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c7006fde0 0x7f5c701419e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5c68009e50 tx=0x7f5c6802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fce6a59d2172e4b server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:04.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.943+0000 7f5c6effd640 1 -- 172.21.15.31:0/4017936022 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6802cb00 con 0x7f5c7006fde0 2024-04-15T00:21:04.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.943+0000 7f5c6effd640 1 -- 172.21.15.31:0/4017936022 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c6802cca0 con 0x7f5c7006fde0 2024-04-15T00:21:04.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.943+0000 7f5c6effd640 1 -- 172.21.15.31:0/4017936022 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c68034610 con 0x7f5c7006fde0 2024-04-15T00:21:04.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.943+0000 7f5c76511640 1 -- 172.21.15.31:0/4017936022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c7006fde0 msgr2=0x7f5c701419e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:04.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.943+0000 7f5c76511640 1 --2- 172.21.15.31:0/4017936022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c7006fde0 0x7f5c701419e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5c68009e50 tx=0x7f5c6802bf60 comp rx=0 tx=0).stop 2024-04-15T00:21:04.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.944+0000 7f5c76511640 1 -- 172.21.15.31:0/4017936022 shutdown_connections 2024-04-15T00:21:04.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.944+0000 7f5c76511640 1 --2- 172.21.15.31:0/4017936022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c7006fde0 0x7f5c701419e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:04.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.944+0000 7f5c76511640 1 --2- 172.21.15.31:0/4017936022 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c7014b570 0x7f5c701414a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:04.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.944+0000 7f5c76511640 1 -- 172.21.15.31:0/4017936022 >> 172.21.15.31:0/4017936022 conn(0x7f5c700b7840 msgr2=0x7f5c700b7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:04.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.944+0000 7f5c76511640 1 -- 172.21.15.31:0/4017936022 shutdown_connections 2024-04-15T00:21:04.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.944+0000 7f5c76511640 1 -- 172.21.15.31:0/4017936022 wait complete. 2024-04-15T00:21:04.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.945+0000 7f5c76511640 1 Processor -- start 2024-04-15T00:21:04.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.945+0000 7f5c76511640 1 -- start start 2024-04-15T00:21:04.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.945+0000 7f5c76511640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c7006fde0 0x7f5c701423f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:04.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.945+0000 7f5c76511640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c70072690 0x7f5c701dd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:04.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.945+0000 7f5c76511640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c7014b570 0x7f5c70138dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:04.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.945+0000 7f5c76511640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5c700b58c0 con 0x7f5c7014b570 2024-04-15T00:21:04.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.945+0000 7f5c76511640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5c700b5740 con 0x7f5c70072690 2024-04-15T00:21:04.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.945+0000 7f5c76511640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f5c700b74a0 con 0x7f5c7006fde0 2024-04-15T00:21:04.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.946+0000 7f5c74aae640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c7014b570 0x7f5c70138dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:04.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.946+0000 7f5c74aae640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c7014b570 0x7f5c70138dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58548/0 (socket says 172.21.15.31:58548) 2024-04-15T00:21:04.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.946+0000 7f5c74aae640 1 -- 172.21.15.31:0/4045570590 learned_addr learned my addr 172.21.15.31:0/4045570590 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:04.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.946+0000 7f5c6f7fe640 1 --2- 172.21.15.31:0/4045570590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c70072690 0x7f5c701dd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:04.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.946+0000 7f5c6ffff640 1 --2- 172.21.15.31:0/4045570590 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c7006fde0 0x7f5c701423f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:04.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.946+0000 7f5c74aae640 1 -- 172.21.15.31:0/4045570590 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c7006fde0 msgr2=0x7f5c701423f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:04.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.946+0000 7f5c74aae640 1 --2- 172.21.15.31:0/4045570590 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c7006fde0 0x7f5c701423f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:04.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.946+0000 7f5c74aae640 1 -- 172.21.15.31:0/4045570590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c70072690 msgr2=0x7f5c701dd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:04.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.946+0000 7f5c74aae640 1 --2- 172.21.15.31:0/4045570590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c70072690 0x7f5c701dd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:04.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.946+0000 7f5c74aae640 1 -- 172.21.15.31:0/4045570590 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c7014a480 con 0x7f5c7014b570 2024-04-15T00:21:04.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.946+0000 7f5c74aae640 1 --2- 172.21.15.31:0/4045570590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c7014b570 0x7f5c70138dd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5c68009e50 tx=0x7f5c68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:04.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.946+0000 7f5c6cff9640 1 -- 172.21.15.31:0/4045570590 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c68043020 con 0x7f5c7014b570 2024-04-15T00:21:04.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.946+0000 7f5c6cff9640 1 -- 172.21.15.31:0/4045570590 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c6802ce50 con 0x7f5c7014b570 2024-04-15T00:21:04.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.946+0000 7f5c76511640 1 -- 172.21.15.31:0/4045570590 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c701436b0 con 0x7f5c7014b570 2024-04-15T00:21:04.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.946+0000 7f5c6cff9640 1 -- 172.21.15.31:0/4045570590 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c68009510 con 0x7f5c7014b570 2024-04-15T00:21:04.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.946+0000 7f5c76511640 1 -- 172.21.15.31:0/4045570590 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c70148460 con 0x7f5c7014b570 2024-04-15T00:21:04.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.947+0000 7f5c76511640 1 -- 172.21.15.31:0/4045570590 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c7013e2c0 con 0x7f5c7014b570 2024-04-15T00:21:04.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.948+0000 7f5c6cff9640 1 -- 172.21.15.31:0/4045570590 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f5c68046020 con 0x7f5c7014b570 2024-04-15T00:21:04.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.948+0000 7f5c6cff9640 1 --2- 172.21.15.31:0/4045570590 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f5c5c06b990 0x7f5c5c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:04.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.948+0000 7f5c6cff9640 1 -- 172.21.15.31:0/4045570590 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f5c680ac9a0 con 0x7f5c7014b570 2024-04-15T00:21:04.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.948+0000 7f5c6ffff640 1 --2- 172.21.15.31:0/4045570590 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f5c5c06b990 0x7f5c5c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:04.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.949+0000 7f5c6ffff640 1 --2- 172.21.15.31:0/4045570590 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f5c5c06b990 0x7f5c5c06de50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5c60007fd0 tx=0x7f5c60009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:04.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:04.953+0000 7f5c6cff9640 1 -- 172.21.15.31:0/4045570590 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f5c6804d030 con 0x7f5c7014b570 2024-04-15T00:21:05.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.172+0000 7f5c76511640 1 -- 172.21.15.31:0/4045570590 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c7004f620 con 0x7f5c7014b570 2024-04-15T00:21:05.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.172+0000 7f5c6cff9640 1 -- 172.21.15.31:0/4045570590 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2207 (secure 0 0 0) 0x7f5c6807b340 con 0x7f5c7014b570 2024-04-15T00:21:05.180 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:21:05.180 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/921487249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":921487249},{"type":"v1","addr":"172.21.15.50:6833","nonce":921487249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/93464605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":93464605},{"type":"v1","addr":"172.21.15.31:6835","nonce":93464605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-15T00:21:05.180 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 3 2024-04-15T00:21:05.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.174+0000 7f5c76511640 1 -- 172.21.15.31:0/4045570590 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f5c5c06b990 msgr2=0x7f5c5c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:05.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.174+0000 7f5c76511640 1 --2- 172.21.15.31:0/4045570590 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f5c5c06b990 0x7f5c5c06de50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5c60007fd0 tx=0x7f5c60009040 comp rx=0 tx=0).stop 2024-04-15T00:21:05.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.174+0000 7f5c76511640 1 -- 172.21.15.31:0/4045570590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c7014b570 msgr2=0x7f5c70138dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:05.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.174+0000 7f5c76511640 1 --2- 172.21.15.31:0/4045570590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c7014b570 0x7f5c70138dd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5c68009e50 tx=0x7f5c68004a40 comp rx=0 tx=0).stop 2024-04-15T00:21:05.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.174+0000 7f5c76511640 1 -- 172.21.15.31:0/4045570590 shutdown_connections 2024-04-15T00:21:05.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.174+0000 7f5c76511640 1 --2- 172.21.15.31:0/4045570590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c7014b570 0x7f5c70138dd0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:05.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.174+0000 7f5c76511640 1 --2- 172.21.15.31:0/4045570590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c70072690 0x7f5c701dd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:05.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.174+0000 7f5c76511640 1 --2- 172.21.15.31:0/4045570590 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f5c5c06b990 0x7f5c5c06de50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:05.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.174+0000 7f5c76511640 1 --2- 172.21.15.31:0/4045570590 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c7006fde0 0x7f5c701423f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:05.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.174+0000 7f5c76511640 1 -- 172.21.15.31:0/4045570590 >> 172.21.15.31:0/4045570590 conn(0x7f5c700b7840 msgr2=0x7f5c70141270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:05.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.174+0000 7f5c76511640 1 -- 172.21.15.31:0/4045570590 shutdown_connections 2024-04-15T00:21:05.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.174+0000 7f5c76511640 1 -- 172.21.15.31:0/4045570590 wait complete. 2024-04-15T00:21:05.192 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:21:05.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.286+0000 7fa324ffe640 1 Processor -- start 2024-04-15T00:21:05.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.286+0000 7fa324ffe640 1 -- start start 2024-04-15T00:21:05.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.287+0000 7fa324ffe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa32014b8e0 0x7fa3200b9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:05.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.287+0000 7fa324ffe640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3200bb2d0 con 0x7fa3200baef0 2024-04-15T00:21:05.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.287+0000 7fa324ffe640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa32014ae00 con 0x7fa3200b8bf0 2024-04-15T00:21:05.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.287+0000 7fa324ffe640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fa32014b0e0 con 0x7fa32014b8e0 2024-04-15T00:21:05.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.287+0000 7fa317fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa32014b8e0 0x7fa3200b9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:05.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.287+0000 7fa31e59c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa3200baef0 0x7fa320147670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57418/0 (socket says 172.21.15.31:57418) 2024-04-15T00:21:05.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.287+0000 7fa31e59c640 1 -- 172.21.15.31:0/2113109901 learned_addr learned my addr 172.21.15.31:0/2113109901 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:05.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.287+0000 7fa317fff640 1 -- 172.21.15.31:0/2113109901 >> v1:172.21.15.50:6789/0 conn(0x7fa3200b8bf0 legacy=0x7fa320151ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:05.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.287+0000 7fa317fff640 1 -- 172.21.15.31:0/2113109901 >> v1:172.21.15.31:6789/0 conn(0x7fa3200baef0 legacy=0x7fa320147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:05.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.287+0000 7fa317fff640 1 -- 172.21.15.31:0/2113109901 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3200bcbb0 con 0x7fa32014b8e0 2024-04-15T00:21:05.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.288+0000 7fa317fff640 1 --2- 172.21.15.31:0/2113109901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa32014b8e0 0x7fa3200b9a10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa3080097a0 tx=0x7fa30802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22626fd04fac68b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:05.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.288+0000 7fa31dd9b640 1 -- 172.21.15.31:0/2113109901 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa308035020 con 0x7fa32014b8e0 2024-04-15T00:21:05.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.288+0000 7fa31dd9b640 1 -- 172.21.15.31:0/2113109901 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa308031830 con 0x7fa32014b8e0 2024-04-15T00:21:05.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.288+0000 7fa31dd9b640 1 -- 172.21.15.31:0/2113109901 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa308031c00 con 0x7fa32014b8e0 2024-04-15T00:21:05.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.288+0000 7fa324ffe640 1 -- 172.21.15.31:0/2113109901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa32014b8e0 msgr2=0x7fa3200b9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:05.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.288+0000 7fa324ffe640 1 --2- 172.21.15.31:0/2113109901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa32014b8e0 0x7fa3200b9a10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa3080097a0 tx=0x7fa30802b8d0 comp rx=0 tx=0).stop 2024-04-15T00:21:05.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.289+0000 7fa324ffe640 1 -- 172.21.15.31:0/2113109901 shutdown_connections 2024-04-15T00:21:05.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.289+0000 7fa324ffe640 1 --2- 172.21.15.31:0/2113109901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa32014b8e0 0x7fa3200b9a10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:05.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.289+0000 7fa324ffe640 1 -- 172.21.15.31:0/2113109901 >> 172.21.15.31:0/2113109901 conn(0x7fa32009ed70 msgr2=0x7fa32009f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:05.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.289+0000 7fa324ffe640 1 -- 172.21.15.31:0/2113109901 shutdown_connections 2024-04-15T00:21:05.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.289+0000 7fa324ffe640 1 -- 172.21.15.31:0/2113109901 wait complete. 2024-04-15T00:21:05.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.290+0000 7fa324ffe640 1 Processor -- start 2024-04-15T00:21:05.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.290+0000 7fa324ffe640 1 -- start start 2024-04-15T00:21:05.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.290+0000 7fa324ffe640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3200b8bf0 0x7fa3201d1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:05.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.290+0000 7fa324ffe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3200baef0 0x7fa3201e0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:05.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.290+0000 7fa324ffe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa32014b8e0 0x7fa320144790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:05.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.290+0000 7fa324ffe640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa3200b9180 con 0x7fa32014b8e0 2024-04-15T00:21:05.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.290+0000 7fa324ffe640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa3200b9000 con 0x7fa3200baef0 2024-04-15T00:21:05.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.290+0000 7fa324ffe640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fa3200b9300 con 0x7fa3200b8bf0 2024-04-15T00:21:05.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.290+0000 7fa31ed9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa32014b8e0 0x7fa320144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:05.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.290+0000 7fa31ed9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa32014b8e0 0x7fa320144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58556/0 (socket says 172.21.15.31:58556) 2024-04-15T00:21:05.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.290+0000 7fa31ed9d640 1 -- 172.21.15.31:0/311942 learned_addr learned my addr 172.21.15.31:0/311942 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:05.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.291+0000 7fa317fff640 1 --2- 172.21.15.31:0/311942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3200baef0 0x7fa3201e0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:05.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.291+0000 7fa31e59c640 1 --2- 172.21.15.31:0/311942 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3200b8bf0 0x7fa3201d1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:05.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.291+0000 7fa31ed9d640 1 -- 172.21.15.31:0/311942 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3200b8bf0 msgr2=0x7fa3201d1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:05.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.291+0000 7fa31ed9d640 1 --2- 172.21.15.31:0/311942 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3200b8bf0 0x7fa3201d1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:05.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.291+0000 7fa31ed9d640 1 -- 172.21.15.31:0/311942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3200baef0 msgr2=0x7fa3201e0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:05.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.291+0000 7fa31ed9d640 1 --2- 172.21.15.31:0/311942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3200baef0 0x7fa3201e0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:05.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.291+0000 7fa31ed9d640 1 -- 172.21.15.31:0/311942 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa320144cd0 con 0x7fa32014b8e0 2024-04-15T00:21:05.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.291+0000 7fa317fff640 1 --2- 172.21.15.31:0/311942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3200baef0 0x7fa3201e0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:21:05.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.291+0000 7fa31ed9d640 1 --2- 172.21.15.31:0/311942 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa32014b8e0 0x7fa320144790 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa31800c6b0 tx=0x7fa31800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:05.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.291+0000 7fa316ffd640 1 -- 172.21.15.31:0/311942 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa318003b70 con 0x7fa32014b8e0 2024-04-15T00:21:05.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.291+0000 7fa316ffd640 1 -- 172.21.15.31:0/311942 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa318003d30 con 0x7fa32014b8e0 2024-04-15T00:21:05.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.291+0000 7fa316ffd640 1 -- 172.21.15.31:0/311942 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa318005310 con 0x7fa32014b8e0 2024-04-15T00:21:05.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.291+0000 7fa324ffe640 1 -- 172.21.15.31:0/311942 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3201e0640 con 0x7fa32014b8e0 2024-04-15T00:21:05.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.291+0000 7fa324ffe640 1 -- 172.21.15.31:0/311942 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa320143870 con 0x7fa32014b8e0 2024-04-15T00:21:05.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.292+0000 7fa324ffe640 1 -- 172.21.15.31:0/311942 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3201e0460 con 0x7fa32014b8e0 2024-04-15T00:21:05.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.292+0000 7fa316ffd640 1 -- 172.21.15.31:0/311942 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fa3180054b0 con 0x7fa32014b8e0 2024-04-15T00:21:05.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.293+0000 7fa316ffd640 1 --2- 172.21.15.31:0/311942 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fa30006b9c0 0x7fa30006de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:05.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.293+0000 7fa31e59c640 1 --2- 172.21.15.31:0/311942 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fa30006b9c0 0x7fa30006de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:05.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.293+0000 7fa316ffd640 1 -- 172.21.15.31:0/311942 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fa31808a2e0 con 0x7fa32014b8e0 2024-04-15T00:21:05.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.293+0000 7fa31e59c640 1 --2- 172.21.15.31:0/311942 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fa30006b9c0 0x7fa30006de80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa310005880 tx=0x7fa310009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:05.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.297+0000 7fa316ffd640 1 -- 172.21.15.31:0/311942 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa3201e0460 con 0x7fa32014b8e0 2024-04-15T00:21:05.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.481+0000 7fa324ffe640 1 -- 172.21.15.31:0/311942 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa320071f30 con 0x7fa32014b8e0 2024-04-15T00:21:05.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.482+0000 7fa316ffd640 1 -- 172.21.15.31:0/311942 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12824 (secure 0 0 0) 0x7fa320144cd0 con 0x7fa32014b8e0 2024-04-15T00:21:05.489 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:21:05.489 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":17,"fsid":"b57c03ab-2810-4ea5-b233-6164468328c0","created":"2024-04-15T00:20:44.073217+0000","modified":"2024-04-15T00:20:58.531703+0000","last_up_change":"2024-04-15T00:20:55.515596+0000","last_in_change":"2024-04-15T00:20:46.364541+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:20:56.423161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b085a2f4-5565-4ccc-a98e-e56180791550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6817","nonce":2355720818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6819","nonce":2355720818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6823","nonce":2355720818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6821","nonce":2355720818}]},"public_addr":"172.21.15.31:6817/2355720818","cluster_addr":"172.21.15.31:6819/2355720818","heartbeat_back_addr":"172.21.15.31:6823/2355720818","heartbeat_front_addr":"172.21.15.31:6821/2355720818","state":["exists","up"]},{"osd":1,"uuid":"0f751557-3f18-464f-8b78-614d19549f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6809","nonce":2705297130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6811","nonce":2705297130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6815","nonce":2705297130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6813","nonce":2705297130}]},"public_addr":"172.21.15.31:6809/2705297130","cluster_addr":"172.21.15.31:6811/2705297130","heartbeat_back_addr":"172.21.15.31:6815/2705297130","heartbeat_front_addr":"172.21.15.31:6813/2705297130","state":["exists","up"]},{"osd":2,"uuid":"17371b09-2bd7-4ef7-926f-e7706319f064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6801","nonce":225061474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6803","nonce":225061474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6807","nonce":225061474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6805","nonce":225061474}]},"public_addr":"172.21.15.31:6801/225061474","cluster_addr":"172.21.15.31:6803/225061474","heartbeat_back_addr":"172.21.15.31:6807/225061474","heartbeat_front_addr":"172.21.15.31:6805/225061474","state":["exists","up"]},{"osd":3,"uuid":"315b6949-f009-4291-9581-aa4912642dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6825","nonce":3722449780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6827","nonce":3722449780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6831","nonce":3722449780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6829","nonce":3722449780}]},"public_addr":"172.21.15.31:6825/3722449780","cluster_addr":"172.21.15.31:6827/3722449780","heartbeat_back_addr":"172.21.15.31:6831/3722449780","heartbeat_front_addr":"172.21.15.31:6829/3722449780","state":["exists","up"]},{"osd":4,"uuid":"e3659369-cc78-4aa8-bd10-a199d4a1569d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6801","nonce":1279970071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6803","nonce":1279970071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6807","nonce":1279970071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6805","nonce":1279970071}]},"public_addr":"172.21.15.50:6801/1279970071","cluster_addr":"172.21.15.50:6803/1279970071","heartbeat_back_addr":"172.21.15.50:6807/1279970071","heartbeat_front_addr":"172.21.15.50:6805/1279970071","state":["exists","up"]},{"osd":5,"uuid":"35c3a4c0-0b45-45d2-85b9-301c347602f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6809","nonce":1589417182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6811","nonce":1589417182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6815","nonce":1589417182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6813","nonce":1589417182}]},"public_addr":"172.21.15.50:6809/1589417182","cluster_addr":"172.21.15.50:6811/1589417182","heartbeat_back_addr":"172.21.15.50:6815/1589417182","heartbeat_front_addr":"172.21.15.50:6813/1589417182","state":["exists","up"]},{"osd":6,"uuid":"20df7a76-245f-4946-9624-6ca9e949227b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6817","nonce":682288274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6819","nonce":682288274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6823","nonce":682288274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6821","nonce":682288274}]},"public_addr":"172.21.15.50:6817/682288274","cluster_addr":"172.21.15.50:6819/682288274","heartbeat_back_addr":"172.21.15.50:6823/682288274","heartbeat_front_addr":"172.21.15.50:6821/682288274","state":["exists","up"]},{"osd":7,"uuid":"95a504b7-e13a-49e6-8484-9dff4d5fc048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6825","nonce":4129060906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6827","nonce":4129060906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6831","nonce":4129060906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6829","nonce":4129060906}]},"public_addr":"172.21.15.50:6825/4129060906","cluster_addr":"172.21.15.50:6827/4129060906","heartbeat_back_addr":"172.21.15.50:6831/4129060906","heartbeat_front_addr":"172.21.15.50:6829/4129060906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.501980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.529961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.540913+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.521396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.448364+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.514136+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.527229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.508950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:21:05.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.484+0000 7fa324ffe640 1 -- 172.21.15.31:0/311942 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fa30006b9c0 msgr2=0x7fa30006de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:05.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.484+0000 7fa324ffe640 1 --2- 172.21.15.31:0/311942 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fa30006b9c0 0x7fa30006de80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa310005880 tx=0x7fa310009040 comp rx=0 tx=0).stop 2024-04-15T00:21:05.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.484+0000 7fa324ffe640 1 -- 172.21.15.31:0/311942 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa32014b8e0 msgr2=0x7fa320144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:05.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.484+0000 7fa324ffe640 1 --2- 172.21.15.31:0/311942 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa32014b8e0 0x7fa320144790 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa31800c6b0 tx=0x7fa31800cb70 comp rx=0 tx=0).stop 2024-04-15T00:21:05.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.484+0000 7fa324ffe640 1 -- 172.21.15.31:0/311942 shutdown_connections 2024-04-15T00:21:05.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.484+0000 7fa324ffe640 1 --2- 172.21.15.31:0/311942 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa32014b8e0 0x7fa320144790 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:05.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.484+0000 7fa324ffe640 1 --2- 172.21.15.31:0/311942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3200baef0 0x7fa3201e0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:05.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.484+0000 7fa324ffe640 1 --2- 172.21.15.31:0/311942 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fa30006b9c0 0x7fa30006de80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:05.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.484+0000 7fa324ffe640 1 --2- 172.21.15.31:0/311942 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3200b8bf0 0x7fa3201d1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:05.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.484+0000 7fa324ffe640 1 -- 172.21.15.31:0/311942 >> 172.21.15.31:0/311942 conn(0x7fa32009ed70 msgr2=0x7fa32009e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:05.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.484+0000 7fa324ffe640 1 -- 172.21.15.31:0/311942 shutdown_connections 2024-04-15T00:21:05.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.484+0000 7fa324ffe640 1 -- 172.21.15.31:0/311942 wait complete. 2024-04-15T00:21:05.502 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T00:20:56.423161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-15T00:21:05.502 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T00:21:05.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.600+0000 7efd88c91640 1 Processor -- start 2024-04-15T00:21:05.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.600+0000 7efd88c91640 1 -- start start 2024-04-15T00:21:05.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.601+0000 7efd88c91640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efd840b8be0 0x7efd84072570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:05.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.601+0000 7efd88c91640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efd8414b4c0 0x7efd841449c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:05.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.601+0000 7efd88c91640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd84072c90 con 0x7efd840b80d0 2024-04-15T00:21:05.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.601+0000 7efd88c91640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7efd8409c0e0 con 0x7efd8414b4c0 2024-04-15T00:21:05.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.601+0000 7efd88c91640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7efd840b84b0 con 0x7efd840b8be0 2024-04-15T00:21:05.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.601+0000 7efd8259c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7efd840b80d0 0x7efd8414adb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57434/0 (socket says 172.21.15.31:57434) 2024-04-15T00:21:05.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.601+0000 7efd8259c640 1 -- 172.21.15.31:0/2917784719 learned_addr learned my addr 172.21.15.31:0/2917784719 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:05.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.601+0000 7efd8159a640 1 -- 172.21.15.31:0/2917784719 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3504106804 0 0) 0x7efd84072c90 con 0x7efd840b80d0 2024-04-15T00:21:05.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.601+0000 7efd82d9d640 1 --2- 172.21.15.31:0/2917784719 >> v2:172.21.15.50:3300/0 conn(0x7efd8414b4c0 0x7efd841449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:05.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.601+0000 7efd8159a640 1 -- 172.21.15.31:0/2917784719 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd6c003520 con 0x7efd840b80d0 2024-04-15T00:21:05.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.601+0000 7efd81d9b640 1 --2- 172.21.15.31:0/2917784719 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efd840b8be0 0x7efd84072570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:05.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.602+0000 7efd8159a640 1 -- 172.21.15.31:0/2917784719 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3403311136 0 0) 0x7efd6c003520 con 0x7efd840b80d0 2024-04-15T00:21:05.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.602+0000 7efd8159a640 1 -- 172.21.15.31:0/2917784719 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efd840b8be0 msgr2=0x7efd84072570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:05.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.602+0000 7efd8159a640 1 --2- 172.21.15.31:0/2917784719 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efd840b8be0 0x7efd84072570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:05.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.602+0000 7efd8159a640 1 -- 172.21.15.31:0/2917784719 >> v2:172.21.15.50:3300/0 conn(0x7efd8414b4c0 msgr2=0x7efd841449c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:05.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.602+0000 7efd8159a640 1 --2- 172.21.15.31:0/2917784719 >> v2:172.21.15.50:3300/0 conn(0x7efd8414b4c0 0x7efd841449c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:05.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.602+0000 7efd8159a640 1 -- 172.21.15.31:0/2917784719 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd8409c380 con 0x7efd840b80d0 2024-04-15T00:21:05.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.602+0000 7efd8159a640 1 -- 172.21.15.31:0/2917784719 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 697057150 0 0) 0x7efd7c001670 con 0x7efd840b80d0 2024-04-15T00:21:05.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.602+0000 7efd8159a640 1 -- 172.21.15.31:0/2917784719 >> v1:172.21.15.31:6789/0 conn(0x7efd840b80d0 legacy=0x7efd8414adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:05.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.602+0000 7efd8159a640 1 --2- 172.21.15.31:0/2917784719 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efd840b8be0 0x7efd6c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:05.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.602+0000 7efd8159a640 1 --2- 172.21.15.31:0/2917784719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd6c003fe0 0x7efd6c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:05.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.602+0000 7efd8159a640 1 --2- 172.21.15.31:0/2917784719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd6c004d40 0x7efd6c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:05.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.602+0000 7efd8159a640 1 -- 172.21.15.31:0/2917784719 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7efd8409c0e0 con 0x7efd6c003fe0 2024-04-15T00:21:05.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.602+0000 7efd8159a640 1 -- 172.21.15.31:0/2917784719 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efd840b84b0 con 0x7efd6c004d40 2024-04-15T00:21:05.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.602+0000 7efd8159a640 1 -- 172.21.15.31:0/2917784719 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7efd6c00bc30 con 0x7efd840b8be0 2024-04-15T00:21:05.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.602+0000 7efd81d9b640 1 --2- 172.21.15.31:0/2917784719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd6c003fe0 0x7efd6c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:05.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.602+0000 7efd8259c640 1 --2- 172.21.15.31:0/2917784719 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efd840b8be0 0x7efd6c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:05.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.602+0000 7efd82d9d640 1 --2- 172.21.15.31:0/2917784719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd6c004d40 0x7efd6c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:05.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.602+0000 7efd81d9b640 1 -- 172.21.15.31:0/2917784719 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efd840b8be0 msgr2=0x7efd6c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:05.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.602+0000 7efd81d9b640 1 --2- 172.21.15.31:0/2917784719 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efd840b8be0 0x7efd6c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:05.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.602+0000 7efd81d9b640 1 -- 172.21.15.31:0/2917784719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd6c004d40 msgr2=0x7efd6c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:05.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.602+0000 7efd81d9b640 1 --2- 172.21.15.31:0/2917784719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd6c004d40 0x7efd6c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:05.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.602+0000 7efd81d9b640 1 -- 172.21.15.31:0/2917784719 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd6c003520 con 0x7efd6c003fe0 2024-04-15T00:21:05.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.603+0000 7efd81d9b640 1 --2- 172.21.15.31:0/2917784719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd6c003fe0 0x7efd6c004800 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efd7800ba00 tx=0x7efd6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14c360fffb537cd server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:05.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.603+0000 7efd8159a640 1 -- 172.21.15.31:0/2917784719 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd78036020 con 0x7efd6c003fe0 2024-04-15T00:21:05.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.603+0000 7efd8159a640 1 -- 172.21.15.31:0/2917784719 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd78032620 con 0x7efd6c003fe0 2024-04-15T00:21:05.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.603+0000 7efd8159a640 1 -- 172.21.15.31:0/2917784719 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7800b600 con 0x7efd6c003fe0 2024-04-15T00:21:05.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.604+0000 7efd88c91640 1 -- 172.21.15.31:0/2917784719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd6c003fe0 msgr2=0x7efd6c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:05.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.604+0000 7efd88c91640 1 --2- 172.21.15.31:0/2917784719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd6c003fe0 0x7efd6c004800 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efd7800ba00 tx=0x7efd6c005830 comp rx=0 tx=0).stop 2024-04-15T00:21:05.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.604+0000 7efd82d9d640 1 -- 172.21.15.31:0/2917784719 reap_dead start 2024-04-15T00:21:05.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.604+0000 7efd88c91640 1 -- 172.21.15.31:0/2917784719 shutdown_connections 2024-04-15T00:21:05.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.604+0000 7efd88c91640 1 -- 172.21.15.31:0/2917784719 >> 172.21.15.31:0/2917784719 conn(0x7efd840bd020 msgr2=0x7efd840bd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:05.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.604+0000 7efd88c91640 1 -- 172.21.15.31:0/2917784719 shutdown_connections 2024-04-15T00:21:05.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.604+0000 7efd88c91640 1 -- 172.21.15.31:0/2917784719 wait complete. 2024-04-15T00:21:05.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.605+0000 7efd88c91640 1 Processor -- start 2024-04-15T00:21:05.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.605+0000 7efd88c91640 1 -- start start 2024-04-15T00:21:05.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.605+0000 7efd88c91640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efd6c003fe0 0x7efd840b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:05.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.605+0000 7efd88c91640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd841dd450 0x7efd841dd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:05.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.605+0000 7efd88c91640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd840b2ce0 0x7efd840b3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:05.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.605+0000 7efd88c91640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7efd840726f0 con 0x7efd840b2ce0 2024-04-15T00:21:05.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.605+0000 7efd88c91640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efd84072570 con 0x7efd841dd450 2024-04-15T00:21:05.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.605+0000 7efd88c91640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7efd84072870 con 0x7efd6c003fe0 2024-04-15T00:21:05.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.606+0000 7efd82d9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd840b2ce0 0x7efd840b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:05.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.606+0000 7efd82d9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd840b2ce0 0x7efd840b3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58576/0 (socket says 172.21.15.31:58576) 2024-04-15T00:21:05.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.606+0000 7efd82d9d640 1 -- 172.21.15.31:0/824807551 learned_addr learned my addr 172.21.15.31:0/824807551 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:05.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.606+0000 7efd81d9b640 1 --2- 172.21.15.31:0/824807551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd841dd450 0x7efd841dd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:05.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.606+0000 7efd8259c640 1 --2- 172.21.15.31:0/824807551 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efd6c003fe0 0x7efd840b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:05.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.606+0000 7efd82d9d640 1 -- 172.21.15.31:0/824807551 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efd6c003fe0 msgr2=0x7efd840b5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:05.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.606+0000 7efd82d9d640 1 --2- 172.21.15.31:0/824807551 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efd6c003fe0 0x7efd840b5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:05.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.606+0000 7efd82d9d640 1 -- 172.21.15.31:0/824807551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd841dd450 msgr2=0x7efd841dd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:05.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.606+0000 7efd82d9d640 1 --2- 172.21.15.31:0/824807551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd841dd450 0x7efd841dd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:05.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.606+0000 7efd82d9d640 1 -- 172.21.15.31:0/824807551 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd840b4cd0 con 0x7efd840b2ce0 2024-04-15T00:21:05.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.606+0000 7efd82d9d640 1 --2- 172.21.15.31:0/824807551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd840b2ce0 0x7efd840b3160 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efd6c004780 tx=0x7efd74007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:05.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.606+0000 7efd72ffd640 1 -- 172.21.15.31:0/824807551 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd740046a0 con 0x7efd840b2ce0 2024-04-15T00:21:05.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.606+0000 7efd72ffd640 1 -- 172.21.15.31:0/824807551 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd7401a070 con 0x7efd840b2ce0 2024-04-15T00:21:05.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.606+0000 7efd88c91640 1 -- 172.21.15.31:0/824807551 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd840b6ec0 con 0x7efd840b2ce0 2024-04-15T00:21:05.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.606+0000 7efd72ffd640 1 -- 172.21.15.31:0/824807551 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd74015640 con 0x7efd840b2ce0 2024-04-15T00:21:05.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.606+0000 7efd88c91640 1 -- 172.21.15.31:0/824807551 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd84145610 con 0x7efd840b2ce0 2024-04-15T00:21:05.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.607+0000 7efd88c91640 1 -- 172.21.15.31:0/824807551 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd84148d30 con 0x7efd840b2ce0 2024-04-15T00:21:05.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.607+0000 7efd72ffd640 1 -- 172.21.15.31:0/824807551 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7efd740157e0 con 0x7efd840b2ce0 2024-04-15T00:21:05.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.608+0000 7efd72ffd640 1 --2- 172.21.15.31:0/824807551 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7efd6406b9c0 0x7efd6406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:05.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.608+0000 7efd72ffd640 1 -- 172.21.15.31:0/824807551 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7efd7408a970 con 0x7efd840b2ce0 2024-04-15T00:21:05.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.608+0000 7efd8259c640 1 --2- 172.21.15.31:0/824807551 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7efd6406b9c0 0x7efd6406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:05.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.608+0000 7efd8259c640 1 --2- 172.21.15.31:0/824807551 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7efd6406b9c0 0x7efd6406de80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efd7c001d30 tx=0x7efd7c007970 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:05.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.612+0000 7efd72ffd640 1 -- 172.21.15.31:0/824807551 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7efd74024020 con 0x7efd840b2ce0 2024-04-15T00:21:05.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.793+0000 7efd88c91640 1 -- 172.21.15.31:0/824807551 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7efd8409f730 con 0x7efd840b2ce0 2024-04-15T00:21:05.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.794+0000 7efd72ffd640 1 -- 172.21.15.31:0/824807551 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7efd74059310 con 0x7efd840b2ce0 2024-04-15T00:21:05.801 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-15T00:21:05.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.796+0000 7efd88c91640 1 -- 172.21.15.31:0/824807551 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7efd6406b9c0 msgr2=0x7efd6406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:05.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.796+0000 7efd88c91640 1 --2- 172.21.15.31:0/824807551 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7efd6406b9c0 0x7efd6406de80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efd7c001d30 tx=0x7efd7c007970 comp rx=0 tx=0).stop 2024-04-15T00:21:05.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.796+0000 7efd88c91640 1 -- 172.21.15.31:0/824807551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd840b2ce0 msgr2=0x7efd840b3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:05.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.796+0000 7efd88c91640 1 --2- 172.21.15.31:0/824807551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd840b2ce0 0x7efd840b3160 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efd6c004780 tx=0x7efd74007700 comp rx=0 tx=0).stop 2024-04-15T00:21:05.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.796+0000 7efd88c91640 1 -- 172.21.15.31:0/824807551 shutdown_connections 2024-04-15T00:21:05.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.796+0000 7efd88c91640 1 --2- 172.21.15.31:0/824807551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd840b2ce0 0x7efd840b3160 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:05.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.796+0000 7efd88c91640 1 --2- 172.21.15.31:0/824807551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd841dd450 0x7efd841dd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:05.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.796+0000 7efd88c91640 1 --2- 172.21.15.31:0/824807551 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7efd6406b9c0 0x7efd6406de80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:05.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.796+0000 7efd88c91640 1 --2- 172.21.15.31:0/824807551 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7efd6c003fe0 0x7efd840b5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:05.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.796+0000 7efd88c91640 1 -- 172.21.15.31:0/824807551 >> 172.21.15.31:0/824807551 conn(0x7efd840bd020 msgr2=0x7efd8409e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:05.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.796+0000 7efd88c91640 1 -- 172.21.15.31:0/824807551 shutdown_connections 2024-04-15T00:21:05.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.796+0000 7efd88c91640 1 -- 172.21.15.31:0/824807551 wait complete. 2024-04-15T00:21:05.814 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-15T00:21:05.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.908+0000 7f760dcde640 1 Processor -- start 2024-04-15T00:21:05.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.908+0000 7f760dcde640 1 -- start start 2024-04-15T00:21:05.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.909+0000 7f760dcde640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f760806c540 0x7f760806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:05.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.909+0000 7f760dcde640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f760806e8a0 con 0x7f760814b050 2024-04-15T00:21:05.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.909+0000 7f760dcde640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f760806eb80 con 0x7f76081413f0 2024-04-15T00:21:05.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.909+0000 7f760dcde640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f760814abc0 con 0x7f760806c540 2024-04-15T00:21:05.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.909+0000 7f76077fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f760806c540 0x7f760806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:05.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.909+0000 7f7606ffd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f760814b050 0x7f760814b4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57446/0 (socket says 172.21.15.31:57446) 2024-04-15T00:21:05.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.909+0000 7f7606ffd640 1 -- 172.21.15.31:0/2235749214 learned_addr learned my addr 172.21.15.31:0/2235749214 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:05.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.909+0000 7f76077fe640 1 -- 172.21.15.31:0/2235749214 >> v1:172.21.15.50:6789/0 conn(0x7f76081413f0 legacy=0x7f7608141800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:05.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.909+0000 7f76077fe640 1 -- 172.21.15.31:0/2235749214 >> v1:172.21.15.31:6789/0 conn(0x7f760814b050 legacy=0x7f760814b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:05.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.909+0000 7f76077fe640 1 -- 172.21.15.31:0/2235749214 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76080b7630 con 0x7f760806c540 2024-04-15T00:21:05.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.909+0000 7f76067fc640 1 -- 172.21.15.31:0/2235749214 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1921182264 0 0) 0x7f760806e8a0 con 0x7f760814b050 2024-04-15T00:21:05.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.910+0000 7f76077fe640 1 --2- 172.21.15.31:0/2235749214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f760806c540 0x7f760806c920 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f75f80097a0 tx=0x7f75f802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67365036a0c0c55e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:05.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.910+0000 7f76067fc640 1 -- 172.21.15.31:0/2235749214 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f8038070 con 0x7f760806c540 2024-04-15T00:21:05.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.910+0000 7f76067fc640 1 -- 172.21.15.31:0/2235749214 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75f8031700 con 0x7f760806c540 2024-04-15T00:21:05.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.910+0000 7f76067fc640 1 -- 172.21.15.31:0/2235749214 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f8031ad0 con 0x7f760806c540 2024-04-15T00:21:05.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.911+0000 7f760dcde640 1 -- 172.21.15.31:0/2235749214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f760806c540 msgr2=0x7f760806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:05.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.911+0000 7f760dcde640 1 --2- 172.21.15.31:0/2235749214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f760806c540 0x7f760806c920 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f75f80097a0 tx=0x7f75f802b7a0 comp rx=0 tx=0).stop 2024-04-15T00:21:05.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.911+0000 7f760dcde640 1 -- 172.21.15.31:0/2235749214 shutdown_connections 2024-04-15T00:21:05.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.911+0000 7f760dcde640 1 --2- 172.21.15.31:0/2235749214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f760806c540 0x7f760806c920 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:05.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.911+0000 7f760dcde640 1 -- 172.21.15.31:0/2235749214 >> 172.21.15.31:0/2235749214 conn(0x7f7608071450 msgr2=0x7f7608071830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:05.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.911+0000 7f760dcde640 1 -- 172.21.15.31:0/2235749214 shutdown_connections 2024-04-15T00:21:05.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.911+0000 7f760dcde640 1 -- 172.21.15.31:0/2235749214 wait complete. 2024-04-15T00:21:05.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.912+0000 7f760dcde640 1 Processor -- start 2024-04-15T00:21:05.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.912+0000 7f760dcde640 1 -- start start 2024-04-15T00:21:05.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.913+0000 7f760dcde640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f760806c540 0x7f760814a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:05.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.913+0000 7f760dcde640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76081413f0 0x7f7608139020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:05.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.913+0000 7f760dcde640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f760814b050 0x7f7608135070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:05.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.913+0000 7f760dcde640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f76081530a0 con 0x7f76081413f0 2024-04-15T00:21:05.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.913+0000 7f760dcde640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7608152f20 con 0x7f760814b050 2024-04-15T00:21:05.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.913+0000 7f760dcde640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f7608153220 con 0x7f760806c540 2024-04-15T00:21:05.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.913+0000 7f7606ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76081413f0 0x7f7608139020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:05.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.913+0000 7f7606ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76081413f0 0x7f7608139020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58590/0 (socket says 172.21.15.31:58590) 2024-04-15T00:21:05.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.913+0000 7f7606ffd640 1 -- 172.21.15.31:0/3631195174 learned_addr learned my addr 172.21.15.31:0/3631195174 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:05.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.913+0000 7f76077fe640 1 --2- 172.21.15.31:0/3631195174 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f760806c540 0x7f760814a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:05.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.913+0000 7f7607fff640 1 --2- 172.21.15.31:0/3631195174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f760814b050 0x7f7608135070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:05.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.913+0000 7f7606ffd640 1 -- 172.21.15.31:0/3631195174 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f760806c540 msgr2=0x7f760814a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:05.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.913+0000 7f7606ffd640 1 --2- 172.21.15.31:0/3631195174 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f760806c540 0x7f760814a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:05.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.913+0000 7f7606ffd640 1 -- 172.21.15.31:0/3631195174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f760814b050 msgr2=0x7f7608135070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:05.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.913+0000 7f7606ffd640 1 --2- 172.21.15.31:0/3631195174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f760814b050 0x7f7608135070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:05.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.913+0000 7f7606ffd640 1 -- 172.21.15.31:0/3631195174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76081447f0 con 0x7f76081413f0 2024-04-15T00:21:05.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.913+0000 7f7606ffd640 1 --2- 172.21.15.31:0/3631195174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76081413f0 0x7f7608139020 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f75fc00c500 tx=0x7f75fc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:05.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.913+0000 7f75effff640 1 -- 172.21.15.31:0/3631195174 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc018070 con 0x7f76081413f0 2024-04-15T00:21:05.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.913+0000 7f75effff640 1 -- 172.21.15.31:0/3631195174 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75fc007580 con 0x7f76081413f0 2024-04-15T00:21:05.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.913+0000 7f760dcde640 1 -- 172.21.15.31:0/3631195174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7608139f90 con 0x7f76081413f0 2024-04-15T00:21:05.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.913+0000 7f75effff640 1 -- 172.21.15.31:0/3631195174 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc004a20 con 0x7f76081413f0 2024-04-15T00:21:05.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.913+0000 7f760dcde640 1 -- 172.21.15.31:0/3631195174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7608143ff0 con 0x7f76081413f0 2024-04-15T00:21:05.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.915+0000 7f760dcde640 1 -- 172.21.15.31:0/3631195174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f760804f620 con 0x7f76081413f0 2024-04-15T00:21:05.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.915+0000 7f75effff640 1 -- 172.21.15.31:0/3631195174 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f75fc01b070 con 0x7f76081413f0 2024-04-15T00:21:05.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.915+0000 7f75effff640 1 --2- 172.21.15.31:0/3631195174 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f75f406b9c0 0x7f75f406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:05.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.915+0000 7f76077fe640 1 --2- 172.21.15.31:0/3631195174 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f75f406b9c0 0x7f75f406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:05.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.915+0000 7f75effff640 1 -- 172.21.15.31:0/3631195174 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f75fc089680 con 0x7f76081413f0 2024-04-15T00:21:05.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.916+0000 7f76077fe640 1 --2- 172.21.15.31:0/3631195174 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f75f406b9c0 0x7f75f406de80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f75f8035000 tx=0x7f75f8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:05.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:05.920+0000 7f75effff640 1 -- 172.21.15.31:0/3631195174 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f75fc058020 con 0x7f76081413f0 2024-04-15T00:21:06.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.105+0000 7f760dcde640 1 -- 172.21.15.31:0/3631195174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f7608143300 con 0x7f76081413f0 2024-04-15T00:21:06.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.105+0000 7f75effff640 1 -- 172.21.15.31:0/3631195174 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f75fc05c0c0 con 0x7f76081413f0 2024-04-15T00:21:06.113 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:21:06.113 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-04-15T00:21:06.113 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:21:06.113 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2024-04-15T00:21:06.113 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2024-04-15T00:21:06.113 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:21:06.113 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-04-15T00:21:06.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.107+0000 7f760dcde640 1 -- 172.21.15.31:0/3631195174 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f75f406b9c0 msgr2=0x7f75f406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:06.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.107+0000 7f760dcde640 1 --2- 172.21.15.31:0/3631195174 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f75f406b9c0 0x7f75f406de80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f75f8035000 tx=0x7f75f8008030 comp rx=0 tx=0).stop 2024-04-15T00:21:06.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.107+0000 7f760dcde640 1 -- 172.21.15.31:0/3631195174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76081413f0 msgr2=0x7f7608139020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:06.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.107+0000 7f760dcde640 1 --2- 172.21.15.31:0/3631195174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76081413f0 0x7f7608139020 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f75fc00c500 tx=0x7f75fc00c9c0 comp rx=0 tx=0).stop 2024-04-15T00:21:06.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.107+0000 7f760dcde640 1 -- 172.21.15.31:0/3631195174 shutdown_connections 2024-04-15T00:21:06.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.107+0000 7f760dcde640 1 --2- 172.21.15.31:0/3631195174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f760814b050 0x7f7608135070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:06.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.107+0000 7f760dcde640 1 --2- 172.21.15.31:0/3631195174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76081413f0 0x7f7608139020 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:06.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.107+0000 7f760dcde640 1 --2- 172.21.15.31:0/3631195174 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f75f406b9c0 0x7f75f406de80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:06.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.107+0000 7f760dcde640 1 --2- 172.21.15.31:0/3631195174 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f760806c540 0x7f760814a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:06.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.107+0000 7f760dcde640 1 -- 172.21.15.31:0/3631195174 >> 172.21.15.31:0/3631195174 conn(0x7f7608071450 msgr2=0x7f76081456e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:06.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.108+0000 7f760dcde640 1 -- 172.21.15.31:0/3631195174 shutdown_connections 2024-04-15T00:21:06.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.108+0000 7f760dcde640 1 -- 172.21.15.31:0/3631195174 wait complete. 2024-04-15T00:21:06.125 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-15T00:21:06.125 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-15T00:21:06.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.223+0000 7f0541a88640 1 Processor -- start 2024-04-15T00:21:06.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.223+0000 7f0541a88640 1 -- start start 2024-04-15T00:21:06.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.224+0000 7f0541a88640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f053c09f4a0 0x7f053c09c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:06.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.224+0000 7f0541a88640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f053c09f880 con 0x7f053c0bbe00 2024-04-15T00:21:06.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.224+0000 7f0541a88640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f053c09bc20 con 0x7f053c09b170 2024-04-15T00:21:06.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.224+0000 7f0541a88640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f053c0bb460 con 0x7f053c09f4a0 2024-04-15T00:21:06.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.224+0000 7f053b7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f053c09f4a0 0x7f053c09c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:06.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.224+0000 7f053bfff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f053c0bbe00 0x7f053c151f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57454/0 (socket says 172.21.15.31:57454) 2024-04-15T00:21:06.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.224+0000 7f053bfff640 1 -- 172.21.15.31:0/821743173 learned_addr learned my addr 172.21.15.31:0/821743173 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:06.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.224+0000 7f053b7fe640 1 -- 172.21.15.31:0/821743173 >> v1:172.21.15.50:6789/0 conn(0x7f053c09b170 legacy=0x7f053c141730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:06.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.224+0000 7f053b7fe640 1 -- 172.21.15.31:0/821743173 >> v1:172.21.15.31:6789/0 conn(0x7f053c0bbe00 legacy=0x7f053c151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:06.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.224+0000 7f053b7fe640 1 -- 172.21.15.31:0/821743173 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f053c09b5d0 con 0x7f053c09f4a0 2024-04-15T00:21:06.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.225+0000 7f053b7fe640 1 --2- 172.21.15.31:0/821743173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f053c09f4a0 0x7f053c09c420 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f052c0097a0 tx=0x7f052c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6227f83e539728d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:06.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.225+0000 7f053a7fc640 1 -- 172.21.15.31:0/821743173 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f052c035020 con 0x7f053c09f4a0 2024-04-15T00:21:06.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.225+0000 7f053a7fc640 1 -- 172.21.15.31:0/821743173 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f052c031830 con 0x7f053c09f4a0 2024-04-15T00:21:06.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.225+0000 7f053a7fc640 1 -- 172.21.15.31:0/821743173 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f052c031c00 con 0x7f053c09f4a0 2024-04-15T00:21:06.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.225+0000 7f0541a88640 1 -- 172.21.15.31:0/821743173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f053c09f4a0 msgr2=0x7f053c09c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:06.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.225+0000 7f0541a88640 1 --2- 172.21.15.31:0/821743173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f053c09f4a0 0x7f053c09c420 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f052c0097a0 tx=0x7f052c02b8d0 comp rx=0 tx=0).stop 2024-04-15T00:21:06.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.226+0000 7f0541a88640 1 -- 172.21.15.31:0/821743173 shutdown_connections 2024-04-15T00:21:06.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.226+0000 7f0541a88640 1 --2- 172.21.15.31:0/821743173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f053c09f4a0 0x7f053c09c420 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:06.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.226+0000 7f0541a88640 1 -- 172.21.15.31:0/821743173 >> 172.21.15.31:0/821743173 conn(0x7f053c0675d0 msgr2=0x7f053c09eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:06.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.226+0000 7f0541a88640 1 -- 172.21.15.31:0/821743173 shutdown_connections 2024-04-15T00:21:06.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.226+0000 7f0541a88640 1 -- 172.21.15.31:0/821743173 wait complete. 2024-04-15T00:21:06.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.227+0000 7f0541a88640 1 Processor -- start 2024-04-15T00:21:06.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.227+0000 7f0541a88640 1 -- start start 2024-04-15T00:21:06.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.227+0000 7f0541a88640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f053c09b170 0x7f053c09c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:06.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.228+0000 7f0541a88640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f053c09f4a0 0x7f053c0b3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:06.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.228+0000 7f0541a88640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f053c0bbe00 0x7f053c13fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:06.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.228+0000 7f0541a88640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f053c09b8d0 con 0x7f053c09b170 2024-04-15T00:21:06.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.228+0000 7f0541a88640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f053c0bc4e0 con 0x7f053c0bbe00 2024-04-15T00:21:06.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.228+0000 7f0541a88640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f053c09bf90 con 0x7f053c09f4a0 2024-04-15T00:21:06.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.228+0000 7f053b7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f053c09b170 0x7f053c09c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:06.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.228+0000 7f053b7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f053c09b170 0x7f053c09c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58608/0 (socket says 172.21.15.31:58608) 2024-04-15T00:21:06.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.228+0000 7f053b7fe640 1 -- 172.21.15.31:0/1747724994 learned_addr learned my addr 172.21.15.31:0/1747724994 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:06.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.228+0000 7f053bfff640 1 --2- 172.21.15.31:0/1747724994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f053c0bbe00 0x7f053c13fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:06.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.228+0000 7f053affd640 1 --2- 172.21.15.31:0/1747724994 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f053c09f4a0 0x7f053c0b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:06.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.228+0000 7f053b7fe640 1 -- 172.21.15.31:0/1747724994 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f053c09f4a0 msgr2=0x7f053c0b3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:06.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.228+0000 7f053b7fe640 1 --2- 172.21.15.31:0/1747724994 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f053c09f4a0 0x7f053c0b3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:06.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.228+0000 7f053b7fe640 1 -- 172.21.15.31:0/1747724994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f053c0bbe00 msgr2=0x7f053c13fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:06.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.228+0000 7f053b7fe640 1 --2- 172.21.15.31:0/1747724994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f053c0bbe00 0x7f053c13fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:06.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.228+0000 7f053b7fe640 1 -- 172.21.15.31:0/1747724994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f053c144250 con 0x7f053c09b170 2024-04-15T00:21:06.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.228+0000 7f053b7fe640 1 --2- 172.21.15.31:0/1747724994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f053c09b170 0x7f053c09c9f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f052c02bee0 tx=0x7f052c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:06.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.228+0000 7f0523fff640 1 -- 172.21.15.31:0/1747724994 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f052c041070 con 0x7f053c09b170 2024-04-15T00:21:06.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.228+0000 7f0523fff640 1 -- 172.21.15.31:0/1747724994 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f052c03a950 con 0x7f053c09b170 2024-04-15T00:21:06.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.228+0000 7f0523fff640 1 -- 172.21.15.31:0/1747724994 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f052c035040 con 0x7f053c09b170 2024-04-15T00:21:06.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.229+0000 7f0541a88640 1 -- 172.21.15.31:0/1747724994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f053c13f2e0 con 0x7f053c09b170 2024-04-15T00:21:06.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.229+0000 7f0541a88640 1 -- 172.21.15.31:0/1747724994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f053c141140 con 0x7f053c09b170 2024-04-15T00:21:06.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.230+0000 7f0541a88640 1 -- 172.21.15.31:0/1747724994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f053c144fc0 con 0x7f053c09b170 2024-04-15T00:21:06.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.230+0000 7f0523fff640 1 -- 172.21.15.31:0/1747724994 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f052c04c060 con 0x7f053c09b170 2024-04-15T00:21:06.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.230+0000 7f0523fff640 1 --2- 172.21.15.31:0/1747724994 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f052806b9c0 0x7f052806de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:06.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.230+0000 7f0523fff640 1 -- 172.21.15.31:0/1747724994 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f052c0abd90 con 0x7f053c09b170 2024-04-15T00:21:06.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.230+0000 7f053affd640 1 --2- 172.21.15.31:0/1747724994 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f052806b9c0 0x7f052806de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:06.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.231+0000 7f053affd640 1 --2- 172.21.15.31:0/1747724994 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f052806b9c0 0x7f052806de80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f053c1d0b00 tx=0x7f0530009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:06.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.235+0000 7f0523fff640 1 -- 172.21.15.31:0/1747724994 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f053c144250 con 0x7f053c09b170 2024-04-15T00:21:06.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.416+0000 7f0541a88640 1 -- 172.21.15.31:0/1747724994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f053c04f620 con 0x7f053c09b170 2024-04-15T00:21:06.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.550+0000 7f0523fff640 1 -- 172.21.15.31:0/1747724994 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f052c07a730 con 0x7f053c09b170 2024-04-15T00:21:06.558 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2024-04-15T00:21:06.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.554+0000 7f0541a88640 1 -- 172.21.15.31:0/1747724994 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f052806b9c0 msgr2=0x7f052806de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:06.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.554+0000 7f0541a88640 1 --2- 172.21.15.31:0/1747724994 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f052806b9c0 0x7f052806de80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f053c1d0b00 tx=0x7f0530009040 comp rx=0 tx=0).stop 2024-04-15T00:21:06.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.554+0000 7f0541a88640 1 -- 172.21.15.31:0/1747724994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f053c09b170 msgr2=0x7f053c09c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:06.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.554+0000 7f0541a88640 1 --2- 172.21.15.31:0/1747724994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f053c09b170 0x7f053c09c9f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f052c02bee0 tx=0x7f052c0046c0 comp rx=0 tx=0).stop 2024-04-15T00:21:06.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.554+0000 7f0541a88640 1 -- 172.21.15.31:0/1747724994 shutdown_connections 2024-04-15T00:21:06.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.554+0000 7f0541a88640 1 --2- 172.21.15.31:0/1747724994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f053c0bbe00 0x7f053c13fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:06.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.554+0000 7f0541a88640 1 --2- 172.21.15.31:0/1747724994 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f052806b9c0 0x7f052806de80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:06.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.554+0000 7f0541a88640 1 --2- 172.21.15.31:0/1747724994 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f053c09f4a0 0x7f053c0b3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:06.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.554+0000 7f0541a88640 1 --2- 172.21.15.31:0/1747724994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f053c09b170 0x7f053c09c9f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:06.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.554+0000 7f0541a88640 1 -- 172.21.15.31:0/1747724994 >> 172.21.15.31:0/1747724994 conn(0x7f053c0675d0 msgr2=0x7f053c1d3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:06.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.555+0000 7f0541a88640 1 -- 172.21.15.31:0/1747724994 shutdown_connections 2024-04-15T00:21:06.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.555+0000 7f0541a88640 1 -- 172.21.15.31:0/1747724994 wait complete. 2024-04-15T00:21:06.576 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-15T00:21:06.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.677+0000 7f17aa620640 1 Processor -- start 2024-04-15T00:21:06.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.677+0000 7f17aa620640 1 -- start start 2024-04-15T00:21:06.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.677+0000 7f17aa620640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f17a4067180 0x7f17a40725d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:06.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.677+0000 7f17aa620640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f17a41492b0 0x7f17a414fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:06.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.677+0000 7f17aa620640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17a4067560 con 0x7f17a4072b10 2024-04-15T00:21:06.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.677+0000 7f17aa620640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f17a40b93b0 con 0x7f17a4067180 2024-04-15T00:21:06.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.677+0000 7f17aa620640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f17a4070a90 con 0x7f17a41492b0 2024-04-15T00:21:06.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.677+0000 7f17a37fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f17a4072b10 0x7f17a4148ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57462/0 (socket says 172.21.15.31:57462) 2024-04-15T00:21:06.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.677+0000 7f17a37fe640 1 -- 172.21.15.31:0/1252987616 learned_addr learned my addr 172.21.15.31:0/1252987616 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:06.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.678+0000 7f17a3fff640 1 --2- 172.21.15.31:0/1252987616 >> v2:172.21.15.50:3300/0 conn(0x7f17a4067180 0x7f17a40725d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:06.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.678+0000 7f17a8bbd640 1 --2- 172.21.15.31:0/1252987616 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f17a41492b0 0x7f17a414fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:06.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.678+0000 7f17a2ffd640 1 -- 172.21.15.31:0/1252987616 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 433162451 0 0) 0x7f17a4067560 con 0x7f17a4072b10 2024-04-15T00:21:06.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.678+0000 7f17a2ffd640 1 -- 172.21.15.31:0/1252987616 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f178c003520 con 0x7f17a4072b10 2024-04-15T00:21:06.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.678+0000 7f17a2ffd640 1 -- 172.21.15.31:0/1252987616 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2072143322 0 0) 0x7f178c003520 con 0x7f17a4072b10 2024-04-15T00:21:06.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.678+0000 7f17a2ffd640 1 -- 172.21.15.31:0/1252987616 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f17a41492b0 msgr2=0x7f17a414fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:06.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.678+0000 7f17a2ffd640 1 --2- 172.21.15.31:0/1252987616 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f17a41492b0 0x7f17a414fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:06.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.678+0000 7f17a2ffd640 1 -- 172.21.15.31:0/1252987616 >> v2:172.21.15.50:3300/0 conn(0x7f17a4067180 msgr2=0x7f17a40725d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:06.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.678+0000 7f17a2ffd640 1 --2- 172.21.15.31:0/1252987616 >> v2:172.21.15.50:3300/0 conn(0x7f17a4067180 0x7f17a40725d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:06.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.678+0000 7f17a2ffd640 1 -- 172.21.15.31:0/1252987616 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a40b9040 con 0x7f17a4072b10 2024-04-15T00:21:06.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.678+0000 7f17a2ffd640 1 -- 172.21.15.31:0/1252987616 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 697057150 0 0) 0x7f1798001670 con 0x7f17a4072b10 2024-04-15T00:21:06.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.678+0000 7f17a2ffd640 1 -- 172.21.15.31:0/1252987616 >> v1:172.21.15.31:6789/0 conn(0x7f17a4072b10 legacy=0x7f17a4148ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:06.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.678+0000 7f17a2ffd640 1 --2- 172.21.15.31:0/1252987616 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f17a41492b0 0x7f178c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:06.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.678+0000 7f17a2ffd640 1 --2- 172.21.15.31:0/1252987616 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f178c003f30 0x7f178c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:06.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.678+0000 7f17a2ffd640 1 --2- 172.21.15.31:0/1252987616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f178c004d40 0x7f178c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:06.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.678+0000 7f17a2ffd640 1 -- 172.21.15.31:0/1252987616 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f17a40b93b0 con 0x7f178c003f30 2024-04-15T00:21:06.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.678+0000 7f17a2ffd640 1 -- 172.21.15.31:0/1252987616 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f17a4070a90 con 0x7f178c004d40 2024-04-15T00:21:06.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.678+0000 7f17a2ffd640 1 -- 172.21.15.31:0/1252987616 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f178c00ba10 con 0x7f17a41492b0 2024-04-15T00:21:06.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.678+0000 7f17a37fe640 1 --2- 172.21.15.31:0/1252987616 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f178c003f30 0x7f178c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:06.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.678+0000 7f17a3fff640 1 --2- 172.21.15.31:0/1252987616 >> v2:172.21.15.50:3300/0 conn(0x7f17a4067180 0x7f17a40725d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:21:06.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.678+0000 7f17a8bbd640 1 --2- 172.21.15.31:0/1252987616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f178c004d40 0x7f178c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:06.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.678+0000 7f17a3fff640 1 --2- 172.21.15.31:0/1252987616 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f17a41492b0 0x7f178c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:06.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.678+0000 7f17a37fe640 1 -- 172.21.15.31:0/1252987616 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f17a41492b0 msgr2=0x7f178c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:06.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.678+0000 7f17a37fe640 1 --2- 172.21.15.31:0/1252987616 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f17a41492b0 0x7f178c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:06.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.678+0000 7f17a37fe640 1 -- 172.21.15.31:0/1252987616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f178c004d40 msgr2=0x7f178c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:06.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.678+0000 7f17a37fe640 1 --2- 172.21.15.31:0/1252987616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f178c004d40 0x7f178c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:06.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.678+0000 7f17a37fe640 1 -- 172.21.15.31:0/1252987616 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f178c003520 con 0x7f178c003f30 2024-04-15T00:21:06.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.678+0000 7f17a8bbd640 1 --2- 172.21.15.31:0/1252987616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f178c004d40 0x7f178c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:06.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.678+0000 7f17a3fff640 1 --2- 172.21.15.31:0/1252987616 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f17a41492b0 0x7f178c0039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:21:06.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.679+0000 7f17a37fe640 1 --2- 172.21.15.31:0/1252987616 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f178c003f30 0x7f178c004800 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f179800c210 tx=0x7f178c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=113458b0c2848977 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:06.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.679+0000 7f17a2ffd640 1 -- 172.21.15.31:0/1252987616 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1798007d50 con 0x7f178c003f30 2024-04-15T00:21:06.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.679+0000 7f17a2ffd640 1 -- 172.21.15.31:0/1252987616 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1798030070 con 0x7f178c003f30 2024-04-15T00:21:06.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.679+0000 7f17a2ffd640 1 -- 172.21.15.31:0/1252987616 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179802cd40 con 0x7f178c003f30 2024-04-15T00:21:06.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.680+0000 7f17aa620640 1 -- 172.21.15.31:0/1252987616 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f178c003f30 msgr2=0x7f178c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:06.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.680+0000 7f17aa620640 1 --2- 172.21.15.31:0/1252987616 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f178c003f30 0x7f178c004800 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f179800c210 tx=0x7f178c005830 comp rx=0 tx=0).stop 2024-04-15T00:21:06.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.680+0000 7f17a8bbd640 1 -- 172.21.15.31:0/1252987616 reap_dead start 2024-04-15T00:21:06.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.680+0000 7f17aa620640 1 -- 172.21.15.31:0/1252987616 shutdown_connections 2024-04-15T00:21:06.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.680+0000 7f17aa620640 1 -- 172.21.15.31:0/1252987616 >> 172.21.15.31:0/1252987616 conn(0x7f17a40b9b60 msgr2=0x7f17a40b9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:06.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.680+0000 7f17aa620640 1 -- 172.21.15.31:0/1252987616 shutdown_connections 2024-04-15T00:21:06.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.680+0000 7f17aa620640 1 -- 172.21.15.31:0/1252987616 wait complete. 2024-04-15T00:21:06.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.681+0000 7f17aa620640 1 Processor -- start 2024-04-15T00:21:06.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.681+0000 7f17aa620640 1 -- start start 2024-04-15T00:21:06.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.682+0000 7f17aa620640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f178c003f30 0x7f17a40b2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:06.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.682+0000 7f17aa620640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17a40b2940 0x7f17a4142600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:06.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.682+0000 7f17aa620640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f17a40b10c0 0x7f17a40b1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:06.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.682+0000 7f17aa620640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f17a40b7920 con 0x7f178c003f30 2024-04-15T00:21:06.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.682+0000 7f17aa620640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f17a40b8350 con 0x7f17a40b2940 2024-04-15T00:21:06.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.682+0000 7f17aa620640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f17a4070660 con 0x7f17a40b10c0 2024-04-15T00:21:06.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.682+0000 7f17a3fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f178c003f30 0x7f17a40b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:06.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.682+0000 7f17a3fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f178c003f30 0x7f17a40b2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58614/0 (socket says 172.21.15.31:58614) 2024-04-15T00:21:06.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.682+0000 7f17a3fff640 1 -- 172.21.15.31:0/3828653949 learned_addr learned my addr 172.21.15.31:0/3828653949 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:06.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.682+0000 7f17a37fe640 1 --2- 172.21.15.31:0/3828653949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17a40b2940 0x7f17a4142600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:06.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.682+0000 7f17a8bbd640 1 --2- 172.21.15.31:0/3828653949 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f17a40b10c0 0x7f17a40b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:06.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.682+0000 7f17a3fff640 1 -- 172.21.15.31:0/3828653949 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f17a40b10c0 msgr2=0x7f17a40b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:06.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.682+0000 7f17a3fff640 1 --2- 172.21.15.31:0/3828653949 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f17a40b10c0 0x7f17a40b1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:06.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.682+0000 7f17a3fff640 1 -- 172.21.15.31:0/3828653949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17a40b2940 msgr2=0x7f17a4142600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:06.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.682+0000 7f17a3fff640 1 --2- 172.21.15.31:0/3828653949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17a40b2940 0x7f17a4142600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:06.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.682+0000 7f17a3fff640 1 -- 172.21.15.31:0/3828653949 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a40b3c80 con 0x7f178c003f30 2024-04-15T00:21:06.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.682+0000 7f17a3fff640 1 --2- 172.21.15.31:0/3828653949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f178c003f30 0x7f17a40b2380 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1794010c00 tx=0x7f179400e540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:06.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.682+0000 7f17a0ff9640 1 -- 172.21.15.31:0/3828653949 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179400f040 con 0x7f178c003f30 2024-04-15T00:21:06.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.682+0000 7f17a0ff9640 1 -- 172.21.15.31:0/3828653949 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f179400ee50 con 0x7f178c003f30 2024-04-15T00:21:06.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.682+0000 7f17aa620640 1 -- 172.21.15.31:0/3828653949 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17a40b2fa0 con 0x7f178c003f30 2024-04-15T00:21:06.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.682+0000 7f17a0ff9640 1 -- 172.21.15.31:0/3828653949 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179401c600 con 0x7f178c003f30 2024-04-15T00:21:06.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.682+0000 7f17aa620640 1 -- 172.21.15.31:0/3828653949 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17a41ddf20 con 0x7f178c003f30 2024-04-15T00:21:06.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.683+0000 7f17aa620640 1 -- 172.21.15.31:0/3828653949 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17a40b2d20 con 0x7f178c003f30 2024-04-15T00:21:06.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.684+0000 7f17a0ff9640 1 -- 172.21.15.31:0/3828653949 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f17940253f0 con 0x7f178c003f30 2024-04-15T00:21:06.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.684+0000 7f17a0ff9640 1 --2- 172.21.15.31:0/3828653949 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f179006b9c0 0x7f179006de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:06.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.684+0000 7f17a0ff9640 1 -- 172.21.15.31:0/3828653949 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f179408ad20 con 0x7f178c003f30 2024-04-15T00:21:06.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.684+0000 7f17a37fe640 1 --2- 172.21.15.31:0/3828653949 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f179006b9c0 0x7f179006de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:06.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.685+0000 7f17a37fe640 1 --2- 172.21.15.31:0/3828653949 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f179006b9c0 0x7f179006de80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1798034000 tx=0x7f1798009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:06.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.689+0000 7f17a0ff9640 1 -- 172.21.15.31:0/3828653949 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f17a40b2d20 con 0x7f178c003f30 2024-04-15T00:21:06.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:06.869+0000 7f17aa620640 1 -- 172.21.15.31:0/3828653949 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f17a404f540 con 0x7f178c003f30 2024-04-15T00:21:07.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.553+0000 7f17a0ff9640 1 -- 172.21.15.31:0/3828653949 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) ==== 171+0+0 (secure 0 0 0) 0x7f17a40b3c80 con 0x7f178c003f30 2024-04-15T00:21:07.560 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2024-04-15T00:21:07.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.556+0000 7f17aa620640 1 -- 172.21.15.31:0/3828653949 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f179006b9c0 msgr2=0x7f179006de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:07.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.556+0000 7f17aa620640 1 --2- 172.21.15.31:0/3828653949 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f179006b9c0 0x7f179006de80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1798034000 tx=0x7f1798009030 comp rx=0 tx=0).stop 2024-04-15T00:21:07.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.556+0000 7f17aa620640 1 -- 172.21.15.31:0/3828653949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f178c003f30 msgr2=0x7f17a40b2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:07.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.556+0000 7f17aa620640 1 --2- 172.21.15.31:0/3828653949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f178c003f30 0x7f17a40b2380 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1794010c00 tx=0x7f179400e540 comp rx=0 tx=0).stop 2024-04-15T00:21:07.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.556+0000 7f17aa620640 1 -- 172.21.15.31:0/3828653949 shutdown_connections 2024-04-15T00:21:07.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.556+0000 7f17aa620640 1 --2- 172.21.15.31:0/3828653949 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f179006b9c0 0x7f179006de80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:07.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.556+0000 7f17aa620640 1 --2- 172.21.15.31:0/3828653949 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f17a40b10c0 0x7f17a40b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:07.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.556+0000 7f17aa620640 1 --2- 172.21.15.31:0/3828653949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17a40b2940 0x7f17a4142600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:07.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.556+0000 7f17aa620640 1 --2- 172.21.15.31:0/3828653949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f178c003f30 0x7f17a40b2380 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:07.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.556+0000 7f17aa620640 1 -- 172.21.15.31:0/3828653949 >> 172.21.15.31:0/3828653949 conn(0x7f17a40b9b60 msgr2=0x7f17a40b9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:07.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.556+0000 7f17aa620640 1 -- 172.21.15.31:0/3828653949 shutdown_connections 2024-04-15T00:21:07.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.556+0000 7f17aa620640 1 -- 172.21.15.31:0/3828653949 wait complete. 2024-04-15T00:21:07.589 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-15T00:21:07.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.690+0000 7fb36dbcc640 1 Processor -- start 2024-04-15T00:21:07.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.690+0000 7fb36dbcc640 1 -- start start 2024-04-15T00:21:07.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.691+0000 7fb36dbcc640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb368072820 0x7fb3680b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:07.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.691+0000 7fb36dbcc640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb368072c00 con 0x7fb3680b7800 2024-04-15T00:21:07.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.691+0000 7fb36dbcc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb36809c150 con 0x7fb3680b2d50 2024-04-15T00:21:07.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.691+0000 7fb36dbcc640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fb36809c430 con 0x7fb368072820 2024-04-15T00:21:07.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.691+0000 7fb366ffd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb3680b7800 0x7fb3681416b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57478/0 (socket says 172.21.15.31:57478) 2024-04-15T00:21:07.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.691+0000 7fb366ffd640 1 -- 172.21.15.31:0/110896546 learned_addr learned my addr 172.21.15.31:0/110896546 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:07.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.691+0000 7fb3677fe640 1 --2- 172.21.15.31:0/110896546 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb368072820 0x7fb3680b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:07.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.691+0000 7fb3667fc640 1 -- 172.21.15.31:0/110896546 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3797444950 0 0) 0x7fb368072c00 con 0x7fb3680b7800 2024-04-15T00:21:07.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.691+0000 7fb3667fc640 1 -- 172.21.15.31:0/110896546 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb350003520 con 0x7fb3680b7800 2024-04-15T00:21:07.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.691+0000 7fb3667fc640 1 -- 172.21.15.31:0/110896546 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1402116800 0 0) 0x7fb36809c150 con 0x7fb3680b2d50 2024-04-15T00:21:07.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.692+0000 7fb3667fc640 1 -- 172.21.15.31:0/110896546 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb368072c00 con 0x7fb3680b2d50 2024-04-15T00:21:07.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.692+0000 7fb3667fc640 1 -- 172.21.15.31:0/110896546 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2356528894 0 0) 0x7fb350003520 con 0x7fb3680b7800 2024-04-15T00:21:07.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.692+0000 7fb3667fc640 1 -- 172.21.15.31:0/110896546 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb368072820 msgr2=0x7fb3680b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:07.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.692+0000 7fb3667fc640 1 --2- 172.21.15.31:0/110896546 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb368072820 0x7fb3680b2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:07.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.692+0000 7fb3667fc640 1 -- 172.21.15.31:0/110896546 >> v1:172.21.15.50:6789/0 conn(0x7fb3680b2d50 legacy=0x7fb368152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:07.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.692+0000 7fb3667fc640 1 -- 172.21.15.31:0/110896546 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3680b3cb0 con 0x7fb3680b7800 2024-04-15T00:21:07.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.692+0000 7fb3667fc640 1 -- 172.21.15.31:0/110896546 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 697057150 0 0) 0x7fb35c001670 con 0x7fb3680b7800 2024-04-15T00:21:07.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.692+0000 7fb3667fc640 1 -- 172.21.15.31:0/110896546 >> v1:172.21.15.31:6789/0 conn(0x7fb3680b7800 legacy=0x7fb3681416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:07.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.692+0000 7fb3667fc640 1 --2- 172.21.15.31:0/110896546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb350003b70 0x7fb350003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:07.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.692+0000 7fb3667fc640 1 --2- 172.21.15.31:0/110896546 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb368072820 0x7fb350004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:07.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.692+0000 7fb3667fc640 1 --2- 172.21.15.31:0/110896546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb350004d40 0x7fb3500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:07.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.692+0000 7fb3667fc640 1 -- 172.21.15.31:0/110896546 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb36809c430 con 0x7fb350004d40 2024-04-15T00:21:07.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.692+0000 7fb3667fc640 1 -- 172.21.15.31:0/110896546 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb35000bb50 con 0x7fb350003b70 2024-04-15T00:21:07.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.692+0000 7fb3667fc640 1 -- 172.21.15.31:0/110896546 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fb35000bd20 con 0x7fb368072820 2024-04-15T00:21:07.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.692+0000 7fb367fff640 1 --2- 172.21.15.31:0/110896546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb350004d40 0x7fb3500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:07.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.692+0000 7fb3677fe640 1 --2- 172.21.15.31:0/110896546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb350003b70 0x7fb350003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:07.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.692+0000 7fb366ffd640 1 --2- 172.21.15.31:0/110896546 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb368072820 0x7fb350004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:07.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.692+0000 7fb367fff640 1 -- 172.21.15.31:0/110896546 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb368072820 msgr2=0x7fb350004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:07.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.692+0000 7fb367fff640 1 --2- 172.21.15.31:0/110896546 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb368072820 0x7fb350004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:07.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.692+0000 7fb367fff640 1 -- 172.21.15.31:0/110896546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb350003b70 msgr2=0x7fb350003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:07.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.692+0000 7fb367fff640 1 --2- 172.21.15.31:0/110896546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb350003b70 0x7fb350003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:07.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.692+0000 7fb367fff640 1 -- 172.21.15.31:0/110896546 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb350003520 con 0x7fb350004d40 2024-04-15T00:21:07.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.693+0000 7fb367fff640 1 --2- 172.21.15.31:0/110896546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb350004d40 0x7fb3500051c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb360001fa0 tx=0x7fb350005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d904bac626f8557 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:07.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.693+0000 7fb3667fc640 1 -- 172.21.15.31:0/110896546 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb360001bf0 con 0x7fb350004d40 2024-04-15T00:21:07.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.693+0000 7fb3667fc640 1 -- 172.21.15.31:0/110896546 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb360003b70 con 0x7fb350004d40 2024-04-15T00:21:07.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.693+0000 7fb3667fc640 1 -- 172.21.15.31:0/110896546 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3600050d0 con 0x7fb350004d40 2024-04-15T00:21:07.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.693+0000 7fb36dbcc640 1 -- 172.21.15.31:0/110896546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb350004d40 msgr2=0x7fb3500051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:07.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.693+0000 7fb36dbcc640 1 --2- 172.21.15.31:0/110896546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb350004d40 0x7fb3500051c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb360001fa0 tx=0x7fb350005830 comp rx=0 tx=0).stop 2024-04-15T00:21:07.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.693+0000 7fb367fff640 1 -- 172.21.15.31:0/110896546 reap_dead start 2024-04-15T00:21:07.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.693+0000 7fb36dbcc640 1 -- 172.21.15.31:0/110896546 shutdown_connections 2024-04-15T00:21:07.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.693+0000 7fb36dbcc640 1 -- 172.21.15.31:0/110896546 >> 172.21.15.31:0/110896546 conn(0x7fb3680bce80 msgr2=0x7fb3680bd290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:07.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.694+0000 7fb36dbcc640 1 -- 172.21.15.31:0/110896546 shutdown_connections 2024-04-15T00:21:07.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.694+0000 7fb36dbcc640 1 -- 172.21.15.31:0/110896546 wait complete. 2024-04-15T00:21:07.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.694+0000 7fb36dbcc640 1 Processor -- start 2024-04-15T00:21:07.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.695+0000 7fb36dbcc640 1 -- start start 2024-04-15T00:21:07.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.695+0000 7fb36dbcc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb350004d40 0x7fb3681474b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:07.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.695+0000 7fb36dbcc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb368143540 0x7fb3681439c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:07.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.695+0000 7fb36dbcc640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb36813a060 0x7fb36813a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:07.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.695+0000 7fb36dbcc640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb3680b8ed0 con 0x7fb350004d40 2024-04-15T00:21:07.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.695+0000 7fb36dbcc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb3680b8d50 con 0x7fb368143540 2024-04-15T00:21:07.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.695+0000 7fb36dbcc640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fb3680b82b0 con 0x7fb36813a060 2024-04-15T00:21:07.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.695+0000 7fb3677fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb350004d40 0x7fb3681474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:07.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.695+0000 7fb3677fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb350004d40 0x7fb3681474b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58632/0 (socket says 172.21.15.31:58632) 2024-04-15T00:21:07.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.695+0000 7fb3677fe640 1 -- 172.21.15.31:0/1797474718 learned_addr learned my addr 172.21.15.31:0/1797474718 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:07.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.696+0000 7fb366ffd640 1 --2- 172.21.15.31:0/1797474718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb368143540 0x7fb3681439c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:07.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.696+0000 7fb3677fe640 1 -- 172.21.15.31:0/1797474718 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb36813a060 msgr2=0x7fb36813a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.696+0000 7fb3677fe640 1 --2- 172.21.15.31:0/1797474718 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb36813a060 0x7fb36813a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.696+0000 7fb3677fe640 1 -- 172.21.15.31:0/1797474718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb368143540 msgr2=0x7fb3681439c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.696+0000 7fb3677fe640 1 --2- 172.21.15.31:0/1797474718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb368143540 0x7fb3681439c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.696+0000 7fb3677fe640 1 -- 172.21.15.31:0/1797474718 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb368143f00 con 0x7fb350004d40 2024-04-15T00:21:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.696+0000 7fb3677fe640 1 --2- 172.21.15.31:0/1797474718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb350004d40 0x7fb3681474b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb3580119a0 tx=0x7fb358011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.696+0000 7fb34ffff640 1 -- 172.21.15.31:0/1797474718 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb35800fa10 con 0x7fb350004d40 2024-04-15T00:21:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.696+0000 7fb34ffff640 1 -- 172.21.15.31:0/1797474718 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb35800fbb0 con 0x7fb350004d40 2024-04-15T00:21:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.696+0000 7fb36dbcc640 1 -- 172.21.15.31:0/1797474718 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3680b4ea0 con 0x7fb350004d40 2024-04-15T00:21:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.696+0000 7fb34ffff640 1 -- 172.21.15.31:0/1797474718 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb358014440 con 0x7fb350004d40 2024-04-15T00:21:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.696+0000 7fb36dbcc640 1 -- 172.21.15.31:0/1797474718 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb368144940 con 0x7fb350004d40 2024-04-15T00:21:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.697+0000 7fb36dbcc640 1 -- 172.21.15.31:0/1797474718 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb36804f540 con 0x7fb350004d40 2024-04-15T00:21:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.698+0000 7fb34ffff640 1 -- 172.21.15.31:0/1797474718 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fb358012040 con 0x7fb350004d40 2024-04-15T00:21:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.698+0000 7fb34ffff640 1 --2- 172.21.15.31:0/1797474718 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb35406b9c0 0x7fb35406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.698+0000 7fb34ffff640 1 -- 172.21.15.31:0/1797474718 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7fb35808acd0 con 0x7fb350004d40 2024-04-15T00:21:07.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.698+0000 7fb366ffd640 1 --2- 172.21.15.31:0/1797474718 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb35406b9c0 0x7fb35406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:07.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.698+0000 7fb366ffd640 1 --2- 172.21.15.31:0/1797474718 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb35406b9c0 0x7fb35406de80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb36809b5a0 tx=0x7fb35c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:07.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.703+0000 7fb34ffff640 1 -- 172.21.15.31:0/1797474718 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb368143f00 con 0x7fb350004d40 2024-04-15T00:21:07.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:07.923+0000 7fb36dbcc640 1 -- 172.21.15.31:0/1797474718 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb36813aa20 con 0x7fb350004d40 2024-04-15T00:21:08.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.574+0000 7fb34ffff640 1 -- 172.21.15.31:0/1797474718 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fb358019030 con 0x7fb350004d40 2024-04-15T00:21:08.582 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 2 and data pool 3 2024-04-15T00:21:08.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.580+0000 7fb36dbcc640 1 -- 172.21.15.31:0/1797474718 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb35406b9c0 msgr2=0x7fb35406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:08.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.580+0000 7fb36dbcc640 1 --2- 172.21.15.31:0/1797474718 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb35406b9c0 0x7fb35406de80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb36809b5a0 tx=0x7fb35c009040 comp rx=0 tx=0).stop 2024-04-15T00:21:08.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.580+0000 7fb36dbcc640 1 -- 172.21.15.31:0/1797474718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb350004d40 msgr2=0x7fb3681474b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:08.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.580+0000 7fb36dbcc640 1 --2- 172.21.15.31:0/1797474718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb350004d40 0x7fb3681474b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb3580119a0 tx=0x7fb358011e60 comp rx=0 tx=0).stop 2024-04-15T00:21:08.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.582+0000 7fb36dbcc640 1 -- 172.21.15.31:0/1797474718 shutdown_connections 2024-04-15T00:21:08.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.582+0000 7fb36dbcc640 1 --2- 172.21.15.31:0/1797474718 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb35406b9c0 0x7fb35406de80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:08.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.582+0000 7fb36dbcc640 1 --2- 172.21.15.31:0/1797474718 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb36813a060 0x7fb36813a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:08.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.582+0000 7fb36dbcc640 1 --2- 172.21.15.31:0/1797474718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb368143540 0x7fb3681439c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:08.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.582+0000 7fb36dbcc640 1 --2- 172.21.15.31:0/1797474718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb350004d40 0x7fb3681474b0 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb3580119a0 tx=0x7fb358011e60 comp rx=0 tx=0).stop 2024-04-15T00:21:08.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.582+0000 7fb36dbcc640 1 -- 172.21.15.31:0/1797474718 >> 172.21.15.31:0/1797474718 conn(0x7fb3680bce80 msgr2=0x7fb36813d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:08.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.584+0000 7fb36dbcc640 1 -- 172.21.15.31:0/1797474718 shutdown_connections 2024-04-15T00:21:08.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.586+0000 7fb36dbcc640 1 -- 172.21.15.31:0/1797474718 wait complete. 2024-04-15T00:21:08.614 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-15T00:21:08.614 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-15T00:21:08.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.717+0000 7fc0dff68640 1 Processor -- start 2024-04-15T00:21:08.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.718+0000 7fc0dff68640 1 -- start start 2024-04-15T00:21:08.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.718+0000 7fc0dff68640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc0d8072820 0x7fc0d80b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:08.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.718+0000 7fc0dff68640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc0d80b77e0 0x7fc0d8141690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:08.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.718+0000 7fc0dff68640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc0d80b8a80 0x7fc0d814acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:08.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.718+0000 7fc0dff68640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fc0d8072c00 con 0x7fc0d8072820 2024-04-15T00:21:08.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.718+0000 7fc0dff68640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc0d809c400 con 0x7fc0d80b77e0 2024-04-15T00:21:08.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.718+0000 7fc0dff68640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fc0d80b8560 con 0x7fc0d80b8a80 2024-04-15T00:21:08.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.718+0000 7fc0ddd04640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc0d8072820 0x7fc0d80b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:08.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.718+0000 7fc0ddd04640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc0d8072820 0x7fc0d80b2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58648/0 (socket says 172.21.15.31:58648) 2024-04-15T00:21:08.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.718+0000 7fc0ddd04640 1 -- 172.21.15.31:0/941075198 learned_addr learned my addr 172.21.15.31:0/941075198 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:08.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.719+0000 7fc0dd503640 1 --2- 172.21.15.31:0/941075198 >> v2:172.21.15.50:3300/0 conn(0x7fc0d80b77e0 0x7fc0d8141690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:08.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.719+0000 7fc0de505640 1 --2- 172.21.15.31:0/941075198 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc0d80b8a80 0x7fc0d814acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:08.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.719+0000 7fc0ddd04640 1 -- 172.21.15.31:0/941075198 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc0d80b8a80 msgr2=0x7fc0d814acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:08.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.719+0000 7fc0ddd04640 1 --2- 172.21.15.31:0/941075198 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc0d80b8a80 0x7fc0d814acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:08.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.719+0000 7fc0ddd04640 1 -- 172.21.15.31:0/941075198 >> v2:172.21.15.50:3300/0 conn(0x7fc0d80b77e0 msgr2=0x7fc0d8141690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:08.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.719+0000 7fc0ddd04640 1 --2- 172.21.15.31:0/941075198 >> v2:172.21.15.50:3300/0 conn(0x7fc0d80b77e0 0x7fc0d8141690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:08.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.719+0000 7fc0ddd04640 1 -- 172.21.15.31:0/941075198 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d80b3b70 con 0x7fc0d8072820 2024-04-15T00:21:08.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.719+0000 7fc0ddd04640 1 --2- 172.21.15.31:0/941075198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0d8072820 0x7fc0d80b2630 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8067ed0 tx=0x7fc0d402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=112442d682af68bd server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:08.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.720+0000 7fc0dcd02640 1 -- 172.21.15.31:0/941075198 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4035020 con 0x7fc0d8072820 2024-04-15T00:21:08.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.720+0000 7fc0dcd02640 1 -- 172.21.15.31:0/941075198 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0d4031870 con 0x7fc0d8072820 2024-04-15T00:21:08.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.720+0000 7fc0dcd02640 1 -- 172.21.15.31:0/941075198 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4031c40 con 0x7fc0d8072820 2024-04-15T00:21:08.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.720+0000 7fc0dff68640 1 -- 172.21.15.31:0/941075198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0d8072820 msgr2=0x7fc0d80b2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:08.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.720+0000 7fc0dff68640 1 --2- 172.21.15.31:0/941075198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0d8072820 0x7fc0d80b2630 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8067ed0 tx=0x7fc0d402b910 comp rx=0 tx=0).stop 2024-04-15T00:21:08.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.720+0000 7fc0dff68640 1 -- 172.21.15.31:0/941075198 shutdown_connections 2024-04-15T00:21:08.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.720+0000 7fc0dff68640 1 --2- 172.21.15.31:0/941075198 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc0d80b8a80 0x7fc0d814acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:08.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.720+0000 7fc0dff68640 1 --2- 172.21.15.31:0/941075198 >> v2:172.21.15.50:3300/0 conn(0x7fc0d80b77e0 0x7fc0d8141690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:08.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.720+0000 7fc0dff68640 1 --2- 172.21.15.31:0/941075198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0d8072820 0x7fc0d80b2630 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:08.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.720+0000 7fc0dff68640 1 -- 172.21.15.31:0/941075198 >> 172.21.15.31:0/941075198 conn(0x7fc0d80bce60 msgr2=0x7fc0d80bd270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:08.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.720+0000 7fc0dff68640 1 -- 172.21.15.31:0/941075198 shutdown_connections 2024-04-15T00:21:08.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.720+0000 7fc0dff68640 1 -- 172.21.15.31:0/941075198 wait complete. 2024-04-15T00:21:08.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.721+0000 7fc0dff68640 1 Processor -- start 2024-04-15T00:21:08.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.721+0000 7fc0dff68640 1 -- start start 2024-04-15T00:21:08.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.722+0000 7fc0dff68640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0d8072820 0x7fc0d809edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:08.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.722+0000 7fc0dff68640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc0d80b77e0 0x7fc0d81dd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:08.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.722+0000 7fc0dff68640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0d80b8a80 0x7fc0d81e07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:08.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.722+0000 7fc0dff68640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d809c010 con 0x7fc0d8072820 2024-04-15T00:21:08.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.722+0000 7fc0dff68640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d809be90 con 0x7fc0d80b8a80 2024-04-15T00:21:08.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.722+0000 7fc0dff68640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fc0d809c190 con 0x7fc0d80b77e0 2024-04-15T00:21:08.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.722+0000 7fc0ddd04640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0d8072820 0x7fc0d809edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:08.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.722+0000 7fc0ddd04640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0d8072820 0x7fc0d809edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58652/0 (socket says 172.21.15.31:58652) 2024-04-15T00:21:08.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.722+0000 7fc0ddd04640 1 -- 172.21.15.31:0/3470484295 learned_addr learned my addr 172.21.15.31:0/3470484295 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:08.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.722+0000 7fc0de505640 1 --2- 172.21.15.31:0/3470484295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0d80b8a80 0x7fc0d81e07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:08.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.722+0000 7fc0ddd04640 1 -- 172.21.15.31:0/3470484295 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc0d80b77e0 msgr2=0x7fc0d81dd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:08.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.722+0000 7fc0dd503640 1 --2- 172.21.15.31:0/3470484295 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc0d80b77e0 0x7fc0d81dd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:08.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.722+0000 7fc0ddd04640 1 --2- 172.21.15.31:0/3470484295 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc0d80b77e0 0x7fc0d81dd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:08.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.722+0000 7fc0ddd04640 1 -- 172.21.15.31:0/3470484295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0d80b8a80 msgr2=0x7fc0d81e07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:08.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.722+0000 7fc0ddd04640 1 --2- 172.21.15.31:0/3470484295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0d80b8a80 0x7fc0d81e07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:08.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.722+0000 7fc0ddd04640 1 -- 172.21.15.31:0/3470484295 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d80b6ea0 con 0x7fc0d8072820 2024-04-15T00:21:08.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.722+0000 7fc0de505640 1 --2- 172.21.15.31:0/3470484295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0d80b8a80 0x7fc0d81e07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:21:08.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.722+0000 7fc0ddd04640 1 --2- 172.21.15.31:0/3470484295 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0d8072820 0x7fc0d809edd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc0d40097c0 tx=0x7fc0d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:08.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.723+0000 7fc0ce7fc640 1 -- 172.21.15.31:0/3470484295 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4040070 con 0x7fc0d8072820 2024-04-15T00:21:08.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.723+0000 7fc0ce7fc640 1 -- 172.21.15.31:0/3470484295 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0d4030d00 con 0x7fc0d8072820 2024-04-15T00:21:08.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.723+0000 7fc0dff68640 1 -- 172.21.15.31:0/3470484295 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0d81453c0 con 0x7fc0d8072820 2024-04-15T00:21:08.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.723+0000 7fc0ce7fc640 1 -- 172.21.15.31:0/3470484295 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4035040 con 0x7fc0d8072820 2024-04-15T00:21:08.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.723+0000 7fc0dff68640 1 -- 172.21.15.31:0/3470484295 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0d8145ba0 con 0x7fc0d8072820 2024-04-15T00:21:08.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.724+0000 7fc0dff68640 1 -- 172.21.15.31:0/3470484295 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0d80b1ec0 con 0x7fc0d8072820 2024-04-15T00:21:08.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.724+0000 7fc0ce7fc640 1 -- 172.21.15.31:0/3470484295 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc0d404b060 con 0x7fc0d8072820 2024-04-15T00:21:08.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.724+0000 7fc0ce7fc640 1 --2- 172.21.15.31:0/3470484295 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc0bc06b990 0x7fc0bc06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:08.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.724+0000 7fc0ce7fc640 1 -- 172.21.15.31:0/3470484295 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc0d40ac580 con 0x7fc0d8072820 2024-04-15T00:21:08.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.724+0000 7fc0dd503640 1 --2- 172.21.15.31:0/3470484295 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc0bc06b990 0x7fc0bc06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:08.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.725+0000 7fc0dd503640 1 --2- 172.21.15.31:0/3470484295 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc0bc06b990 0x7fc0bc06de50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc0d813cc80 tx=0x7fc0c8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:08.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.729+0000 7fc0ce7fc640 1 -- 172.21.15.31:0/3470484295 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc0d407b180 con 0x7fc0d8072820 2024-04-15T00:21:08.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:08.918+0000 7fc0dff68640 1 -- 172.21.15.31:0/3470484295 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fc0d804f620 con 0x7fc0d8072820 2024-04-15T00:21:09.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.576+0000 7fc0ce7fc640 1 -- 172.21.15.31:0/3470484295 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) ==== 157+0+0 (secure 0 0 0) 0x7fc0d407aa80 con 0x7fc0d8072820 2024-04-15T00:21:09.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.578+0000 7fc0dff68640 1 -- 172.21.15.31:0/3470484295 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc0bc06b990 msgr2=0x7fc0bc06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:09.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.578+0000 7fc0dff68640 1 --2- 172.21.15.31:0/3470484295 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc0bc06b990 0x7fc0bc06de50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc0d813cc80 tx=0x7fc0c8008040 comp rx=0 tx=0).stop 2024-04-15T00:21:09.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.578+0000 7fc0dff68640 1 -- 172.21.15.31:0/3470484295 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0d8072820 msgr2=0x7fc0d809edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:09.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.578+0000 7fc0dff68640 1 --2- 172.21.15.31:0/3470484295 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0d8072820 0x7fc0d809edd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc0d40097c0 tx=0x7fc0d40046c0 comp rx=0 tx=0).stop 2024-04-15T00:21:09.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.579+0000 7fc0dff68640 1 -- 172.21.15.31:0/3470484295 shutdown_connections 2024-04-15T00:21:09.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.579+0000 7fc0dff68640 1 --2- 172.21.15.31:0/3470484295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0d80b8a80 0x7fc0d81e07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:09.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.579+0000 7fc0dff68640 1 --2- 172.21.15.31:0/3470484295 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc0bc06b990 0x7fc0bc06de50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:09.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.579+0000 7fc0dff68640 1 --2- 172.21.15.31:0/3470484295 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc0d80b77e0 0x7fc0d81dd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:09.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.579+0000 7fc0dff68640 1 --2- 172.21.15.31:0/3470484295 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0d8072820 0x7fc0d809edd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:09.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.579+0000 7fc0dff68640 1 -- 172.21.15.31:0/3470484295 >> 172.21.15.31:0/3470484295 conn(0x7fc0d80bce60 msgr2=0x7fc0d813f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:09.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.579+0000 7fc0dff68640 1 -- 172.21.15.31:0/3470484295 shutdown_connections 2024-04-15T00:21:09.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.579+0000 7fc0dff68640 1 -- 172.21.15.31:0/3470484295 wait complete. 2024-04-15T00:21:09.601 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-15T00:21:09.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.711+0000 7f2896676640 1 Processor -- start 2024-04-15T00:21:09.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.711+0000 7f2896676640 1 -- start start 2024-04-15T00:21:09.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.711+0000 7f2896676640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f28900baef0 0x7f2890147670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:09.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.711+0000 7f2896676640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f289014b8e0 0x7f28900b9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:09.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.711+0000 7f2896676640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28900bb2d0 con 0x7f28900b8bf0 2024-04-15T00:21:09.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.711+0000 7f2896676640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f2890147bb0 con 0x7f28900baef0 2024-04-15T00:21:09.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.711+0000 7f2896676640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f289014ae00 con 0x7f289014b8e0 2024-04-15T00:21:09.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.711+0000 7f288ffff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f28900baef0 0x7f2890147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:09.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.711+0000 7f288ffff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f28900baef0 0x7f2890147670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58662/0 (socket says 172.21.15.31:58662) 2024-04-15T00:21:09.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.711+0000 7f288ffff640 1 -- 172.21.15.31:0/2513378240 learned_addr learned my addr 172.21.15.31:0/2513378240 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:09.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.712+0000 7f288f7fe640 1 --2- 172.21.15.31:0/2513378240 >> v2:172.21.15.50:3300/0 conn(0x7f289014b8e0 0x7f28900b9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:09.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.712+0000 7f288ffff640 1 -- 172.21.15.31:0/2513378240 >> v2:172.21.15.50:3300/0 conn(0x7f289014b8e0 msgr2=0x7f28900b9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:09.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.712+0000 7f288ffff640 1 --2- 172.21.15.31:0/2513378240 >> v2:172.21.15.50:3300/0 conn(0x7f289014b8e0 0x7f28900b9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:09.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.712+0000 7f288ffff640 1 -- 172.21.15.31:0/2513378240 >> v1:172.21.15.50:6789/0 conn(0x7f28900b8bf0 legacy=0x7f2890072600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:09.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.712+0000 7f288ffff640 1 -- 172.21.15.31:0/2513378240 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f289014b0e0 con 0x7f28900baef0 2024-04-15T00:21:09.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.712+0000 7f288f7fe640 1 --2- 172.21.15.31:0/2513378240 >> v2:172.21.15.50:3300/0 conn(0x7f289014b8e0 0x7f28900b9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:21:09.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.712+0000 7f288ffff640 1 --2- 172.21.15.31:0/2513378240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28900baef0 0x7f2890147670 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f28900737c0 tx=0x7f288002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9168d954af87709f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:09.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.713+0000 7f288effd640 1 -- 172.21.15.31:0/2513378240 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288002e070 con 0x7f28900baef0 2024-04-15T00:21:09.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.713+0000 7f288effd640 1 -- 172.21.15.31:0/2513378240 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2880037070 con 0x7f28900baef0 2024-04-15T00:21:09.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.713+0000 7f288effd640 1 -- 172.21.15.31:0/2513378240 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2880031a00 con 0x7f28900baef0 2024-04-15T00:21:09.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.713+0000 7f2896676640 1 -- 172.21.15.31:0/2513378240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28900baef0 msgr2=0x7f2890147670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:09.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.713+0000 7f2896676640 1 --2- 172.21.15.31:0/2513378240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28900baef0 0x7f2890147670 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f28900737c0 tx=0x7f288002b880 comp rx=0 tx=0).stop 2024-04-15T00:21:09.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.713+0000 7f2896676640 1 -- 172.21.15.31:0/2513378240 shutdown_connections 2024-04-15T00:21:09.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.713+0000 7f2896676640 1 --2- 172.21.15.31:0/2513378240 >> v2:172.21.15.50:3300/0 conn(0x7f289014b8e0 0x7f28900b9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:09.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.713+0000 7f2896676640 1 --2- 172.21.15.31:0/2513378240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28900baef0 0x7f2890147670 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:09.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.713+0000 7f2896676640 1 -- 172.21.15.31:0/2513378240 >> 172.21.15.31:0/2513378240 conn(0x7f289009ed70 msgr2=0x7f289009f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:09.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.713+0000 7f2896676640 1 -- 172.21.15.31:0/2513378240 shutdown_connections 2024-04-15T00:21:09.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.713+0000 7f2896676640 1 -- 172.21.15.31:0/2513378240 wait complete. 2024-04-15T00:21:09.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.714+0000 7f2896676640 1 Processor -- start 2024-04-15T00:21:09.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.714+0000 7f2896676640 1 -- start start 2024-04-15T00:21:09.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.715+0000 7f2896676640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f28900b8bf0 0x7f28901d0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:09.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.715+0000 7f2896676640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28900baef0 0x7f28900a2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:09.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.715+0000 7f2896676640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f289014b8e0 0x7f28900a1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:09.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.715+0000 7f2896676640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f28900ba0d0 con 0x7f289014b8e0 2024-04-15T00:21:09.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.715+0000 7f2896676640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f28900b9f50 con 0x7f28900baef0 2024-04-15T00:21:09.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.715+0000 7f2896676640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f28900b9000 con 0x7f28900b8bf0 2024-04-15T00:21:09.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.715+0000 7f2894c13640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f289014b8e0 0x7f28900a1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:09.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.715+0000 7f2894c13640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f289014b8e0 0x7f28900a1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58666/0 (socket says 172.21.15.31:58666) 2024-04-15T00:21:09.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.715+0000 7f2894c13640 1 -- 172.21.15.31:0/546987805 learned_addr learned my addr 172.21.15.31:0/546987805 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:09.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.715+0000 7f288ffff640 1 --2- 172.21.15.31:0/546987805 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f28900b8bf0 0x7f28901d0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:09.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.715+0000 7f288f7fe640 1 --2- 172.21.15.31:0/546987805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28900baef0 0x7f28900a2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:09.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.715+0000 7f2894c13640 1 -- 172.21.15.31:0/546987805 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f28900b8bf0 msgr2=0x7f28901d0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:09.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.715+0000 7f2894c13640 1 --2- 172.21.15.31:0/546987805 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f28900b8bf0 0x7f28901d0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:09.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.715+0000 7f2894c13640 1 -- 172.21.15.31:0/546987805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28900baef0 msgr2=0x7f28900a2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:09.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.715+0000 7f2894c13640 1 --2- 172.21.15.31:0/546987805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28900baef0 0x7f28900a2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:09.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.715+0000 7f2894c13640 1 -- 172.21.15.31:0/546987805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28901d1260 con 0x7f289014b8e0 2024-04-15T00:21:09.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.715+0000 7f288ffff640 1 --2- 172.21.15.31:0/546987805 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f28900b8bf0 0x7f28901d0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:09.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.715+0000 7f288f7fe640 1 --2- 172.21.15.31:0/546987805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28900baef0 0x7f28900a2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:09.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.716+0000 7f2894c13640 1 --2- 172.21.15.31:0/546987805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f289014b8e0 0x7f28900a1430 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f288800c780 tx=0x7f288800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:09.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.716+0000 7f288cff9640 1 -- 172.21.15.31:0/546987805 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2888004b60 con 0x7f289014b8e0 2024-04-15T00:21:09.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.716+0000 7f288cff9640 1 -- 172.21.15.31:0/546987805 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2888004d00 con 0x7f289014b8e0 2024-04-15T00:21:09.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.716+0000 7f2896676640 1 -- 172.21.15.31:0/546987805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28900a0c70 con 0x7f289014b8e0 2024-04-15T00:21:09.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.716+0000 7f288cff9640 1 -- 172.21.15.31:0/546987805 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288800aa90 con 0x7f289014b8e0 2024-04-15T00:21:09.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.716+0000 7f2896676640 1 -- 172.21.15.31:0/546987805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28900a2950 con 0x7f289014b8e0 2024-04-15T00:21:09.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.717+0000 7f2896676640 1 -- 172.21.15.31:0/546987805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28900a10f0 con 0x7f289014b8e0 2024-04-15T00:21:09.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.717+0000 7f288cff9640 1 -- 172.21.15.31:0/546987805 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f288800ac30 con 0x7f289014b8e0 2024-04-15T00:21:09.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.718+0000 7f288cff9640 1 --2- 172.21.15.31:0/546987805 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f287c06b990 0x7f287c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:09.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.718+0000 7f288ffff640 1 --2- 172.21.15.31:0/546987805 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f287c06b990 0x7f287c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:09.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.718+0000 7f288cff9640 1 -- 172.21.15.31:0/546987805 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 6007+0+0 (secure 0 0 0) 0x7f288808ab90 con 0x7f289014b8e0 2024-04-15T00:21:09.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.718+0000 7f288ffff640 1 --2- 172.21.15.31:0/546987805 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f287c06b990 0x7f287c06de50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2880036000 tx=0x7f288003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:09.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.722+0000 7f288cff9640 1 -- 172.21.15.31:0/546987805 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2888020070 con 0x7f289014b8e0 2024-04-15T00:21:09.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:09.903+0000 7f2896676640 1 -- 172.21.15.31:0/546987805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f289004f620 con 0x7f289014b8e0 2024-04-15T00:21:10.623 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:21:10.626 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:21:11.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.592+0000 7f288cff9640 1 -- 172.21.15.31:0/546987805 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) ==== 228+0+0 (secure 0 0 0) 0x7f28901d1260 con 0x7f289014b8e0 2024-04-15T00:21:11.600 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data_ec' created 2024-04-15T00:21:11.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.599+0000 7f2896676640 1 -- 172.21.15.31:0/546987805 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f287c06b990 msgr2=0x7f287c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:11.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.599+0000 7f2896676640 1 --2- 172.21.15.31:0/546987805 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f287c06b990 0x7f287c06de50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2880036000 tx=0x7f288003d040 comp rx=0 tx=0).stop 2024-04-15T00:21:11.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.599+0000 7f2896676640 1 -- 172.21.15.31:0/546987805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f289014b8e0 msgr2=0x7f28900a1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:11.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.599+0000 7f2896676640 1 --2- 172.21.15.31:0/546987805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f289014b8e0 0x7f28900a1430 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f288800c780 tx=0x7f288800cc40 comp rx=0 tx=0).stop 2024-04-15T00:21:11.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.601+0000 7f2896676640 1 -- 172.21.15.31:0/546987805 shutdown_connections 2024-04-15T00:21:11.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.601+0000 7f2896676640 1 --2- 172.21.15.31:0/546987805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f289014b8e0 0x7f28900a1430 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:11.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.601+0000 7f2896676640 1 --2- 172.21.15.31:0/546987805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28900baef0 0x7f28900a2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:11.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.601+0000 7f2896676640 1 --2- 172.21.15.31:0/546987805 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f287c06b990 0x7f287c06de50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:11.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.601+0000 7f2896676640 1 --2- 172.21.15.31:0/546987805 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f28900b8bf0 0x7f28901d0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:11.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.601+0000 7f2896676640 1 -- 172.21.15.31:0/546987805 >> 172.21.15.31:0/546987805 conn(0x7f289009ed70 msgr2=0x7f289009bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:11.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.603+0000 7f2896676640 1 -- 172.21.15.31:0/546987805 shutdown_connections 2024-04-15T00:21:11.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.604+0000 7f2896676640 1 -- 172.21.15.31:0/546987805 wait complete. 2024-04-15T00:21:11.625 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-15T00:21:11.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.728+0000 7f7e79436640 1 Processor -- start 2024-04-15T00:21:11.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.728+0000 7f7e79436640 1 -- start start 2024-04-15T00:21:11.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.729+0000 7f7e79436640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7e7409c420 0x7f7e7409b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:11.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.729+0000 7f7e79436640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e7409f880 con 0x7f7e740bbe00 2024-04-15T00:21:11.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.729+0000 7f7e79436640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e7409bc20 con 0x7f7e7409f4a0 2024-04-15T00:21:11.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.729+0000 7f7e79436640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f7e7409b6b0 con 0x7f7e7409c420 2024-04-15T00:21:11.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.729+0000 7f7e737fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7e740bbe00 0x7f7e74151f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57490/0 (socket says 172.21.15.31:57490) 2024-04-15T00:21:11.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.729+0000 7f7e737fe640 1 -- 172.21.15.31:0/2609405532 learned_addr learned my addr 172.21.15.31:0/2609405532 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:11.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.729+0000 7f7e727fc640 1 --2- 172.21.15.31:0/2609405532 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7e7409c420 0x7f7e7409b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:11.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.729+0000 7f7e71ffb640 1 -- 172.21.15.31:0/2609405532 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1816175116 0 0) 0x7f7e7409f880 con 0x7f7e740bbe00 2024-04-15T00:21:11.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.729+0000 7f7e71ffb640 1 -- 172.21.15.31:0/2609405532 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e60003520 con 0x7f7e740bbe00 2024-04-15T00:21:11.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.729+0000 7f7e71ffb640 1 -- 172.21.15.31:0/2609405532 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3011114044 0 0) 0x7f7e7409bc20 con 0x7f7e7409f4a0 2024-04-15T00:21:11.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.729+0000 7f7e71ffb640 1 -- 172.21.15.31:0/2609405532 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e7409f880 con 0x7f7e7409f4a0 2024-04-15T00:21:11.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.729+0000 7f7e71ffb640 1 -- 172.21.15.31:0/2609405532 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 309536227 0 0) 0x7f7e60003520 con 0x7f7e740bbe00 2024-04-15T00:21:11.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.729+0000 7f7e71ffb640 1 -- 172.21.15.31:0/2609405532 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7e7409c420 msgr2=0x7f7e7409b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:11.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.729+0000 7f7e71ffb640 1 --2- 172.21.15.31:0/2609405532 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7e7409c420 0x7f7e7409b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:11.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.729+0000 7f7e71ffb640 1 -- 172.21.15.31:0/2609405532 >> v1:172.21.15.50:6789/0 conn(0x7f7e7409f4a0 legacy=0x7f7e74141730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:11.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.729+0000 7f7e71ffb640 1 -- 172.21.15.31:0/2609405532 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e740bc250 con 0x7f7e740bbe00 2024-04-15T00:21:11.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.729+0000 7f7e71ffb640 1 -- 172.21.15.31:0/2609405532 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 697057150 0 0) 0x7f7e640019f0 con 0x7f7e740bbe00 2024-04-15T00:21:11.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.729+0000 7f7e71ffb640 1 -- 172.21.15.31:0/2609405532 >> v1:172.21.15.31:6789/0 conn(0x7f7e740bbe00 legacy=0x7f7e74151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:11.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.729+0000 7f7e71ffb640 1 --2- 172.21.15.31:0/2609405532 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7e7409c420 0x7f7e60003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:11.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.729+0000 7f7e71ffb640 1 --2- 172.21.15.31:0/2609405532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e600040d0 0x7f7e60004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:11.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.729+0000 7f7e71ffb640 1 --2- 172.21.15.31:0/2609405532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e60004d40 0x7f7e600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:11.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.729+0000 7f7e71ffb640 1 -- 172.21.15.31:0/2609405532 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7409b6b0 con 0x7f7e600040d0 2024-04-15T00:21:11.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.729+0000 7f7e71ffb640 1 -- 172.21.15.31:0/2609405532 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6000bb50 con 0x7f7e60004d40 2024-04-15T00:21:11.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.729+0000 7f7e71ffb640 1 -- 172.21.15.31:0/2609405532 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f7e6000bd20 con 0x7f7e7409c420 2024-04-15T00:21:11.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.729+0000 7f7e727fc640 1 --2- 172.21.15.31:0/2609405532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e600040d0 0x7f7e60004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:11.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.730+0000 7f7e72ffd640 1 --2- 172.21.15.31:0/2609405532 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7e7409c420 0x7f7e60003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:11.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.730+0000 7f7e737fe640 1 --2- 172.21.15.31:0/2609405532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e60004d40 0x7f7e600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:11.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.730+0000 7f7e727fc640 1 -- 172.21.15.31:0/2609405532 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7e7409c420 msgr2=0x7f7e60003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:11.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.730+0000 7f7e727fc640 1 --2- 172.21.15.31:0/2609405532 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7e7409c420 0x7f7e60003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:11.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.730+0000 7f7e727fc640 1 -- 172.21.15.31:0/2609405532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e60004d40 msgr2=0x7f7e600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:11.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.730+0000 7f7e727fc640 1 --2- 172.21.15.31:0/2609405532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e60004d40 0x7f7e600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:11.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.730+0000 7f7e727fc640 1 -- 172.21.15.31:0/2609405532 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e60003520 con 0x7f7e600040d0 2024-04-15T00:21:11.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.730+0000 7f7e727fc640 1 --2- 172.21.15.31:0/2609405532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e600040d0 0x7f7e60004800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c009ac0 tx=0x7f7e60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ca14e0d71980f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:11.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.731+0000 7f7e71ffb640 1 -- 172.21.15.31:0/2609405532 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c040070 con 0x7f7e600040d0 2024-04-15T00:21:11.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.731+0000 7f7e71ffb640 1 -- 172.21.15.31:0/2609405532 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e5c03b400 con 0x7f7e600040d0 2024-04-15T00:21:11.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.731+0000 7f7e71ffb640 1 -- 172.21.15.31:0/2609405532 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c009690 con 0x7f7e600040d0 2024-04-15T00:21:11.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.731+0000 7f7e79436640 1 -- 172.21.15.31:0/2609405532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e600040d0 msgr2=0x7f7e60004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:11.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.731+0000 7f7e79436640 1 --2- 172.21.15.31:0/2609405532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e600040d0 0x7f7e60004800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c009ac0 tx=0x7f7e60005830 comp rx=0 tx=0).stop 2024-04-15T00:21:11.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.731+0000 7f7e737fe640 1 -- 172.21.15.31:0/2609405532 reap_dead start 2024-04-15T00:21:11.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.731+0000 7f7e79436640 1 -- 172.21.15.31:0/2609405532 shutdown_connections 2024-04-15T00:21:11.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.731+0000 7f7e79436640 1 -- 172.21.15.31:0/2609405532 >> 172.21.15.31:0/2609405532 conn(0x7f7e740675d0 msgr2=0x7f7e7409eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:11.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.731+0000 7f7e79436640 1 -- 172.21.15.31:0/2609405532 shutdown_connections 2024-04-15T00:21:11.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.731+0000 7f7e79436640 1 -- 172.21.15.31:0/2609405532 wait complete. 2024-04-15T00:21:11.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.732+0000 7f7e79436640 1 Processor -- start 2024-04-15T00:21:11.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.732+0000 7f7e79436640 1 -- start start 2024-04-15T00:21:11.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.733+0000 7f7e79436640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e600040d0 0x7f7e740b3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:11.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.733+0000 7f7e79436640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7e74146560 0x7f7e74145b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:11.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.733+0000 7f7e79436640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e741460c0 0x7f7e7409fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:11.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.733+0000 7f7e79436640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7409b8d0 con 0x7f7e600040d0 2024-04-15T00:21:11.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.733+0000 7f7e79436640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7409bf90 con 0x7f7e741460c0 2024-04-15T00:21:11.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.733+0000 7f7e79436640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f7e740bb690 con 0x7f7e74146560 2024-04-15T00:21:11.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.733+0000 7f7e72ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e600040d0 0x7f7e740b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:11.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.733+0000 7f7e72ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e600040d0 0x7f7e740b3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58688/0 (socket says 172.21.15.31:58688) 2024-04-15T00:21:11.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.733+0000 7f7e72ffd640 1 -- 172.21.15.31:0/2600023207 learned_addr learned my addr 172.21.15.31:0/2600023207 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:11.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.733+0000 7f7e737fe640 1 --2- 172.21.15.31:0/2600023207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e741460c0 0x7f7e7409fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:11.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.733+0000 7f7e727fc640 1 --2- 172.21.15.31:0/2600023207 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7e74146560 0x7f7e74145b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:11.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.733+0000 7f7e72ffd640 1 -- 172.21.15.31:0/2600023207 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7e74146560 msgr2=0x7f7e74145b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:11.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.733+0000 7f7e72ffd640 1 --2- 172.21.15.31:0/2600023207 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7e74146560 0x7f7e74145b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:11.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.733+0000 7f7e72ffd640 1 -- 172.21.15.31:0/2600023207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e741460c0 msgr2=0x7f7e7409fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:11.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.733+0000 7f7e72ffd640 1 --2- 172.21.15.31:0/2600023207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e741460c0 0x7f7e7409fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:11.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.733+0000 7f7e72ffd640 1 -- 172.21.15.31:0/2600023207 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e740a16d0 con 0x7f7e600040d0 2024-04-15T00:21:11.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.733+0000 7f7e727fc640 1 --2- 172.21.15.31:0/2600023207 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7e74146560 0x7f7e74145b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:11.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.734+0000 7f7e72ffd640 1 --2- 172.21.15.31:0/2600023207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e600040d0 0x7f7e740b3390 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00f7a0 tx=0x7f7e6c00fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:11.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.734+0000 7f7e6b7fe640 1 -- 172.21.15.31:0/2600023207 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c00fe50 con 0x7f7e600040d0 2024-04-15T00:21:11.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.734+0000 7f7e6b7fe640 1 -- 172.21.15.31:0/2600023207 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e6c018070 con 0x7f7e600040d0 2024-04-15T00:21:11.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.734+0000 7f7e79436640 1 -- 172.21.15.31:0/2600023207 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e740a19b0 con 0x7f7e600040d0 2024-04-15T00:21:11.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.734+0000 7f7e6b7fe640 1 -- 172.21.15.31:0/2600023207 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c00d730 con 0x7f7e600040d0 2024-04-15T00:21:11.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.734+0000 7f7e79436640 1 -- 172.21.15.31:0/2600023207 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e740b6f70 con 0x7f7e600040d0 2024-04-15T00:21:11.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.735+0000 7f7e79436640 1 -- 172.21.15.31:0/2600023207 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e741457a0 con 0x7f7e600040d0 2024-04-15T00:21:11.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.735+0000 7f7e6b7fe640 1 -- 172.21.15.31:0/2600023207 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f7e6c00d8d0 con 0x7f7e600040d0 2024-04-15T00:21:11.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.736+0000 7f7e6b7fe640 1 --2- 172.21.15.31:0/2600023207 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f7e5406b990 0x7f7e5406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:11.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.736+0000 7f7e6b7fe640 1 -- 172.21.15.31:0/2600023207 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f7e6c08a9c0 con 0x7f7e600040d0 2024-04-15T00:21:11.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.736+0000 7f7e727fc640 1 --2- 172.21.15.31:0/2600023207 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f7e5406b990 0x7f7e5406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:11.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.736+0000 7f7e727fc640 1 --2- 172.21.15.31:0/2600023207 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f7e5406b990 0x7f7e5406de50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c03d000 tx=0x7f7e5c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:11.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.740+0000 7f7e6b7fe640 1 -- 172.21.15.31:0/2600023207 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7e6c08ce20 con 0x7f7e600040d0 2024-04-15T00:21:11.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:11.919+0000 7f7e79436640 1 -- 172.21.15.31:0/2600023207 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f7e7413ffe0 con 0x7f7e600040d0 2024-04-15T00:21:11.952 INFO:tasks.ceph.mds.a.smithi031.stderr:2024-04-15T00:21:11.945+0000 7f7a999f1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-15T00:21:12.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.596+0000 7f7e6b7fe640 1 -- 172.21.15.31:0/2600023207 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) ==== 169+0+0 (secure 0 0 0) 0x7f7e6c059340 con 0x7f7e600040d0 2024-04-15T00:21:12.604 INFO:teuthology.orchestra.run.smithi031.stderr:set pool 4 allow_ec_overwrites to true 2024-04-15T00:21:12.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.601+0000 7f7e79436640 1 -- 172.21.15.31:0/2600023207 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f7e5406b990 msgr2=0x7f7e5406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:12.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.601+0000 7f7e79436640 1 --2- 172.21.15.31:0/2600023207 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f7e5406b990 0x7f7e5406de50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c03d000 tx=0x7f7e5c008030 comp rx=0 tx=0).stop 2024-04-15T00:21:12.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.601+0000 7f7e79436640 1 -- 172.21.15.31:0/2600023207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e600040d0 msgr2=0x7f7e740b3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:12.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.601+0000 7f7e79436640 1 --2- 172.21.15.31:0/2600023207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e600040d0 0x7f7e740b3390 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00f7a0 tx=0x7f7e6c00fc60 comp rx=0 tx=0).stop 2024-04-15T00:21:12.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.603+0000 7f7e79436640 1 -- 172.21.15.31:0/2600023207 shutdown_connections 2024-04-15T00:21:12.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.604+0000 7f7e79436640 1 --2- 172.21.15.31:0/2600023207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e741460c0 0x7f7e7409fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:12.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.604+0000 7f7e79436640 1 --2- 172.21.15.31:0/2600023207 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f7e5406b990 0x7f7e5406de50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:12.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.604+0000 7f7e79436640 1 --2- 172.21.15.31:0/2600023207 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7e74146560 0x7f7e74145b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:12.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.604+0000 7f7e79436640 1 --2- 172.21.15.31:0/2600023207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e600040d0 0x7f7e740b3390 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:12.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.604+0000 7f7e79436640 1 -- 172.21.15.31:0/2600023207 >> 172.21.15.31:0/2600023207 conn(0x7f7e740675d0 msgr2=0x7f7e7413ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:12.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.605+0000 7f7e79436640 1 -- 172.21.15.31:0/2600023207 shutdown_connections 2024-04-15T00:21:12.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.605+0000 7f7e79436640 1 -- 172.21.15.31:0/2600023207 wait complete. 2024-04-15T00:21:12.637 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-15T00:21:12.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.739+0000 7fc55dd55640 1 Processor -- start 2024-04-15T00:21:12.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.739+0000 7fc55dd55640 1 -- start start 2024-04-15T00:21:12.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.740+0000 7fc55dd55640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc558151190 0x7fc558153580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:12.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.740+0000 7fc55dd55640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc558072b30 con 0x7fc558072750 2024-04-15T00:21:12.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.740+0000 7fc55dd55640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5580bad90 con 0x7fc5580b8ab0 2024-04-15T00:21:12.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.740+0000 7fc55dd55640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc5580b0580 con 0x7fc558151190 2024-04-15T00:21:12.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.740+0000 7fc5577fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc558072750 0x7fc55809bf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:36500/0 (socket says 172.21.15.31:36500) 2024-04-15T00:21:12.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.740+0000 7fc5577fe640 1 -- 172.21.15.31:0/1477784938 learned_addr learned my addr 172.21.15.31:0/1477784938 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:12.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.740+0000 7fc5567fc640 1 -- 172.21.15.31:0/1477784938 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3227370110 0 0) 0x7fc558072b30 con 0x7fc558072750 2024-04-15T00:21:12.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.740+0000 7fc5567fc640 1 -- 172.21.15.31:0/1477784938 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc540003520 con 0x7fc558072750 2024-04-15T00:21:12.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.741+0000 7fc557fff640 1 --2- 172.21.15.31:0/1477784938 >> v2:172.21.15.50:3300/0 conn(0x7fc558151190 0x7fc558153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:12.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.741+0000 7fc5567fc640 1 -- 172.21.15.31:0/1477784938 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1585106032 0 0) 0x7fc540003520 con 0x7fc558072750 2024-04-15T00:21:12.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.741+0000 7fc5567fc640 1 -- 172.21.15.31:0/1477784938 >> v2:172.21.15.50:3300/0 conn(0x7fc558151190 msgr2=0x7fc558153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:12.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.741+0000 7fc5567fc640 1 --2- 172.21.15.31:0/1477784938 >> v2:172.21.15.50:3300/0 conn(0x7fc558151190 0x7fc558153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:12.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.741+0000 7fc5567fc640 1 -- 172.21.15.31:0/1477784938 >> v1:172.21.15.50:6789/0 conn(0x7fc5580b8ab0 legacy=0x7fc5580b8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:12.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.741+0000 7fc5567fc640 1 -- 172.21.15.31:0/1477784938 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5580bb070 con 0x7fc558072750 2024-04-15T00:21:12.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.741+0000 7fc5567fc640 1 -- 172.21.15.31:0/1477784938 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 697057150 0 0) 0x7fc548001670 con 0x7fc558072750 2024-04-15T00:21:12.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.741+0000 7fc5567fc640 1 -- 172.21.15.31:0/1477784938 >> v1:172.21.15.31:6789/0 conn(0x7fc558072750 legacy=0x7fc55809bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:12.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.741+0000 7fc5567fc640 1 --2- 172.21.15.31:0/1477784938 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc5400039b0 0x7fc540003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:12.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.741+0000 7fc5567fc640 1 --2- 172.21.15.31:0/1477784938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc540004800 0x7fc540004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:12.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.741+0000 7fc5567fc640 1 --2- 172.21.15.31:0/1477784938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5400051c0 0x7fc54000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:12.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.741+0000 7fc5567fc640 1 -- 172.21.15.31:0/1477784938 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc5580b0580 con 0x7fc540004800 2024-04-15T00:21:12.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.741+0000 7fc5567fc640 1 -- 172.21.15.31:0/1477784938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc54000c160 con 0x7fc5400051c0 2024-04-15T00:21:12.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.741+0000 7fc5567fc640 1 -- 172.21.15.31:0/1477784938 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fc54000c360 con 0x7fc5400039b0 2024-04-15T00:21:12.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.741+0000 7fc556ffd640 1 --2- 172.21.15.31:0/1477784938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc540004800 0x7fc540004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:12.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.741+0000 7fc557fff640 1 --2- 172.21.15.31:0/1477784938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5400051c0 0x7fc54000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:12.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.741+0000 7fc5577fe640 1 --2- 172.21.15.31:0/1477784938 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc5400039b0 0x7fc540003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:12.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.741+0000 7fc556ffd640 1 -- 172.21.15.31:0/1477784938 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc5400039b0 msgr2=0x7fc540003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:12.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.741+0000 7fc556ffd640 1 --2- 172.21.15.31:0/1477784938 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc5400039b0 0x7fc540003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:12.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.741+0000 7fc556ffd640 1 -- 172.21.15.31:0/1477784938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5400051c0 msgr2=0x7fc54000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:12.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.741+0000 7fc556ffd640 1 --2- 172.21.15.31:0/1477784938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5400051c0 0x7fc54000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:12.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.741+0000 7fc557fff640 1 -- 172.21.15.31:0/1477784938 reap_dead start 2024-04-15T00:21:12.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.741+0000 7fc556ffd640 1 -- 172.21.15.31:0/1477784938 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc540003520 con 0x7fc540004800 2024-04-15T00:21:12.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.742+0000 7fc556ffd640 1 --2- 172.21.15.31:0/1477784938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc540004800 0x7fc540004c80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc54c001750 tx=0x7fc540005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b7876fb35b792b server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:12.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.742+0000 7fc5567fc640 1 -- 172.21.15.31:0/1477784938 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54c001370 con 0x7fc540004800 2024-04-15T00:21:12.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.742+0000 7fc5567fc640 1 -- 172.21.15.31:0/1477784938 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc54c0052d0 con 0x7fc540004800 2024-04-15T00:21:12.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.742+0000 7fc5567fc640 1 -- 172.21.15.31:0/1477784938 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54c003830 con 0x7fc540004800 2024-04-15T00:21:12.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.743+0000 7fc55dd55640 1 -- 172.21.15.31:0/1477784938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc540004800 msgr2=0x7fc540004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:12.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.743+0000 7fc55dd55640 1 --2- 172.21.15.31:0/1477784938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc540004800 0x7fc540004c80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc54c001750 tx=0x7fc540005830 comp rx=0 tx=0).stop 2024-04-15T00:21:12.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.743+0000 7fc55dd55640 1 -- 172.21.15.31:0/1477784938 shutdown_connections 2024-04-15T00:21:12.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.743+0000 7fc55dd55640 1 --2- 172.21.15.31:0/1477784938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc540004800 0x7fc540004c80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:12.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.743+0000 7fc55dd55640 1 -- 172.21.15.31:0/1477784938 >> 172.21.15.31:0/1477784938 conn(0x7fc5580bcef0 msgr2=0x7fc5580bd300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:12.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.743+0000 7fc55dd55640 1 -- 172.21.15.31:0/1477784938 shutdown_connections 2024-04-15T00:21:12.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.743+0000 7fc55dd55640 1 -- 172.21.15.31:0/1477784938 wait complete. 2024-04-15T00:21:12.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.744+0000 7fc55dd55640 1 Processor -- start 2024-04-15T00:21:12.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.744+0000 7fc55dd55640 1 -- start start 2024-04-15T00:21:12.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.744+0000 7fc55dd55640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc540004800 0x7fc5580b1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:12.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.744+0000 7fc55dd55640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc558149050 0x7fc5581494d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:12.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.744+0000 7fc55dd55640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc558142d10 0x7fc558143190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:12.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.744+0000 7fc55dd55640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc558074530 con 0x7fc558142d10 2024-04-15T00:21:12.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.744+0000 7fc55dd55640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc5581478f0 con 0x7fc558149050 2024-04-15T00:21:12.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.744+0000 7fc55dd55640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fc5580b3c80 con 0x7fc540004800 2024-04-15T00:21:12.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.745+0000 7fc557fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc558142d10 0x7fc558143190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:12.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.745+0000 7fc557fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc558142d10 0x7fc558143190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49868/0 (socket says 172.21.15.31:49868) 2024-04-15T00:21:12.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.745+0000 7fc557fff640 1 -- 172.21.15.31:0/1361467470 learned_addr learned my addr 172.21.15.31:0/1361467470 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:12.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.745+0000 7fc5577fe640 1 --2- 172.21.15.31:0/1361467470 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc540004800 0x7fc5580b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:12.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.745+0000 7fc556ffd640 1 --2- 172.21.15.31:0/1361467470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc558149050 0x7fc5581494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:12.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.745+0000 7fc557fff640 1 -- 172.21.15.31:0/1361467470 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc540004800 msgr2=0x7fc5580b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:12.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.745+0000 7fc557fff640 1 --2- 172.21.15.31:0/1361467470 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc540004800 0x7fc5580b1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:12.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.745+0000 7fc557fff640 1 -- 172.21.15.31:0/1361467470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc558149050 msgr2=0x7fc5581494d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:12.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.745+0000 7fc557fff640 1 --2- 172.21.15.31:0/1361467470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc558149050 0x7fc5581494d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:12.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.745+0000 7fc557fff640 1 -- 172.21.15.31:0/1361467470 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5580b2310 con 0x7fc558142d10 2024-04-15T00:21:12.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.745+0000 7fc557fff640 1 --2- 172.21.15.31:0/1361467470 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc558142d10 0x7fc558143190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc5580734d0 tx=0x7fc55000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:12.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.745+0000 7fc53ffff640 1 -- 172.21.15.31:0/1361467470 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc550019070 con 0x7fc558142d10 2024-04-15T00:21:12.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.745+0000 7fc53ffff640 1 -- 172.21.15.31:0/1361467470 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc55000fdc0 con 0x7fc558142d10 2024-04-15T00:21:12.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.745+0000 7fc55dd55640 1 -- 172.21.15.31:0/1361467470 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5581436d0 con 0x7fc558142d10 2024-04-15T00:21:12.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.745+0000 7fc53ffff640 1 -- 172.21.15.31:0/1361467470 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc550003bd0 con 0x7fc558142d10 2024-04-15T00:21:12.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.745+0000 7fc55dd55640 1 -- 172.21.15.31:0/1361467470 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5580b2590 con 0x7fc558142d10 2024-04-15T00:21:12.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.746+0000 7fc55dd55640 1 -- 172.21.15.31:0/1361467470 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc55814af80 con 0x7fc558142d10 2024-04-15T00:21:12.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.747+0000 7fc53ffff640 1 -- 172.21.15.31:0/1361467470 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc55001c070 con 0x7fc558142d10 2024-04-15T00:21:12.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.747+0000 7fc53ffff640 1 --2- 172.21.15.31:0/1361467470 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc54406b990 0x7fc54406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:12.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.747+0000 7fc53ffff640 1 -- 172.21.15.31:0/1361467470 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7fc55008b510 con 0x7fc558142d10 2024-04-15T00:21:12.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.747+0000 7fc5577fe640 1 --2- 172.21.15.31:0/1361467470 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc54406b990 0x7fc54406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:12.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.747+0000 7fc5577fe640 1 --2- 172.21.15.31:0/1361467470 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc54406b990 0x7fc54406de50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc558143d10 tx=0x7fc548000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:12.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.751+0000 7fc53ffff640 1 -- 172.21.15.31:0/1361467470 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc5580b2310 con 0x7fc558142d10 2024-04-15T00:21:12.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:12.970+0000 7fc55dd55640 1 -- 172.21.15.31:0/1361467470 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fc55804f540 con 0x7fc558142d10 2024-04-15T00:21:13.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.598+0000 7fc53ffff640 1 -- 172.21.15.31:0/1361467470 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) ==== 137+0+0 (secure 0 0 0) 0x7fc550010040 con 0x7fc558142d10 2024-04-15T00:21:13.605 INFO:teuthology.orchestra.run.smithi031.stderr:added data pool 4 to fsmap 2024-04-15T00:21:13.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.602+0000 7fc55dd55640 1 -- 172.21.15.31:0/1361467470 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc54406b990 msgr2=0x7fc54406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:13.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.602+0000 7fc55dd55640 1 --2- 172.21.15.31:0/1361467470 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc54406b990 0x7fc54406de50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc558143d10 tx=0x7fc548000ed0 comp rx=0 tx=0).stop 2024-04-15T00:21:13.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.602+0000 7fc55dd55640 1 -- 172.21.15.31:0/1361467470 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc558142d10 msgr2=0x7fc558143190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:13.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.602+0000 7fc55dd55640 1 --2- 172.21.15.31:0/1361467470 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc558142d10 0x7fc558143190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc5580734d0 tx=0x7fc55000f580 comp rx=0 tx=0).stop 2024-04-15T00:21:13.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.602+0000 7fc55dd55640 1 -- 172.21.15.31:0/1361467470 shutdown_connections 2024-04-15T00:21:13.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.602+0000 7fc55dd55640 1 --2- 172.21.15.31:0/1361467470 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc558142d10 0x7fc558143190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:13.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.602+0000 7fc55dd55640 1 --2- 172.21.15.31:0/1361467470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc558149050 0x7fc5581494d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:13.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.602+0000 7fc55dd55640 1 --2- 172.21.15.31:0/1361467470 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc54406b990 0x7fc54406de50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:13.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.602+0000 7fc55dd55640 1 --2- 172.21.15.31:0/1361467470 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc540004800 0x7fc5580b1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:13.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.602+0000 7fc55dd55640 1 -- 172.21.15.31:0/1361467470 >> 172.21.15.31:0/1361467470 conn(0x7fc5580bcef0 msgr2=0x7fc55809c480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:13.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.602+0000 7fc55dd55640 1 -- 172.21.15.31:0/1361467470 shutdown_connections 2024-04-15T00:21:13.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.602+0000 7fc55dd55640 1 -- 172.21.15.31:0/1361467470 wait complete. 2024-04-15T00:21:13.623 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T00:21:13.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.723+0000 7f4c0f20f640 1 Processor -- start 2024-04-15T00:21:13.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.723+0000 7f4c0f20f640 1 -- start start 2024-04-15T00:21:13.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.724+0000 7f4c0f20f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4c080b56b0 0x7f4c08148080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:13.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.724+0000 7f4c0f20f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4c080b5a90 0x7f4c080b6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:13.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.724+0000 7f4c0f20f640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4c0806c6d0 0x7f4c080b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:13.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.724+0000 7f4c0f20f640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f4c08147bf0 con 0x7f4c080b56b0 2024-04-15T00:21:13.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.724+0000 7f4c0f20f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f4c0806cc20 con 0x7f4c080b5a90 2024-04-15T00:21:13.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.724+0000 7f4c0f20f640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f4c0806bcf0 con 0x7f4c0806c6d0 2024-04-15T00:21:13.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.724+0000 7f4c0cfab640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4c080b56b0 0x7f4c08148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:13.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.724+0000 7f4c0cfab640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4c080b56b0 0x7f4c08148080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49878/0 (socket says 172.21.15.31:49878) 2024-04-15T00:21:13.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.724+0000 7f4c0cfab640 1 -- 172.21.15.31:0/859785018 learned_addr learned my addr 172.21.15.31:0/859785018 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:13.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.724+0000 7f4c07fff640 1 --2- 172.21.15.31:0/859785018 >> v2:172.21.15.50:3300/0 conn(0x7f4c080b5a90 0x7f4c080b6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:13.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.724+0000 7f4c0d7ac640 1 --2- 172.21.15.31:0/859785018 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4c0806c6d0 0x7f4c080b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:13.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.724+0000 7f4c0cfab640 1 -- 172.21.15.31:0/859785018 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4c0806c6d0 msgr2=0x7f4c080b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:13.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.724+0000 7f4c0cfab640 1 --2- 172.21.15.31:0/859785018 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4c0806c6d0 0x7f4c080b6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:13.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.724+0000 7f4c0cfab640 1 -- 172.21.15.31:0/859785018 >> v2:172.21.15.50:3300/0 conn(0x7f4c080b5a90 msgr2=0x7f4c080b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:13.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.724+0000 7f4c0cfab640 1 --2- 172.21.15.31:0/859785018 >> v2:172.21.15.50:3300/0 conn(0x7f4c080b5a90 0x7f4c080b6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:13.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.724+0000 7f4c0cfab640 1 -- 172.21.15.31:0/859785018 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c08147880 con 0x7f4c080b56b0 2024-04-15T00:21:13.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.725+0000 7f4c0cfab640 1 --2- 172.21.15.31:0/859785018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c080b56b0 0x7f4c08148080 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4c0806f540 tx=0x7f4bf802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562ed7b361ec9363 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:13.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.725+0000 7f4c077fe640 1 -- 172.21.15.31:0/859785018 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf802e070 con 0x7f4c080b56b0 2024-04-15T00:21:13.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.725+0000 7f4c077fe640 1 -- 172.21.15.31:0/859785018 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf8037070 con 0x7f4c080b56b0 2024-04-15T00:21:13.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.725+0000 7f4c077fe640 1 -- 172.21.15.31:0/859785018 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8031a00 con 0x7f4c080b56b0 2024-04-15T00:21:13.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.726+0000 7f4c0f20f640 1 -- 172.21.15.31:0/859785018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c080b56b0 msgr2=0x7f4c08148080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:13.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.726+0000 7f4c0f20f640 1 --2- 172.21.15.31:0/859785018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c080b56b0 0x7f4c08148080 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4c0806f540 tx=0x7f4bf802b880 comp rx=0 tx=0).stop 2024-04-15T00:21:13.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.726+0000 7f4c0f20f640 1 -- 172.21.15.31:0/859785018 shutdown_connections 2024-04-15T00:21:13.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.726+0000 7f4c0f20f640 1 --2- 172.21.15.31:0/859785018 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4c0806c6d0 0x7f4c080b6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:13.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.726+0000 7f4c0f20f640 1 --2- 172.21.15.31:0/859785018 >> v2:172.21.15.50:3300/0 conn(0x7f4c080b5a90 0x7f4c080b6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:13.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.726+0000 7f4c0f20f640 1 --2- 172.21.15.31:0/859785018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c080b56b0 0x7f4c08148080 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:13.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.726+0000 7f4c0f20f640 1 -- 172.21.15.31:0/859785018 >> 172.21.15.31:0/859785018 conn(0x7f4c080b77b0 msgr2=0x7f4c080b7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:13.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.726+0000 7f4c0f20f640 1 -- 172.21.15.31:0/859785018 shutdown_connections 2024-04-15T00:21:13.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.726+0000 7f4c0f20f640 1 -- 172.21.15.31:0/859785018 wait complete. 2024-04-15T00:21:13.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.727+0000 7f4c0f20f640 1 Processor -- start 2024-04-15T00:21:13.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.727+0000 7f4c0f20f640 1 -- start start 2024-04-15T00:21:13.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.728+0000 7f4c0f20f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c0806c6d0 0x7f4c080b3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:13.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.728+0000 7f4c0f20f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c080b56b0 0x7f4c080b2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:13.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.728+0000 7f4c0f20f640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4c080b5a90 0x7f4c081e0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:13.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.728+0000 7f4c0f20f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4c080b6240 con 0x7f4c0806c6d0 2024-04-15T00:21:13.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.728+0000 7f4c0f20f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4c080b60c0 con 0x7f4c080b56b0 2024-04-15T00:21:13.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.728+0000 7f4c0f20f640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f4c0806d050 con 0x7f4c080b5a90 2024-04-15T00:21:13.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.728+0000 7f4c0cfab640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c0806c6d0 0x7f4c080b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:13.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.728+0000 7f4c0cfab640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c0806c6d0 0x7f4c080b3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49892/0 (socket says 172.21.15.31:49892) 2024-04-15T00:21:13.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.728+0000 7f4c0cfab640 1 -- 172.21.15.31:0/2170505777 learned_addr learned my addr 172.21.15.31:0/2170505777 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:13.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.728+0000 7f4c0d7ac640 1 --2- 172.21.15.31:0/2170505777 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4c080b5a90 0x7f4c081e0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:13.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.728+0000 7f4c07fff640 1 --2- 172.21.15.31:0/2170505777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c080b56b0 0x7f4c080b2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:13.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.728+0000 7f4c0cfab640 1 -- 172.21.15.31:0/2170505777 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4c080b5a90 msgr2=0x7f4c081e0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:13.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.728+0000 7f4c0cfab640 1 --2- 172.21.15.31:0/2170505777 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4c080b5a90 0x7f4c081e0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:13.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.728+0000 7f4c0cfab640 1 -- 172.21.15.31:0/2170505777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c080b56b0 msgr2=0x7f4c080b2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:13.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.728+0000 7f4c0cfab640 1 --2- 172.21.15.31:0/2170505777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c080b56b0 0x7f4c080b2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:13.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.728+0000 7f4c0cfab640 1 -- 172.21.15.31:0/2170505777 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c08142220 con 0x7f4c0806c6d0 2024-04-15T00:21:13.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.728+0000 7f4c0cfab640 1 --2- 172.21.15.31:0/2170505777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c0806c6d0 0x7f4c080b3970 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4bf802b8c0 tx=0x7f4bf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:13.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.728+0000 7f4c057fa640 1 -- 172.21.15.31:0/2170505777 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8032670 con 0x7f4c0806c6d0 2024-04-15T00:21:13.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.728+0000 7f4c057fa640 1 -- 172.21.15.31:0/2170505777 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf8032830 con 0x7f4c0806c6d0 2024-04-15T00:21:13.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.728+0000 7f4c0f20f640 1 -- 172.21.15.31:0/2170505777 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c080b2440 con 0x7f4c0806c6d0 2024-04-15T00:21:13.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.728+0000 7f4c057fa640 1 -- 172.21.15.31:0/2170505777 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8032c20 con 0x7f4c0806c6d0 2024-04-15T00:21:13.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.728+0000 7f4c0f20f640 1 -- 172.21.15.31:0/2170505777 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c080b1760 con 0x7f4c0806c6d0 2024-04-15T00:21:13.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.729+0000 7f4c0f20f640 1 -- 172.21.15.31:0/2170505777 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c0814bbd0 con 0x7f4c0806c6d0 2024-04-15T00:21:13.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.730+0000 7f4c057fa640 1 -- 172.21.15.31:0/2170505777 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f4bf804c060 con 0x7f4c0806c6d0 2024-04-15T00:21:13.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.730+0000 7f4c057fa640 1 --2- 172.21.15.31:0/2170505777 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f4bf406b990 0x7f4bf406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:13.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.730+0000 7f4c057fa640 1 -- 172.21.15.31:0/2170505777 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4bf80ac3e0 con 0x7f4c0806c6d0 2024-04-15T00:21:13.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.730+0000 7f4c07fff640 1 --2- 172.21.15.31:0/2170505777 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f4bf406b990 0x7f4bf406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:13.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.731+0000 7f4c07fff640 1 --2- 172.21.15.31:0/2170505777 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f4bf406b990 0x7f4bf406de50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4c08072580 tx=0x7f4bfc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:13.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.735+0000 7f4c057fa640 1 -- 172.21.15.31:0/2170505777 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4bf8040070 con 0x7f4c0806c6d0 2024-04-15T00:21:13.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.952+0000 7f4c0f20f640 1 -- 172.21.15.31:0/2170505777 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c08146790 con 0x7f4c0806c6d0 2024-04-15T00:21:13.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.952+0000 7f4c057fa640 1 -- 172.21.15.31:0/2170505777 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3520 (secure 0 0 0) 0x7f4bf807a770 con 0x7f4c0806c6d0 2024-04-15T00:21:13.960 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:21:13.960 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/921487249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":921487249},{"type":"v1","addr":"172.21.15.50:6833","nonce":921487249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T00:21:07.925196+0000","modified":"2024-04-15T00:21:12.972118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/93464605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":93464605},{"type":"v1","addr":"172.21.15.31:6835","nonce":93464605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-04-15T00:21:13.960 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 6 2024-04-15T00:21:13.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.954+0000 7f4c0f20f640 1 -- 172.21.15.31:0/2170505777 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f4bf406b990 msgr2=0x7f4bf406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:13.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.954+0000 7f4c0f20f640 1 --2- 172.21.15.31:0/2170505777 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f4bf406b990 0x7f4bf406de50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4c08072580 tx=0x7f4bfc009190 comp rx=0 tx=0).stop 2024-04-15T00:21:13.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.954+0000 7f4c0f20f640 1 -- 172.21.15.31:0/2170505777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c0806c6d0 msgr2=0x7f4c080b3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:13.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.954+0000 7f4c0f20f640 1 --2- 172.21.15.31:0/2170505777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c0806c6d0 0x7f4c080b3970 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4bf802b8c0 tx=0x7f4bf80046c0 comp rx=0 tx=0).stop 2024-04-15T00:21:13.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.954+0000 7f4c0f20f640 1 -- 172.21.15.31:0/2170505777 shutdown_connections 2024-04-15T00:21:13.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.954+0000 7f4c0f20f640 1 --2- 172.21.15.31:0/2170505777 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f4bf406b990 0x7f4bf406de50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:13.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.954+0000 7f4c0f20f640 1 --2- 172.21.15.31:0/2170505777 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4c080b5a90 0x7f4c081e0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:13.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.954+0000 7f4c0f20f640 1 --2- 172.21.15.31:0/2170505777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c080b56b0 0x7f4c080b2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:13.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.954+0000 7f4c0f20f640 1 --2- 172.21.15.31:0/2170505777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c0806c6d0 0x7f4c080b3970 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:13.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.954+0000 7f4c0f20f640 1 -- 172.21.15.31:0/2170505777 >> 172.21.15.31:0/2170505777 conn(0x7f4c080b77b0 msgr2=0x7f4c08146b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:13.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.954+0000 7f4c0f20f640 1 -- 172.21.15.31:0/2170505777 shutdown_connections 2024-04-15T00:21:13.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:13.954+0000 7f4c0f20f640 1 -- 172.21.15.31:0/2170505777 wait complete. 2024-04-15T00:21:13.972 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:21:14.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.066+0000 7fd363c88640 1 Processor -- start 2024-04-15T00:21:14.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.067+0000 7fd363c88640 1 -- start start 2024-04-15T00:21:14.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.067+0000 7fd363c88640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd35c072690 0x7fd35c14ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:14.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.067+0000 7fd363c88640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd35c141bb0 0x7fd35c14b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:14.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.067+0000 7fd363c88640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd35c072a70 con 0x7fd35c06fde0 2024-04-15T00:21:14.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.067+0000 7fd363c88640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fd35c06efa0 con 0x7fd35c072690 2024-04-15T00:21:14.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.067+0000 7fd363c88640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fd35c06f820 con 0x7fd35c141bb0 2024-04-15T00:21:14.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.067+0000 7fd361223640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd35c06fde0 0x7fd35c1414a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:36514/0 (socket says 172.21.15.31:36514) 2024-04-15T00:21:14.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.067+0000 7fd361223640 1 -- 172.21.15.31:0/2841524905 learned_addr learned my addr 172.21.15.31:0/2841524905 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:14.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.067+0000 7fd360a22640 1 -- 172.21.15.31:0/2841524905 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 370745883 0 0) 0x7fd35c072a70 con 0x7fd35c06fde0 2024-04-15T00:21:14.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.068+0000 7fd361a24640 1 --2- 172.21.15.31:0/2841524905 >> v2:172.21.15.50:3300/0 conn(0x7fd35c072690 0x7fd35c14ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:14.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.068+0000 7fd360a22640 1 -- 172.21.15.31:0/2841524905 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd348003520 con 0x7fd35c06fde0 2024-04-15T00:21:14.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.068+0000 7fd362225640 1 --2- 172.21.15.31:0/2841524905 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd35c141bb0 0x7fd35c14b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:14.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.068+0000 7fd360a22640 1 -- 172.21.15.31:0/2841524905 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 340072235 0 0) 0x7fd348003520 con 0x7fd35c06fde0 2024-04-15T00:21:14.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.068+0000 7fd360a22640 1 -- 172.21.15.31:0/2841524905 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd35c141bb0 msgr2=0x7fd35c14b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:14.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.068+0000 7fd360a22640 1 --2- 172.21.15.31:0/2841524905 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd35c141bb0 0x7fd35c14b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:14.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.068+0000 7fd360a22640 1 -- 172.21.15.31:0/2841524905 >> v2:172.21.15.50:3300/0 conn(0x7fd35c072690 msgr2=0x7fd35c14ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:14.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.068+0000 7fd360a22640 1 --2- 172.21.15.31:0/2841524905 >> v2:172.21.15.50:3300/0 conn(0x7fd35c072690 0x7fd35c14ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:14.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.068+0000 7fd360a22640 1 -- 172.21.15.31:0/2841524905 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd35c06f1d0 con 0x7fd35c06fde0 2024-04-15T00:21:14.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.068+0000 7fd360a22640 1 -- 172.21.15.31:0/2841524905 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 697057150 0 0) 0x7fd34c001670 con 0x7fd35c06fde0 2024-04-15T00:21:14.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.068+0000 7fd360a22640 1 -- 172.21.15.31:0/2841524905 >> v1:172.21.15.31:6789/0 conn(0x7fd35c06fde0 legacy=0x7fd35c1414a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:14.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.068+0000 7fd360a22640 1 --2- 172.21.15.31:0/2841524905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3480039b0 0x7fd348003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:14.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.068+0000 7fd360a22640 1 --2- 172.21.15.31:0/2841524905 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd35c141bb0 0x7fd348004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:14.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.068+0000 7fd360a22640 1 --2- 172.21.15.31:0/2841524905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd348004d40 0x7fd3480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:14.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.068+0000 7fd360a22640 1 -- 172.21.15.31:0/2841524905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd35c06f820 con 0x7fd3480039b0 2024-04-15T00:21:14.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.068+0000 7fd360a22640 1 -- 172.21.15.31:0/2841524905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd34800b9c0 con 0x7fd348004d40 2024-04-15T00:21:14.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.068+0000 7fd360a22640 1 -- 172.21.15.31:0/2841524905 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fd34800bb40 con 0x7fd35c141bb0 2024-04-15T00:21:14.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.068+0000 7fd361a24640 1 --2- 172.21.15.31:0/2841524905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3480039b0 0x7fd348003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:14.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.068+0000 7fd361223640 1 --2- 172.21.15.31:0/2841524905 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd35c141bb0 0x7fd348004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:14.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.068+0000 7fd362225640 1 --2- 172.21.15.31:0/2841524905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd348004d40 0x7fd3480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:14.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.068+0000 7fd361a24640 1 -- 172.21.15.31:0/2841524905 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd35c141bb0 msgr2=0x7fd348004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:14.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.068+0000 7fd361a24640 1 --2- 172.21.15.31:0/2841524905 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd35c141bb0 0x7fd348004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:14.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.068+0000 7fd361a24640 1 -- 172.21.15.31:0/2841524905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd348004d40 msgr2=0x7fd3480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:14.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.068+0000 7fd361a24640 1 --2- 172.21.15.31:0/2841524905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd348004d40 0x7fd3480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:14.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.068+0000 7fd361a24640 1 -- 172.21.15.31:0/2841524905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd348003520 con 0x7fd3480039b0 2024-04-15T00:21:14.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.068+0000 7fd361223640 1 --2- 172.21.15.31:0/2841524905 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd35c141bb0 0x7fd348004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:14.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.068+0000 7fd362225640 1 --2- 172.21.15.31:0/2841524905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd348004d40 0x7fd3480051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:14.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.069+0000 7fd361a24640 1 --2- 172.21.15.31:0/2841524905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3480039b0 0x7fd348003dd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd358009ab0 tx=0x7fd348005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3c6e85340a1b09 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:14.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.069+0000 7fd360a22640 1 -- 172.21.15.31:0/2841524905 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd358009680 con 0x7fd3480039b0 2024-04-15T00:21:14.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.069+0000 7fd360a22640 1 -- 172.21.15.31:0/2841524905 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd358005990 con 0x7fd3480039b0 2024-04-15T00:21:14.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.069+0000 7fd360a22640 1 -- 172.21.15.31:0/2841524905 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd358005d80 con 0x7fd3480039b0 2024-04-15T00:21:14.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.070+0000 7fd363c88640 1 -- 172.21.15.31:0/2841524905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3480039b0 msgr2=0x7fd348003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:14.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.070+0000 7fd363c88640 1 --2- 172.21.15.31:0/2841524905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3480039b0 0x7fd348003dd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd358009ab0 tx=0x7fd348005830 comp rx=0 tx=0).stop 2024-04-15T00:21:14.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.070+0000 7fd362225640 1 -- 172.21.15.31:0/2841524905 reap_dead start 2024-04-15T00:21:14.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.070+0000 7fd363c88640 1 -- 172.21.15.31:0/2841524905 shutdown_connections 2024-04-15T00:21:14.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.070+0000 7fd363c88640 1 -- 172.21.15.31:0/2841524905 >> 172.21.15.31:0/2841524905 conn(0x7fd35c0b7840 msgr2=0x7fd35c0b7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:14.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.070+0000 7fd363c88640 1 -- 172.21.15.31:0/2841524905 shutdown_connections 2024-04-15T00:21:14.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.070+0000 7fd363c88640 1 -- 172.21.15.31:0/2841524905 wait complete. 2024-04-15T00:21:14.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.071+0000 7fd363c88640 1 Processor -- start 2024-04-15T00:21:14.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.071+0000 7fd363c88640 1 -- start start 2024-04-15T00:21:14.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.071+0000 7fd363c88640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3480039b0 0x7fd35c149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:14.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.071+0000 7fd363c88640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd35c147520 0x7fd35c1dd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:14.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.071+0000 7fd363c88640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd35c1dd700 0x7fd35c13bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:14.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.071+0000 7fd363c88640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd35c0b58c0 con 0x7fd3480039b0 2024-04-15T00:21:14.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.071+0000 7fd363c88640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd35c0b5740 con 0x7fd35c147520 2024-04-15T00:21:14.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.071+0000 7fd363c88640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fd35c0b74a0 con 0x7fd35c1dd700 2024-04-15T00:21:14.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.071+0000 7fd361a24640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3480039b0 0x7fd35c149e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:14.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.071+0000 7fd361a24640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3480039b0 0x7fd35c149e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49906/0 (socket says 172.21.15.31:49906) 2024-04-15T00:21:14.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.071+0000 7fd361a24640 1 -- 172.21.15.31:0/2840892390 learned_addr learned my addr 172.21.15.31:0/2840892390 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:14.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.072+0000 7fd361223640 1 --2- 172.21.15.31:0/2840892390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd35c147520 0x7fd35c1dd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:14.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.072+0000 7fd362225640 1 --2- 172.21.15.31:0/2840892390 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd35c1dd700 0x7fd35c13bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:14.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.072+0000 7fd361a24640 1 -- 172.21.15.31:0/2840892390 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd35c1dd700 msgr2=0x7fd35c13bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:14.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.072+0000 7fd361a24640 1 --2- 172.21.15.31:0/2840892390 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd35c1dd700 0x7fd35c13bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:14.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.072+0000 7fd361a24640 1 -- 172.21.15.31:0/2840892390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd35c147520 msgr2=0x7fd35c1dd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:14.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.072+0000 7fd361a24640 1 --2- 172.21.15.31:0/2840892390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd35c147520 0x7fd35c1dd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:14.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.072+0000 7fd361a24640 1 -- 172.21.15.31:0/2840892390 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd35c1ddb80 con 0x7fd3480039b0 2024-04-15T00:21:14.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.072+0000 7fd361223640 1 --2- 172.21.15.31:0/2840892390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd35c147520 0x7fd35c1dd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:14.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.072+0000 7fd361a24640 1 --2- 172.21.15.31:0/2840892390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3480039b0 0x7fd35c149e60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd358009bd0 tx=0x7fd358004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:14.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.072+0000 7fd3527fc640 1 -- 172.21.15.31:0/2840892390 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd358043070 con 0x7fd3480039b0 2024-04-15T00:21:14.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.072+0000 7fd3527fc640 1 -- 172.21.15.31:0/2840892390 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd35802cd30 con 0x7fd3480039b0 2024-04-15T00:21:14.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.072+0000 7fd363c88640 1 -- 172.21.15.31:0/2840892390 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd35c146f20 con 0x7fd3480039b0 2024-04-15T00:21:14.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.072+0000 7fd3527fc640 1 -- 172.21.15.31:0/2840892390 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd358006270 con 0x7fd3480039b0 2024-04-15T00:21:14.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.072+0000 7fd363c88640 1 -- 172.21.15.31:0/2840892390 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd35c142180 con 0x7fd3480039b0 2024-04-15T00:21:14.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.073+0000 7fd363c88640 1 -- 172.21.15.31:0/2840892390 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd35c04f620 con 0x7fd3480039b0 2024-04-15T00:21:14.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.074+0000 7fd3527fc640 1 -- 172.21.15.31:0/2840892390 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fd358046070 con 0x7fd3480039b0 2024-04-15T00:21:14.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.074+0000 7fd3527fc640 1 --2- 172.21.15.31:0/2840892390 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fd34006b9c0 0x7fd34006de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:14.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.074+0000 7fd3527fc640 1 -- 172.21.15.31:0/2840892390 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd3580acaf0 con 0x7fd3480039b0 2024-04-15T00:21:14.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.074+0000 7fd361223640 1 --2- 172.21.15.31:0/2840892390 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fd34006b9c0 0x7fd34006de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:14.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.074+0000 7fd361223640 1 --2- 172.21.15.31:0/2840892390 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fd34006b9c0 0x7fd34006de80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd34c001eb0 tx=0x7fd34c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:14.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.078+0000 7fd3527fc640 1 -- 172.21.15.31:0/2840892390 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd35c1ddb80 con 0x7fd3480039b0 2024-04-15T00:21:14.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.260+0000 7fd363c88640 1 -- 172.21.15.31:0/2840892390 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd35c143430 con 0x7fd3480039b0 2024-04-15T00:21:14.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.262+0000 7fd3527fc640 1 -- 172.21.15.31:0/2840892390 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7fd35807b570 con 0x7fd3480039b0 2024-04-15T00:21:14.269 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:21:14.270 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"fsid":"b57c03ab-2810-4ea5-b233-6164468328c0","created":"2024-04-15T00:20:44.073217+0000","modified":"2024-04-15T00:21:12.971956+0000","last_up_change":"2024-04-15T00:20:55.515596+0000","last_in_change":"2024-04-15T00:20:46.364541+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:20:56.423161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:21:06.436169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:21:06.888505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:21:10.610300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b085a2f4-5565-4ccc-a98e-e56180791550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6817","nonce":2355720818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6819","nonce":2355720818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6823","nonce":2355720818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6821","nonce":2355720818}]},"public_addr":"172.21.15.31:6817/2355720818","cluster_addr":"172.21.15.31:6819/2355720818","heartbeat_back_addr":"172.21.15.31:6823/2355720818","heartbeat_front_addr":"172.21.15.31:6821/2355720818","state":["exists","up"]},{"osd":1,"uuid":"0f751557-3f18-464f-8b78-614d19549f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6809","nonce":2705297130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6811","nonce":2705297130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6815","nonce":2705297130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6813","nonce":2705297130}]},"public_addr":"172.21.15.31:6809/2705297130","cluster_addr":"172.21.15.31:6811/2705297130","heartbeat_back_addr":"172.21.15.31:6815/2705297130","heartbeat_front_addr":"172.21.15.31:6813/2705297130","state":["exists","up"]},{"osd":2,"uuid":"17371b09-2bd7-4ef7-926f-e7706319f064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6801","nonce":225061474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6803","nonce":225061474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6807","nonce":225061474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6805","nonce":225061474}]},"public_addr":"172.21.15.31:6801/225061474","cluster_addr":"172.21.15.31:6803/225061474","heartbeat_back_addr":"172.21.15.31:6807/225061474","heartbeat_front_addr":"172.21.15.31:6805/225061474","state":["exists","up"]},{"osd":3,"uuid":"315b6949-f009-4291-9581-aa4912642dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6825","nonce":3722449780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6827","nonce":3722449780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6831","nonce":3722449780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6829","nonce":3722449780}]},"public_addr":"172.21.15.31:6825/3722449780","cluster_addr":"172.21.15.31:6827/3722449780","heartbeat_back_addr":"172.21.15.31:6831/3722449780","heartbeat_front_addr":"172.21.15.31:6829/3722449780","state":["exists","up"]},{"osd":4,"uuid":"e3659369-cc78-4aa8-bd10-a199d4a1569d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6801","nonce":1279970071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6803","nonce":1279970071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6807","nonce":1279970071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6805","nonce":1279970071}]},"public_addr":"172.21.15.50:6801/1279970071","cluster_addr":"172.21.15.50:6803/1279970071","heartbeat_back_addr":"172.21.15.50:6807/1279970071","heartbeat_front_addr":"172.21.15.50:6805/1279970071","state":["exists","up"]},{"osd":5,"uuid":"35c3a4c0-0b45-45d2-85b9-301c347602f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6809","nonce":1589417182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6811","nonce":1589417182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6815","nonce":1589417182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6813","nonce":1589417182}]},"public_addr":"172.21.15.50:6809/1589417182","cluster_addr":"172.21.15.50:6811/1589417182","heartbeat_back_addr":"172.21.15.50:6815/1589417182","heartbeat_front_addr":"172.21.15.50:6813/1589417182","state":["exists","up"]},{"osd":6,"uuid":"20df7a76-245f-4946-9624-6ca9e949227b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6817","nonce":682288274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6819","nonce":682288274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6823","nonce":682288274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6821","nonce":682288274}]},"public_addr":"172.21.15.50:6817/682288274","cluster_addr":"172.21.15.50:6819/682288274","heartbeat_back_addr":"172.21.15.50:6823/682288274","heartbeat_front_addr":"172.21.15.50:6821/682288274","state":["exists","up"]},{"osd":7,"uuid":"95a504b7-e13a-49e6-8484-9dff4d5fc048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6825","nonce":4129060906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6827","nonce":4129060906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6831","nonce":4129060906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6829","nonce":4129060906}]},"public_addr":"172.21.15.50:6825/4129060906","cluster_addr":"172.21.15.50:6827/4129060906","heartbeat_back_addr":"172.21.15.50:6831/4129060906","heartbeat_front_addr":"172.21.15.50:6829/4129060906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.501980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.529961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.540913+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.521396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.448364+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.514136+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.527229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.508950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:21:14.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.263+0000 7fd363c88640 1 -- 172.21.15.31:0/2840892390 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fd34006b9c0 msgr2=0x7fd34006de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:14.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.263+0000 7fd363c88640 1 --2- 172.21.15.31:0/2840892390 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fd34006b9c0 0x7fd34006de80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd34c001eb0 tx=0x7fd34c009040 comp rx=0 tx=0).stop 2024-04-15T00:21:14.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.263+0000 7fd363c88640 1 -- 172.21.15.31:0/2840892390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3480039b0 msgr2=0x7fd35c149e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:14.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.264+0000 7fd363c88640 1 --2- 172.21.15.31:0/2840892390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3480039b0 0x7fd35c149e60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd358009bd0 tx=0x7fd358004730 comp rx=0 tx=0).stop 2024-04-15T00:21:14.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.264+0000 7fd363c88640 1 -- 172.21.15.31:0/2840892390 shutdown_connections 2024-04-15T00:21:14.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.264+0000 7fd363c88640 1 --2- 172.21.15.31:0/2840892390 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fd34006b9c0 0x7fd34006de80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:14.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.264+0000 7fd363c88640 1 --2- 172.21.15.31:0/2840892390 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd35c1dd700 0x7fd35c13bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:14.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.264+0000 7fd363c88640 1 --2- 172.21.15.31:0/2840892390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd35c147520 0x7fd35c1dd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:14.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.264+0000 7fd363c88640 1 --2- 172.21.15.31:0/2840892390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3480039b0 0x7fd35c149e60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:14.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.264+0000 7fd363c88640 1 -- 172.21.15.31:0/2840892390 >> 172.21.15.31:0/2840892390 conn(0x7fd35c0b7840 msgr2=0x7fd35c071410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:14.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.264+0000 7fd363c88640 1 -- 172.21.15.31:0/2840892390 shutdown_connections 2024-04-15T00:21:14.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.264+0000 7fd363c88640 1 -- 172.21.15.31:0/2840892390 wait complete. 2024-04-15T00:21:14.282 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:21:14.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.375+0000 7fa2742d5640 1 Processor -- start 2024-04-15T00:21:14.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.375+0000 7fa2742d5640 1 -- start start 2024-04-15T00:21:14.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.376+0000 7fa2742d5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa26c1446d0 0x7fa26c0b3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:14.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.376+0000 7fa2742d5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa26c0b2480 0x7fa26c0b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:14.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.376+0000 7fa2742d5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa26c143c60 con 0x7fa26c0af260 2024-04-15T00:21:14.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.376+0000 7fa2742d5640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fa26c072f80 con 0x7fa26c0b2480 2024-04-15T00:21:14.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.376+0000 7fa2742d5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fa26c0b0a40 con 0x7fa26c1446d0 2024-04-15T00:21:14.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.376+0000 7fa272872640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa26c0b2480 0x7fa26c0b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:14.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.376+0000 7fa272872640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa26c0b2480 0x7fa26c0b28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49914/0 (socket says 172.21.15.31:49914) 2024-04-15T00:21:14.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.376+0000 7fa272872640 1 -- 172.21.15.31:0/2511933679 learned_addr learned my addr 172.21.15.31:0/2511933679 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:14.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.376+0000 7fa271870640 1 --2- 172.21.15.31:0/2511933679 >> v2:172.21.15.50:3300/0 conn(0x7fa26c1446d0 0x7fa26c0b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:14.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.377+0000 7fa272872640 1 -- 172.21.15.31:0/2511933679 >> v2:172.21.15.50:3300/0 conn(0x7fa26c1446d0 msgr2=0x7fa26c0b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:14.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.377+0000 7fa272872640 1 --2- 172.21.15.31:0/2511933679 >> v2:172.21.15.50:3300/0 conn(0x7fa26c1446d0 0x7fa26c0b3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:14.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.377+0000 7fa272872640 1 -- 172.21.15.31:0/2511933679 >> v1:172.21.15.50:6789/0 conn(0x7fa26c0af260 legacy=0x7fa26c0af640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:14.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.377+0000 7fa272872640 1 -- 172.21.15.31:0/2511933679 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa26c0add40 con 0x7fa26c0b2480 2024-04-15T00:21:14.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.377+0000 7fa272872640 1 --2- 172.21.15.31:0/2511933679 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa26c0b2480 0x7fa26c0b28d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa26c0b65c0 tx=0x7fa26402bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414e2c826160ad29 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:14.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.377+0000 7fa27106f640 1 -- 172.21.15.31:0/2511933679 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26402c960 con 0x7fa26c0b2480 2024-04-15T00:21:14.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.378+0000 7fa27106f640 1 -- 172.21.15.31:0/2511933679 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa26402cb00 con 0x7fa26c0b2480 2024-04-15T00:21:14.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.378+0000 7fa27106f640 1 -- 172.21.15.31:0/2511933679 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2640343f0 con 0x7fa26c0b2480 2024-04-15T00:21:14.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.378+0000 7fa2742d5640 1 -- 172.21.15.31:0/2511933679 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa26c0b2480 msgr2=0x7fa26c0b28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:14.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.378+0000 7fa2742d5640 1 --2- 172.21.15.31:0/2511933679 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa26c0b2480 0x7fa26c0b28d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa26c0b65c0 tx=0x7fa26402bdc0 comp rx=0 tx=0).stop 2024-04-15T00:21:14.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.378+0000 7fa2742d5640 1 -- 172.21.15.31:0/2511933679 shutdown_connections 2024-04-15T00:21:14.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.378+0000 7fa2742d5640 1 --2- 172.21.15.31:0/2511933679 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa26c0b2480 0x7fa26c0b28d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:14.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.378+0000 7fa2742d5640 1 --2- 172.21.15.31:0/2511933679 >> v2:172.21.15.50:3300/0 conn(0x7fa26c1446d0 0x7fa26c0b3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:14.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.378+0000 7fa2742d5640 1 -- 172.21.15.31:0/2511933679 >> 172.21.15.31:0/2511933679 conn(0x7fa26c06c470 msgr2=0x7fa26c06c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:14.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.378+0000 7fa2742d5640 1 -- 172.21.15.31:0/2511933679 shutdown_connections 2024-04-15T00:21:14.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.378+0000 7fa2742d5640 1 -- 172.21.15.31:0/2511933679 wait complete. 2024-04-15T00:21:14.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.379+0000 7fa2742d5640 1 Processor -- start 2024-04-15T00:21:14.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.379+0000 7fa2742d5640 1 -- start start 2024-04-15T00:21:14.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.380+0000 7fa2742d5640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa26c0af260 0x7fa26c0b9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:14.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.380+0000 7fa2742d5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26c0b2480 0x7fa26c1caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:14.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.380+0000 7fa2742d5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa26c1446d0 0x7fa26c1d9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:14.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.380+0000 7fa2742d5640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa26c0aeb90 con 0x7fa26c1446d0 2024-04-15T00:21:14.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.380+0000 7fa2742d5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa26c1441b0 con 0x7fa26c0b2480 2024-04-15T00:21:14.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.380+0000 7fa2742d5640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fa26c0b2e10 con 0x7fa26c0af260 2024-04-15T00:21:14.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.380+0000 7fa272872640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa26c1446d0 0x7fa26c1d9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:14.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.380+0000 7fa272872640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa26c1446d0 0x7fa26c1d9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49926/0 (socket says 172.21.15.31:49926) 2024-04-15T00:21:14.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.380+0000 7fa272872640 1 -- 172.21.15.31:0/3407056259 learned_addr learned my addr 172.21.15.31:0/3407056259 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:14.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.380+0000 7fa271870640 1 --2- 172.21.15.31:0/3407056259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26c0b2480 0x7fa26c1caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:14.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.380+0000 7fa272071640 1 --2- 172.21.15.31:0/3407056259 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa26c0af260 0x7fa26c0b9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:14.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.380+0000 7fa272872640 1 -- 172.21.15.31:0/3407056259 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa26c0af260 msgr2=0x7fa26c0b9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:14.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.380+0000 7fa272872640 1 --2- 172.21.15.31:0/3407056259 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa26c0af260 0x7fa26c0b9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:14.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.380+0000 7fa272872640 1 -- 172.21.15.31:0/3407056259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26c0b2480 msgr2=0x7fa26c1caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:14.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.380+0000 7fa272872640 1 --2- 172.21.15.31:0/3407056259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26c0b2480 0x7fa26c1caad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:14.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.380+0000 7fa272872640 1 -- 172.21.15.31:0/3407056259 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa26c1ca8b0 con 0x7fa26c1446d0 2024-04-15T00:21:14.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.380+0000 7fa272872640 1 --2- 172.21.15.31:0/3407056259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa26c1446d0 0x7fa26c1d9ea0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa264009f40 tx=0x7fa264004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:14.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.380+0000 7fa262ffd640 1 -- 172.21.15.31:0/3407056259 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa264043020 con 0x7fa26c1446d0 2024-04-15T00:21:14.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.381+0000 7fa262ffd640 1 -- 172.21.15.31:0/3407056259 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa26403e450 con 0x7fa26c1446d0 2024-04-15T00:21:14.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.381+0000 7fa2742d5640 1 -- 172.21.15.31:0/3407056259 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa26c1cbe20 con 0x7fa26c1446d0 2024-04-15T00:21:14.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.381+0000 7fa262ffd640 1 -- 172.21.15.31:0/3407056259 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26403e840 con 0x7fa26c1446d0 2024-04-15T00:21:14.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.381+0000 7fa2742d5640 1 -- 172.21.15.31:0/3407056259 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa26c1cc7c0 con 0x7fa26c1446d0 2024-04-15T00:21:14.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.381+0000 7fa2742d5640 1 -- 172.21.15.31:0/3407056259 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa26c1cc5f0 con 0x7fa26c1446d0 2024-04-15T00:21:14.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.382+0000 7fa262ffd640 1 -- 172.21.15.31:0/3407056259 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fa264005d10 con 0x7fa26c1446d0 2024-04-15T00:21:14.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.382+0000 7fa262ffd640 1 --2- 172.21.15.31:0/3407056259 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fa25006b9c0 0x7fa25006de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:14.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.382+0000 7fa262ffd640 1 -- 172.21.15.31:0/3407056259 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa2640acdd0 con 0x7fa26c1446d0 2024-04-15T00:21:14.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.382+0000 7fa272071640 1 --2- 172.21.15.31:0/3407056259 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fa25006b9c0 0x7fa25006de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:14.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.383+0000 7fa272071640 1 --2- 172.21.15.31:0/3407056259 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fa25006b9c0 0x7fa25006de80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa268004f60 tx=0x7fa268007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:14.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.386+0000 7fa262ffd640 1 -- 172.21.15.31:0/3407056259 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa26404d020 con 0x7fa26c1446d0 2024-04-15T00:21:14.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.570+0000 7fa2742d5640 1 -- 172.21.15.31:0/3407056259 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa26c09f0c0 con 0x7fa26c1446d0 2024-04-15T00:21:14.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.571+0000 7fa262ffd640 1 -- 172.21.15.31:0/3407056259 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7fa26c09f0c0 con 0x7fa26c1446d0 2024-04-15T00:21:14.578 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:21:14.578 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"fsid":"b57c03ab-2810-4ea5-b233-6164468328c0","created":"2024-04-15T00:20:44.073217+0000","modified":"2024-04-15T00:21:12.971956+0000","last_up_change":"2024-04-15T00:20:55.515596+0000","last_in_change":"2024-04-15T00:20:46.364541+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:20:56.423161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:21:06.436169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:21:06.888505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:21:10.610300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b085a2f4-5565-4ccc-a98e-e56180791550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6817","nonce":2355720818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6819","nonce":2355720818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6823","nonce":2355720818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6821","nonce":2355720818}]},"public_addr":"172.21.15.31:6817/2355720818","cluster_addr":"172.21.15.31:6819/2355720818","heartbeat_back_addr":"172.21.15.31:6823/2355720818","heartbeat_front_addr":"172.21.15.31:6821/2355720818","state":["exists","up"]},{"osd":1,"uuid":"0f751557-3f18-464f-8b78-614d19549f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6809","nonce":2705297130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6811","nonce":2705297130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6815","nonce":2705297130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6813","nonce":2705297130}]},"public_addr":"172.21.15.31:6809/2705297130","cluster_addr":"172.21.15.31:6811/2705297130","heartbeat_back_addr":"172.21.15.31:6815/2705297130","heartbeat_front_addr":"172.21.15.31:6813/2705297130","state":["exists","up"]},{"osd":2,"uuid":"17371b09-2bd7-4ef7-926f-e7706319f064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6801","nonce":225061474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6803","nonce":225061474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6807","nonce":225061474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6805","nonce":225061474}]},"public_addr":"172.21.15.31:6801/225061474","cluster_addr":"172.21.15.31:6803/225061474","heartbeat_back_addr":"172.21.15.31:6807/225061474","heartbeat_front_addr":"172.21.15.31:6805/225061474","state":["exists","up"]},{"osd":3,"uuid":"315b6949-f009-4291-9581-aa4912642dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6825","nonce":3722449780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6827","nonce":3722449780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6831","nonce":3722449780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6829","nonce":3722449780}]},"public_addr":"172.21.15.31:6825/3722449780","cluster_addr":"172.21.15.31:6827/3722449780","heartbeat_back_addr":"172.21.15.31:6831/3722449780","heartbeat_front_addr":"172.21.15.31:6829/3722449780","state":["exists","up"]},{"osd":4,"uuid":"e3659369-cc78-4aa8-bd10-a199d4a1569d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6801","nonce":1279970071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6803","nonce":1279970071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6807","nonce":1279970071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6805","nonce":1279970071}]},"public_addr":"172.21.15.50:6801/1279970071","cluster_addr":"172.21.15.50:6803/1279970071","heartbeat_back_addr":"172.21.15.50:6807/1279970071","heartbeat_front_addr":"172.21.15.50:6805/1279970071","state":["exists","up"]},{"osd":5,"uuid":"35c3a4c0-0b45-45d2-85b9-301c347602f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6809","nonce":1589417182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6811","nonce":1589417182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6815","nonce":1589417182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6813","nonce":1589417182}]},"public_addr":"172.21.15.50:6809/1589417182","cluster_addr":"172.21.15.50:6811/1589417182","heartbeat_back_addr":"172.21.15.50:6815/1589417182","heartbeat_front_addr":"172.21.15.50:6813/1589417182","state":["exists","up"]},{"osd":6,"uuid":"20df7a76-245f-4946-9624-6ca9e949227b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6817","nonce":682288274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6819","nonce":682288274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6823","nonce":682288274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6821","nonce":682288274}]},"public_addr":"172.21.15.50:6817/682288274","cluster_addr":"172.21.15.50:6819/682288274","heartbeat_back_addr":"172.21.15.50:6823/682288274","heartbeat_front_addr":"172.21.15.50:6821/682288274","state":["exists","up"]},{"osd":7,"uuid":"95a504b7-e13a-49e6-8484-9dff4d5fc048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6825","nonce":4129060906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6827","nonce":4129060906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6831","nonce":4129060906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6829","nonce":4129060906}]},"public_addr":"172.21.15.50:6825/4129060906","cluster_addr":"172.21.15.50:6827/4129060906","heartbeat_back_addr":"172.21.15.50:6831/4129060906","heartbeat_front_addr":"172.21.15.50:6829/4129060906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.501980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.529961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.540913+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.521396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.448364+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.514136+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.527229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.508950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:21:14.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.572+0000 7fa2742d5640 1 -- 172.21.15.31:0/3407056259 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fa25006b9c0 msgr2=0x7fa25006de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:14.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.572+0000 7fa2742d5640 1 --2- 172.21.15.31:0/3407056259 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fa25006b9c0 0x7fa25006de80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa268004f60 tx=0x7fa268007e30 comp rx=0 tx=0).stop 2024-04-15T00:21:14.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.573+0000 7fa2742d5640 1 -- 172.21.15.31:0/3407056259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa26c1446d0 msgr2=0x7fa26c1d9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:14.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.573+0000 7fa2742d5640 1 --2- 172.21.15.31:0/3407056259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa26c1446d0 0x7fa26c1d9ea0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa264009f40 tx=0x7fa264004a40 comp rx=0 tx=0).stop 2024-04-15T00:21:14.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.573+0000 7fa2742d5640 1 -- 172.21.15.31:0/3407056259 shutdown_connections 2024-04-15T00:21:14.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.573+0000 7fa2742d5640 1 --2- 172.21.15.31:0/3407056259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa26c1446d0 0x7fa26c1d9ea0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:14.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.573+0000 7fa2742d5640 1 --2- 172.21.15.31:0/3407056259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26c0b2480 0x7fa26c1caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:14.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.573+0000 7fa2742d5640 1 --2- 172.21.15.31:0/3407056259 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fa25006b9c0 0x7fa25006de80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:14.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.573+0000 7fa2742d5640 1 --2- 172.21.15.31:0/3407056259 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa26c0af260 0x7fa26c0b9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:14.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.573+0000 7fa2742d5640 1 -- 172.21.15.31:0/3407056259 >> 172.21.15.31:0/3407056259 conn(0x7fa26c06c470 msgr2=0x7fa26c1cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:14.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.573+0000 7fa2742d5640 1 -- 172.21.15.31:0/3407056259 shutdown_connections 2024-04-15T00:21:14.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.573+0000 7fa2742d5640 1 -- 172.21.15.31:0/3407056259 wait complete. 2024-04-15T00:21:14.605 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T00:21:14.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.700+0000 7fc5a658c640 1 Processor -- start 2024-04-15T00:21:14.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.700+0000 7fc5a658c640 1 -- start start 2024-04-15T00:21:14.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.700+0000 7fc5a658c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc5a014b8e0 0x7fc5a00b9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:14.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.700+0000 7fc5a658c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc5a00b8bf0 0x7fc5a0151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:14.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.700+0000 7fc5a658c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5a00bb2d0 con 0x7fc5a00baef0 2024-04-15T00:21:14.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.700+0000 7fc5a658c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fc5a014ae00 con 0x7fc5a00b8bf0 2024-04-15T00:21:14.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.700+0000 7fc5a658c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc5a014b0e0 con 0x7fc5a014b8e0 2024-04-15T00:21:14.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.700+0000 7fc5a4b29640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc5a00b8bf0 0x7fc5a0151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:14.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.700+0000 7fc5a4b29640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc5a00b8bf0 0x7fc5a0151ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49928/0 (socket says 172.21.15.31:49928) 2024-04-15T00:21:14.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.700+0000 7fc5a4b29640 1 -- 172.21.15.31:0/2890789421 learned_addr learned my addr 172.21.15.31:0/2890789421 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:14.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.701+0000 7fc59f7fe640 1 --2- 172.21.15.31:0/2890789421 >> v2:172.21.15.50:3300/0 conn(0x7fc5a014b8e0 0x7fc5a00b9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:14.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.701+0000 7fc5a4b29640 1 -- 172.21.15.31:0/2890789421 >> v2:172.21.15.50:3300/0 conn(0x7fc5a014b8e0 msgr2=0x7fc5a00b9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:14.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.701+0000 7fc5a4b29640 1 --2- 172.21.15.31:0/2890789421 >> v2:172.21.15.50:3300/0 conn(0x7fc5a014b8e0 0x7fc5a00b9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:14.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.701+0000 7fc5a4b29640 1 -- 172.21.15.31:0/2890789421 >> v1:172.21.15.50:6789/0 conn(0x7fc5a00baef0 legacy=0x7fc5a0147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:14.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.701+0000 7fc5a4b29640 1 -- 172.21.15.31:0/2890789421 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a00bcbb0 con 0x7fc5a00b8bf0 2024-04-15T00:21:14.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.701+0000 7fc59f7fe640 1 --2- 172.21.15.31:0/2890789421 >> v2:172.21.15.50:3300/0 conn(0x7fc5a014b8e0 0x7fc5a00b9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:14.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.701+0000 7fc5a4b29640 1 --2- 172.21.15.31:0/2890789421 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a00b8bf0 0x7fc5a0151ff0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc5a00737c0 tx=0x7fc59802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db8ccd4883e4fd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:14.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.702+0000 7fc59effd640 1 -- 172.21.15.31:0/2890789421 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc59802ca80 con 0x7fc5a00b8bf0 2024-04-15T00:21:14.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.702+0000 7fc59effd640 1 -- 172.21.15.31:0/2890789421 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc59802cc20 con 0x7fc5a00b8bf0 2024-04-15T00:21:14.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.702+0000 7fc59effd640 1 -- 172.21.15.31:0/2890789421 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5980343f0 con 0x7fc5a00b8bf0 2024-04-15T00:21:14.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.702+0000 7fc5a658c640 1 -- 172.21.15.31:0/2890789421 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a00b8bf0 msgr2=0x7fc5a0151ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:14.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.702+0000 7fc5a658c640 1 --2- 172.21.15.31:0/2890789421 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a00b8bf0 0x7fc5a0151ff0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc5a00737c0 tx=0x7fc59802bee0 comp rx=0 tx=0).stop 2024-04-15T00:21:14.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.702+0000 7fc5a658c640 1 -- 172.21.15.31:0/2890789421 shutdown_connections 2024-04-15T00:21:14.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.702+0000 7fc5a658c640 1 --2- 172.21.15.31:0/2890789421 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a00b8bf0 0x7fc5a0151ff0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:14.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.702+0000 7fc5a658c640 1 --2- 172.21.15.31:0/2890789421 >> v2:172.21.15.50:3300/0 conn(0x7fc5a014b8e0 0x7fc5a00b9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:14.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.702+0000 7fc5a658c640 1 -- 172.21.15.31:0/2890789421 >> 172.21.15.31:0/2890789421 conn(0x7fc5a009ed70 msgr2=0x7fc5a009f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:14.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.702+0000 7fc5a658c640 1 -- 172.21.15.31:0/2890789421 shutdown_connections 2024-04-15T00:21:14.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.702+0000 7fc5a658c640 1 -- 172.21.15.31:0/2890789421 wait complete. 2024-04-15T00:21:14.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.703+0000 7fc5a658c640 1 Processor -- start 2024-04-15T00:21:14.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.703+0000 7fc5a658c640 1 -- start start 2024-04-15T00:21:14.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.704+0000 7fc5a658c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5a00b8bf0 0x7fc5a01e0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:14.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.704+0000 7fc5a658c640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc5a00baef0 0x7fc5a01d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:14.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.704+0000 7fc5a658c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a014b8e0 0x7fc5a0143a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:14.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.704+0000 7fc5a658c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a00b9180 con 0x7fc5a014b8e0 2024-04-15T00:21:14.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.704+0000 7fc5a658c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a00b9000 con 0x7fc5a00b8bf0 2024-04-15T00:21:14.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.704+0000 7fc5a658c640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fc5a00b9300 con 0x7fc5a00baef0 2024-04-15T00:21:14.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.704+0000 7fc5a4b29640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a014b8e0 0x7fc5a0143a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:14.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.704+0000 7fc5a4b29640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a014b8e0 0x7fc5a0143a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49934/0 (socket says 172.21.15.31:49934) 2024-04-15T00:21:14.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.704+0000 7fc5a4b29640 1 -- 172.21.15.31:0/3405656933 learned_addr learned my addr 172.21.15.31:0/3405656933 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:14.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.704+0000 7fc59ffff640 1 --2- 172.21.15.31:0/3405656933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5a00b8bf0 0x7fc5a01e0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:14.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.704+0000 7fc59f7fe640 1 --2- 172.21.15.31:0/3405656933 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc5a00baef0 0x7fc5a01d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:14.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.704+0000 7fc5a4b29640 1 -- 172.21.15.31:0/3405656933 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc5a00baef0 msgr2=0x7fc5a01d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:14.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.704+0000 7fc5a4b29640 1 --2- 172.21.15.31:0/3405656933 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc5a00baef0 0x7fc5a01d14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:14.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.704+0000 7fc5a4b29640 1 -- 172.21.15.31:0/3405656933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5a00b8bf0 msgr2=0x7fc5a01e0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:14.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.704+0000 7fc5a4b29640 1 --2- 172.21.15.31:0/3405656933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5a00b8bf0 0x7fc5a01e0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:14.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.704+0000 7fc5a4b29640 1 -- 172.21.15.31:0/3405656933 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a01e02e0 con 0x7fc5a014b8e0 2024-04-15T00:21:14.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.704+0000 7fc5a4b29640 1 --2- 172.21.15.31:0/3405656933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a014b8e0 0x7fc5a0143a60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc59802c4f0 tx=0x7fc598004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:14.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.705+0000 7fc59cff9640 1 -- 172.21.15.31:0/3405656933 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc598043020 con 0x7fc5a014b8e0 2024-04-15T00:21:14.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.705+0000 7fc59cff9640 1 -- 172.21.15.31:0/3405656933 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc59803e450 con 0x7fc5a014b8e0 2024-04-15T00:21:14.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.705+0000 7fc5a658c640 1 -- 172.21.15.31:0/3405656933 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5a01e05c0 con 0x7fc5a014b8e0 2024-04-15T00:21:14.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.705+0000 7fc59cff9640 1 -- 172.21.15.31:0/3405656933 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc598009510 con 0x7fc5a014b8e0 2024-04-15T00:21:14.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.705+0000 7fc5a658c640 1 -- 172.21.15.31:0/3405656933 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5a01d3410 con 0x7fc5a014b8e0 2024-04-15T00:21:14.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.706+0000 7fc5a658c640 1 -- 172.21.15.31:0/3405656933 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5a004f620 con 0x7fc5a014b8e0 2024-04-15T00:21:14.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.706+0000 7fc59cff9640 1 -- 172.21.15.31:0/3405656933 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc598046020 con 0x7fc5a014b8e0 2024-04-15T00:21:14.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.706+0000 7fc59cff9640 1 --2- 172.21.15.31:0/3405656933 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc58006b990 0x7fc58006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:14.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.706+0000 7fc59cff9640 1 -- 172.21.15.31:0/3405656933 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc5980ad2e0 con 0x7fc5a014b8e0 2024-04-15T00:21:14.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.707+0000 7fc59ffff640 1 --2- 172.21.15.31:0/3405656933 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc58006b990 0x7fc58006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:14.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.707+0000 7fc59ffff640 1 --2- 172.21.15.31:0/3405656933 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc58006b990 0x7fc58006de50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc590001640 tx=0x7fc590009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:14.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.711+0000 7fc59cff9640 1 -- 172.21.15.31:0/3405656933 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc59804d030 con 0x7fc5a014b8e0 2024-04-15T00:21:14.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.929+0000 7fc5a658c640 1 -- 172.21.15.31:0/3405656933 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc5a0149410 con 0x7fc5a014b8e0 2024-04-15T00:21:14.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.929+0000 7fc59cff9640 1 -- 172.21.15.31:0/3405656933 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3520 (secure 0 0 0) 0x7fc59807bc40 con 0x7fc5a014b8e0 2024-04-15T00:21:14.937 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:21:14.937 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/921487249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":921487249},{"type":"v1","addr":"172.21.15.50:6833","nonce":921487249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T00:21:07.925196+0000","modified":"2024-04-15T00:21:12.972118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/93464605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":93464605},{"type":"v1","addr":"172.21.15.31:6835","nonce":93464605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-04-15T00:21:14.937 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 6 2024-04-15T00:21:14.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.931+0000 7fc5a658c640 1 -- 172.21.15.31:0/3405656933 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc58006b990 msgr2=0x7fc58006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:14.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.931+0000 7fc5a658c640 1 --2- 172.21.15.31:0/3405656933 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc58006b990 0x7fc58006de50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc590001640 tx=0x7fc590009040 comp rx=0 tx=0).stop 2024-04-15T00:21:14.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.931+0000 7fc5a658c640 1 -- 172.21.15.31:0/3405656933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a014b8e0 msgr2=0x7fc5a0143a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:14.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.931+0000 7fc5a658c640 1 --2- 172.21.15.31:0/3405656933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a014b8e0 0x7fc5a0143a60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc59802c4f0 tx=0x7fc598004a40 comp rx=0 tx=0).stop 2024-04-15T00:21:14.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.931+0000 7fc5a658c640 1 -- 172.21.15.31:0/3405656933 shutdown_connections 2024-04-15T00:21:14.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.931+0000 7fc5a658c640 1 --2- 172.21.15.31:0/3405656933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a014b8e0 0x7fc5a0143a60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:14.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.931+0000 7fc5a658c640 1 --2- 172.21.15.31:0/3405656933 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc58006b990 0x7fc58006de50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:14.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.931+0000 7fc5a658c640 1 --2- 172.21.15.31:0/3405656933 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc5a00baef0 0x7fc5a01d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:14.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.931+0000 7fc5a658c640 1 --2- 172.21.15.31:0/3405656933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5a00b8bf0 0x7fc5a01e0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:14.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.931+0000 7fc5a658c640 1 -- 172.21.15.31:0/3405656933 >> 172.21.15.31:0/3405656933 conn(0x7fc5a009ed70 msgr2=0x7fc5a009bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:14.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.932+0000 7fc5a658c640 1 -- 172.21.15.31:0/3405656933 shutdown_connections 2024-04-15T00:21:14.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:14.932+0000 7fc5a658c640 1 -- 172.21.15.31:0/3405656933 wait complete. 2024-04-15T00:21:14.949 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:21:15.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.043+0000 7fc5608de640 1 Processor -- start 2024-04-15T00:21:15.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.043+0000 7fc5608de640 1 -- start start 2024-04-15T00:21:15.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.044+0000 7fc5608de640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc55c0b94f0 0x7fc55c0bb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.044+0000 7fc5608de640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc55c0b9fb0 con 0x7fc55c14b870 2024-04-15T00:21:15.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.044+0000 7fc5608de640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc55c14ad90 con 0x7fc55c0b9bd0 2024-04-15T00:21:15.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.044+0000 7fc5608de640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fc55c14b3e0 con 0x7fc55c0b94f0 2024-04-15T00:21:15.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.044+0000 7fc55ad9d640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc55c14b870 0x7fc55c0b8a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:36522/0 (socket says 172.21.15.31:36522) 2024-04-15T00:21:15.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.044+0000 7fc55ad9d640 1 -- 172.21.15.31:0/1374590989 learned_addr learned my addr 172.21.15.31:0/1374590989 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:15.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.044+0000 7fc55959a640 1 -- 172.21.15.31:0/1374590989 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3486627566 0 0) 0x7fc55c0b9fb0 con 0x7fc55c14b870 2024-04-15T00:21:15.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.044+0000 7fc55959a640 1 -- 172.21.15.31:0/1374590989 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc548003520 con 0x7fc55c14b870 2024-04-15T00:21:15.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.044+0000 7fc559d9b640 1 --2- 172.21.15.31:0/1374590989 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc55c0b94f0 0x7fc55c0bb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.044+0000 7fc55959a640 1 -- 172.21.15.31:0/1374590989 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3685871848 0 0) 0x7fc548003520 con 0x7fc55c14b870 2024-04-15T00:21:15.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.044+0000 7fc55959a640 1 -- 172.21.15.31:0/1374590989 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc55c0b94f0 msgr2=0x7fc55c0bb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:15.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.044+0000 7fc55959a640 1 --2- 172.21.15.31:0/1374590989 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc55c0b94f0 0x7fc55c0bb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.044+0000 7fc55959a640 1 -- 172.21.15.31:0/1374590989 >> v1:172.21.15.50:6789/0 conn(0x7fc55c0b9bd0 legacy=0x7fc55c147600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:15.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.044+0000 7fc55959a640 1 -- 172.21.15.31:0/1374590989 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc55c14b070 con 0x7fc55c14b870 2024-04-15T00:21:15.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.044+0000 7fc55959a640 1 -- 172.21.15.31:0/1374590989 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 697057150 0 0) 0x7fc554001670 con 0x7fc55c14b870 2024-04-15T00:21:15.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.045+0000 7fc55959a640 1 -- 172.21.15.31:0/1374590989 >> v1:172.21.15.31:6789/0 conn(0x7fc55c14b870 legacy=0x7fc55c0b8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:15.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.045+0000 7fc55959a640 1 --2- 172.21.15.31:0/1374590989 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc55c0b94f0 0x7fc5480039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.045+0000 7fc55959a640 1 --2- 172.21.15.31:0/1374590989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc548003f20 0x7fc548004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.045+0000 7fc55959a640 1 --2- 172.21.15.31:0/1374590989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc548004d40 0x7fc5480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.045+0000 7fc55959a640 1 -- 172.21.15.31:0/1374590989 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c14b3e0 con 0x7fc548003f20 2024-04-15T00:21:15.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.045+0000 7fc55959a640 1 -- 172.21.15.31:0/1374590989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc54800bb80 con 0x7fc548004d40 2024-04-15T00:21:15.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.045+0000 7fc55959a640 1 -- 172.21.15.31:0/1374590989 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fc54800bd80 con 0x7fc55c0b94f0 2024-04-15T00:21:15.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.045+0000 7fc559d9b640 1 --2- 172.21.15.31:0/1374590989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc548003f20 0x7fc548004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.045+0000 7fc55a59c640 1 --2- 172.21.15.31:0/1374590989 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc55c0b94f0 0x7fc5480039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.045+0000 7fc55ad9d640 1 --2- 172.21.15.31:0/1374590989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc548004d40 0x7fc5480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.045+0000 7fc559d9b640 1 -- 172.21.15.31:0/1374590989 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc55c0b94f0 msgr2=0x7fc5480039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:15.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.045+0000 7fc559d9b640 1 --2- 172.21.15.31:0/1374590989 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc55c0b94f0 0x7fc5480039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.045+0000 7fc559d9b640 1 -- 172.21.15.31:0/1374590989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc548004d40 msgr2=0x7fc5480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:15.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.045+0000 7fc559d9b640 1 --2- 172.21.15.31:0/1374590989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc548004d40 0x7fc5480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.045+0000 7fc559d9b640 1 -- 172.21.15.31:0/1374590989 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc548003520 con 0x7fc548003f20 2024-04-15T00:21:15.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.046+0000 7fc559d9b640 1 --2- 172.21.15.31:0/1374590989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc548003f20 0x7fc548004800 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc544009ac0 tx=0x7fc548005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a69e414c252b7c11 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:15.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.046+0000 7fc55959a640 1 -- 172.21.15.31:0/1374590989 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc544039070 con 0x7fc548003f20 2024-04-15T00:21:15.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.046+0000 7fc55959a640 1 -- 172.21.15.31:0/1374590989 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc54402c6b0 con 0x7fc548003f20 2024-04-15T00:21:15.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.046+0000 7fc55959a640 1 -- 172.21.15.31:0/1374590989 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc544009690 con 0x7fc548003f20 2024-04-15T00:21:15.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.046+0000 7fc5608de640 1 -- 172.21.15.31:0/1374590989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc548003f20 msgr2=0x7fc548004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:15.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.046+0000 7fc5608de640 1 --2- 172.21.15.31:0/1374590989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc548003f20 0x7fc548004800 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc544009ac0 tx=0x7fc548005830 comp rx=0 tx=0).stop 2024-04-15T00:21:15.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.046+0000 7fc55ad9d640 1 -- 172.21.15.31:0/1374590989 reap_dead start 2024-04-15T00:21:15.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.046+0000 7fc5608de640 1 -- 172.21.15.31:0/1374590989 shutdown_connections 2024-04-15T00:21:15.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.046+0000 7fc5608de640 1 -- 172.21.15.31:0/1374590989 >> 172.21.15.31:0/1374590989 conn(0x7fc55c09ed70 msgr2=0x7fc55c09f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:15.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.047+0000 7fc5608de640 1 -- 172.21.15.31:0/1374590989 shutdown_connections 2024-04-15T00:21:15.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.047+0000 7fc5608de640 1 -- 172.21.15.31:0/1374590989 wait complete. 2024-04-15T00:21:15.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.048+0000 7fc5608de640 1 Processor -- start 2024-04-15T00:21:15.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.048+0000 7fc5608de640 1 -- start start 2024-04-15T00:21:15.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.048+0000 7fc5608de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc548003f20 0x7fc55c0a2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.048+0000 7fc5608de640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc55c141ef0 0x7fc55c143770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.048+0000 7fc5608de640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc55c144cf0 0x7fc55c142600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.048+0000 7fc5608de640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c0b92f0 con 0x7fc55c141ef0 2024-04-15T00:21:15.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.048+0000 7fc5608de640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c0b9170 con 0x7fc548003f20 2024-04-15T00:21:15.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.048+0000 7fc5608de640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fc55c0bb140 con 0x7fc55c144cf0 2024-04-15T00:21:15.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.048+0000 7fc559d9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc55c141ef0 0x7fc55c143770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.048+0000 7fc559d9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc55c141ef0 0x7fc55c143770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49956/0 (socket says 172.21.15.31:49956) 2024-04-15T00:21:15.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.048+0000 7fc559d9b640 1 -- 172.21.15.31:0/3427603903 learned_addr learned my addr 172.21.15.31:0/3427603903 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:15.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.048+0000 7fc55a59c640 1 --2- 172.21.15.31:0/3427603903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc548003f20 0x7fc55c0a2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.048+0000 7fc55ad9d640 1 --2- 172.21.15.31:0/3427603903 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc55c144cf0 0x7fc55c142600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.049+0000 7fc559d9b640 1 -- 172.21.15.31:0/3427603903 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc55c144cf0 msgr2=0x7fc55c142600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:15.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.049+0000 7fc559d9b640 1 --2- 172.21.15.31:0/3427603903 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc55c144cf0 0x7fc55c142600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.049+0000 7fc559d9b640 1 -- 172.21.15.31:0/3427603903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc548003f20 msgr2=0x7fc55c0a2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:15.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.049+0000 7fc559d9b640 1 --2- 172.21.15.31:0/3427603903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc548003f20 0x7fc55c0a2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.049+0000 7fc559d9b640 1 -- 172.21.15.31:0/3427603903 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc55c143e70 con 0x7fc55c141ef0 2024-04-15T00:21:15.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.049+0000 7fc559d9b640 1 --2- 172.21.15.31:0/3427603903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc55c141ef0 0x7fc55c143770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc544037040 tx=0x7fc544004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:15.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.049+0000 7fc552ffd640 1 -- 172.21.15.31:0/3427603903 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc544042020 con 0x7fc55c141ef0 2024-04-15T00:21:15.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.049+0000 7fc552ffd640 1 -- 172.21.15.31:0/3427603903 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc54403a040 con 0x7fc55c141ef0 2024-04-15T00:21:15.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.049+0000 7fc5608de640 1 -- 172.21.15.31:0/3427603903 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc55c1444f0 con 0x7fc55c141ef0 2024-04-15T00:21:15.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.049+0000 7fc552ffd640 1 -- 172.21.15.31:0/3427603903 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc544039070 con 0x7fc55c141ef0 2024-04-15T00:21:15.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.049+0000 7fc5608de640 1 -- 172.21.15.31:0/3427603903 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc55c145170 con 0x7fc55c141ef0 2024-04-15T00:21:15.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.050+0000 7fc5608de640 1 -- 172.21.15.31:0/3427603903 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc55c0bc290 con 0x7fc55c141ef0 2024-04-15T00:21:15.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.051+0000 7fc552ffd640 1 -- 172.21.15.31:0/3427603903 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc544045020 con 0x7fc55c141ef0 2024-04-15T00:21:15.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.051+0000 7fc552ffd640 1 --2- 172.21.15.31:0/3427603903 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc53c06b9c0 0x7fc53c06de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.051+0000 7fc552ffd640 1 -- 172.21.15.31:0/3427603903 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc5440abea0 con 0x7fc55c141ef0 2024-04-15T00:21:15.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.051+0000 7fc55a59c640 1 --2- 172.21.15.31:0/3427603903 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc53c06b9c0 0x7fc53c06de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.051+0000 7fc55a59c640 1 --2- 172.21.15.31:0/3427603903 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc53c06b9c0 0x7fc53c06de80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc54c002010 tx=0x7fc54c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:15.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.055+0000 7fc552ffd640 1 -- 172.21.15.31:0/3427603903 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc54404c070 con 0x7fc55c141ef0 2024-04-15T00:21:15.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.239+0000 7fc5608de640 1 -- 172.21.15.31:0/3427603903 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc55c04f620 con 0x7fc55c141ef0 2024-04-15T00:21:15.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.240+0000 7fc552ffd640 1 -- 172.21.15.31:0/3427603903 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7fc54407a120 con 0x7fc55c141ef0 2024-04-15T00:21:15.247 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:21:15.247 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"fsid":"b57c03ab-2810-4ea5-b233-6164468328c0","created":"2024-04-15T00:20:44.073217+0000","modified":"2024-04-15T00:21:12.971956+0000","last_up_change":"2024-04-15T00:20:55.515596+0000","last_in_change":"2024-04-15T00:20:46.364541+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:20:56.423161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:21:06.436169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:21:06.888505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:21:10.610300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b085a2f4-5565-4ccc-a98e-e56180791550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6817","nonce":2355720818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6819","nonce":2355720818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6823","nonce":2355720818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6821","nonce":2355720818}]},"public_addr":"172.21.15.31:6817/2355720818","cluster_addr":"172.21.15.31:6819/2355720818","heartbeat_back_addr":"172.21.15.31:6823/2355720818","heartbeat_front_addr":"172.21.15.31:6821/2355720818","state":["exists","up"]},{"osd":1,"uuid":"0f751557-3f18-464f-8b78-614d19549f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6809","nonce":2705297130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6811","nonce":2705297130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6815","nonce":2705297130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6813","nonce":2705297130}]},"public_addr":"172.21.15.31:6809/2705297130","cluster_addr":"172.21.15.31:6811/2705297130","heartbeat_back_addr":"172.21.15.31:6815/2705297130","heartbeat_front_addr":"172.21.15.31:6813/2705297130","state":["exists","up"]},{"osd":2,"uuid":"17371b09-2bd7-4ef7-926f-e7706319f064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6801","nonce":225061474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6803","nonce":225061474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6807","nonce":225061474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6805","nonce":225061474}]},"public_addr":"172.21.15.31:6801/225061474","cluster_addr":"172.21.15.31:6803/225061474","heartbeat_back_addr":"172.21.15.31:6807/225061474","heartbeat_front_addr":"172.21.15.31:6805/225061474","state":["exists","up"]},{"osd":3,"uuid":"315b6949-f009-4291-9581-aa4912642dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6825","nonce":3722449780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6827","nonce":3722449780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6831","nonce":3722449780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6829","nonce":3722449780}]},"public_addr":"172.21.15.31:6825/3722449780","cluster_addr":"172.21.15.31:6827/3722449780","heartbeat_back_addr":"172.21.15.31:6831/3722449780","heartbeat_front_addr":"172.21.15.31:6829/3722449780","state":["exists","up"]},{"osd":4,"uuid":"e3659369-cc78-4aa8-bd10-a199d4a1569d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6801","nonce":1279970071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6803","nonce":1279970071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6807","nonce":1279970071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6805","nonce":1279970071}]},"public_addr":"172.21.15.50:6801/1279970071","cluster_addr":"172.21.15.50:6803/1279970071","heartbeat_back_addr":"172.21.15.50:6807/1279970071","heartbeat_front_addr":"172.21.15.50:6805/1279970071","state":["exists","up"]},{"osd":5,"uuid":"35c3a4c0-0b45-45d2-85b9-301c347602f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6809","nonce":1589417182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6811","nonce":1589417182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6815","nonce":1589417182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6813","nonce":1589417182}]},"public_addr":"172.21.15.50:6809/1589417182","cluster_addr":"172.21.15.50:6811/1589417182","heartbeat_back_addr":"172.21.15.50:6815/1589417182","heartbeat_front_addr":"172.21.15.50:6813/1589417182","state":["exists","up"]},{"osd":6,"uuid":"20df7a76-245f-4946-9624-6ca9e949227b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6817","nonce":682288274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6819","nonce":682288274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6823","nonce":682288274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6821","nonce":682288274}]},"public_addr":"172.21.15.50:6817/682288274","cluster_addr":"172.21.15.50:6819/682288274","heartbeat_back_addr":"172.21.15.50:6823/682288274","heartbeat_front_addr":"172.21.15.50:6821/682288274","state":["exists","up"]},{"osd":7,"uuid":"95a504b7-e13a-49e6-8484-9dff4d5fc048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6825","nonce":4129060906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6827","nonce":4129060906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6831","nonce":4129060906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6829","nonce":4129060906}]},"public_addr":"172.21.15.50:6825/4129060906","cluster_addr":"172.21.15.50:6827/4129060906","heartbeat_back_addr":"172.21.15.50:6831/4129060906","heartbeat_front_addr":"172.21.15.50:6829/4129060906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.501980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.529961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.540913+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.521396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.448364+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.514136+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.527229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.508950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:21:15.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.242+0000 7fc5608de640 1 -- 172.21.15.31:0/3427603903 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc53c06b9c0 msgr2=0x7fc53c06de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:15.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.242+0000 7fc5608de640 1 --2- 172.21.15.31:0/3427603903 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc53c06b9c0 0x7fc53c06de80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc54c002010 tx=0x7fc54c009040 comp rx=0 tx=0).stop 2024-04-15T00:21:15.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.242+0000 7fc5608de640 1 -- 172.21.15.31:0/3427603903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc55c141ef0 msgr2=0x7fc55c143770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:15.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.242+0000 7fc5608de640 1 --2- 172.21.15.31:0/3427603903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc55c141ef0 0x7fc55c143770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc544037040 tx=0x7fc544004730 comp rx=0 tx=0).stop 2024-04-15T00:21:15.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.242+0000 7fc5608de640 1 -- 172.21.15.31:0/3427603903 shutdown_connections 2024-04-15T00:21:15.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.242+0000 7fc5608de640 1 --2- 172.21.15.31:0/3427603903 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc53c06b9c0 0x7fc53c06de80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.242+0000 7fc5608de640 1 --2- 172.21.15.31:0/3427603903 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc55c144cf0 0x7fc55c142600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.242+0000 7fc5608de640 1 --2- 172.21.15.31:0/3427603903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc55c141ef0 0x7fc55c143770 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.242+0000 7fc5608de640 1 --2- 172.21.15.31:0/3427603903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc548003f20 0x7fc55c0a2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.242+0000 7fc5608de640 1 -- 172.21.15.31:0/3427603903 >> 172.21.15.31:0/3427603903 conn(0x7fc55c09ed70 msgr2=0x7fc55c072d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:15.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.242+0000 7fc5608de640 1 -- 172.21.15.31:0/3427603903 shutdown_connections 2024-04-15T00:21:15.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.242+0000 7fc5608de640 1 -- 172.21.15.31:0/3427603903 wait complete. 2024-04-15T00:21:15.461 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-15T00:21:07.925196+0000', 'modified': '2024-04-15T00:21:12.972118+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4272': {'gid': 4272, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6835/93464605', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6834', 'nonce': 93464605}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 93464605}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4272, 'qdb_cluster': [4272]} 2024-04-15T00:21:15.461 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-15T00:21:15.461 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-15T00:21:15.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.557+0000 7f14a4d1e640 1 Processor -- start 2024-04-15T00:21:15.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.558+0000 7f14a4d1e640 1 -- start start 2024-04-15T00:21:15.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.558+0000 7f14a4d1e640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f14a006dcf0 0x7f14a00b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.558+0000 7f14a4d1e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f14a0147ed0 0x7f14a0151f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.558+0000 7f14a4d1e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14a0147710 con 0x7f14a0141990 2024-04-15T00:21:15.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.558+0000 7f14a4d1e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f14a0147a40 con 0x7f14a0147ed0 2024-04-15T00:21:15.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.558+0000 7f14a4d1e640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f14a0141d70 con 0x7f14a006dcf0 2024-04-15T00:21:15.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.558+0000 7f149ed9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f14a0147ed0 0x7f14a0151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.558+0000 7f149e59c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f14a0141990 0x7f14a00742e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:36530/0 (socket says 172.21.15.31:36530) 2024-04-15T00:21:15.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.558+0000 7f149e59c640 1 -- 172.21.15.31:0/1904436285 learned_addr learned my addr 172.21.15.31:0/1904436285 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:15.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.558+0000 7f149ed9d640 1 --2- 172.21.15.31:0/1904436285 >> v2:172.21.15.31:3300/0 conn(0x7f14a0147ed0 0x7f14a0151f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49970/0 (socket says 172.21.15.31:49970) 2024-04-15T00:21:15.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.559+0000 7f1497fff640 1 --2- 172.21.15.31:0/1904436285 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f14a006dcf0 0x7f14a00b46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.559+0000 7f149ed9d640 1 -- 172.21.15.31:0/1904436285 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f14a006dcf0 msgr2=0x7f14a00b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:15.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.559+0000 7f149ed9d640 1 --2- 172.21.15.31:0/1904436285 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f14a006dcf0 0x7f14a00b46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.559+0000 7f149ed9d640 1 -- 172.21.15.31:0/1904436285 >> v1:172.21.15.31:6789/0 conn(0x7f14a0141990 legacy=0x7f14a00742e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:15.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.559+0000 7f149ed9d640 1 -- 172.21.15.31:0/1904436285 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14a00b4df0 con 0x7f14a0147ed0 2024-04-15T00:21:15.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.559+0000 7f149dd9b640 1 -- 172.21.15.31:0/1904436285 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 445705371 0 0) 0x7f14a0147710 con 0x7f14a0141990 2024-04-15T00:21:15.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.559+0000 7f149ed9d640 1 --2- 172.21.15.31:0/1904436285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14a0147ed0 0x7f14a0151f60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1498009d90 tx=0x7f149802be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c78016773688c086 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:15.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.559+0000 7f149dd9b640 1 -- 172.21.15.31:0/1904436285 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1498039070 con 0x7f14a0147ed0 2024-04-15T00:21:15.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.559+0000 7f149dd9b640 1 -- 172.21.15.31:0/1904436285 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f149802cbc0 con 0x7f14a0147ed0 2024-04-15T00:21:15.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.560+0000 7f149dd9b640 1 -- 172.21.15.31:0/1904436285 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1498034440 con 0x7f14a0147ed0 2024-04-15T00:21:15.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.560+0000 7f14a4d1e640 1 -- 172.21.15.31:0/1904436285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14a0147ed0 msgr2=0x7f14a0151f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:15.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.560+0000 7f14a4d1e640 1 --2- 172.21.15.31:0/1904436285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14a0147ed0 0x7f14a0151f60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1498009d90 tx=0x7f149802be10 comp rx=0 tx=0).stop 2024-04-15T00:21:15.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.560+0000 7f14a4d1e640 1 -- 172.21.15.31:0/1904436285 shutdown_connections 2024-04-15T00:21:15.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.560+0000 7f14a4d1e640 1 --2- 172.21.15.31:0/1904436285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14a0147ed0 0x7f14a0151f60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.560+0000 7f14a4d1e640 1 --2- 172.21.15.31:0/1904436285 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f14a006dcf0 0x7f14a00b46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.560+0000 7f14a4d1e640 1 -- 172.21.15.31:0/1904436285 >> 172.21.15.31:0/1904436285 conn(0x7f14a009b0f0 msgr2=0x7f14a009b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:15.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.560+0000 7f14a4d1e640 1 -- 172.21.15.31:0/1904436285 shutdown_connections 2024-04-15T00:21:15.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.560+0000 7f14a4d1e640 1 -- 172.21.15.31:0/1904436285 wait complete. 2024-04-15T00:21:15.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.561+0000 7f14a4d1e640 1 Processor -- start 2024-04-15T00:21:15.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.561+0000 7f14a4d1e640 1 -- start start 2024-04-15T00:21:15.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.562+0000 7f14a4d1e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14a0141990 0x7f14a0140eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.562+0000 7f14a4d1e640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f14a0147ed0 0x7f14a0072410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.562+0000 7f14a4d1e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14a0072950 0x7f14a01e0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.562+0000 7f14a4d1e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f14a01484e0 con 0x7f14a0141990 2024-04-15T00:21:15.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.562+0000 7f14a4d1e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f14a0148360 con 0x7f14a0072950 2024-04-15T00:21:15.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.562+0000 7f14a4d1e640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f14a01524a0 con 0x7f14a0147ed0 2024-04-15T00:21:15.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.562+0000 7f149e59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14a0141990 0x7f14a0140eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.562+0000 7f149e59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14a0141990 0x7f14a0140eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49974/0 (socket says 172.21.15.31:49974) 2024-04-15T00:21:15.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.562+0000 7f149e59c640 1 -- 172.21.15.31:0/1422322576 learned_addr learned my addr 172.21.15.31:0/1422322576 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:15.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.562+0000 7f1497fff640 1 --2- 172.21.15.31:0/1422322576 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f14a0147ed0 0x7f14a0072410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.562+0000 7f149ed9d640 1 --2- 172.21.15.31:0/1422322576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14a0072950 0x7f14a01e0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.562+0000 7f149e59c640 1 -- 172.21.15.31:0/1422322576 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f14a0147ed0 msgr2=0x7f14a0072410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:15.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.562+0000 7f149e59c640 1 --2- 172.21.15.31:0/1422322576 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f14a0147ed0 0x7f14a0072410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.562+0000 7f149e59c640 1 -- 172.21.15.31:0/1422322576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14a0072950 msgr2=0x7f14a01e0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:15.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.562+0000 7f149e59c640 1 --2- 172.21.15.31:0/1422322576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14a0072950 0x7f14a01e0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.562+0000 7f149e59c640 1 -- 172.21.15.31:0/1422322576 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14a013f230 con 0x7f14a0141990 2024-04-15T00:21:15.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.562+0000 7f149e59c640 1 --2- 172.21.15.31:0/1422322576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14a0141990 0x7f14a0140eb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f149000c4d0 tx=0x7f149000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:15.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.563+0000 7f1496ffd640 1 -- 172.21.15.31:0/1422322576 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1490018070 con 0x7f14a0141990 2024-04-15T00:21:15.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.563+0000 7f1496ffd640 1 -- 172.21.15.31:0/1422322576 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1490007500 con 0x7f14a0141990 2024-04-15T00:21:15.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.563+0000 7f14a4d1e640 1 -- 172.21.15.31:0/1422322576 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14a0071750 con 0x7f14a0141990 2024-04-15T00:21:15.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.563+0000 7f1496ffd640 1 -- 172.21.15.31:0/1422322576 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1490004a20 con 0x7f14a0141990 2024-04-15T00:21:15.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.563+0000 7f14a4d1e640 1 -- 172.21.15.31:0/1422322576 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14a014b9e0 con 0x7f14a0141990 2024-04-15T00:21:15.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.564+0000 7f1496ffd640 1 -- 172.21.15.31:0/1422322576 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f149001b070 con 0x7f14a0141990 2024-04-15T00:21:15.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.565+0000 7f1496ffd640 1 --2- 172.21.15.31:0/1422322576 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f148006b9c0 0x7f148006de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.565+0000 7f1497fff640 1 --2- 172.21.15.31:0/1422322576 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f148006b9c0 0x7f148006de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.565+0000 7f1496ffd640 1 -- 172.21.15.31:0/1422322576 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1490089d20 con 0x7f14a0141990 2024-04-15T00:21:15.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.565+0000 7f1497fff640 1 --2- 172.21.15.31:0/1422322576 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f148006b9c0 0x7f148006de80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f14a0145400 tx=0x7f1488008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:15.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.566+0000 7f14a7bdd740 1 Processor -- start 2024-04-15T00:21:15.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.566+0000 7f14a7bdd740 1 -- start start 2024-04-15T00:21:15.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.566+0000 7f14a7bdd740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cec04d060 0x561cec07c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.566+0000 7f14a7bdd740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x561cec07cac0 0x561cec075520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.567+0000 7f14a7bdd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cec075a60 0x561cec075ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.567+0000 7f14a7bdd740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561cebfb1f80 con 0x561cec04d060 2024-04-15T00:21:15.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.567+0000 7f14a7bdd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561cebf5a9a0 con 0x561cec075a60 2024-04-15T00:21:15.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.567+0000 7f14a7bdd740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x561cebfadf30 con 0x561cec07cac0 2024-04-15T00:21:15.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.567+0000 7f149e59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cec04d060 0x561cec07c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.567+0000 7f149e59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cec04d060 0x561cec07c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49984/0 (socket says 172.21.15.31:49984) 2024-04-15T00:21:15.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.567+0000 7f149e59c640 1 -- 172.21.15.31:0/3740168999 learned_addr learned my addr 172.21.15.31:0/3740168999 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:15.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.567+0000 7f149ed9d640 1 --2- 172.21.15.31:0/3740168999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cec075a60 0x561cec075ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.567+0000 7f1497fff640 1 --2- 172.21.15.31:0/3740168999 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x561cec07cac0 0x561cec075520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.567+0000 7f149e59c640 1 -- 172.21.15.31:0/3740168999 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x561cec07cac0 msgr2=0x561cec075520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:15.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.567+0000 7f149e59c640 1 --2- 172.21.15.31:0/3740168999 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x561cec07cac0 0x561cec075520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.567+0000 7f149e59c640 1 -- 172.21.15.31:0/3740168999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cec075a60 msgr2=0x561cec075ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:15.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.567+0000 7f149e59c640 1 --2- 172.21.15.31:0/3740168999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cec075a60 0x561cec075ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.567+0000 7f149e59c640 1 -- 172.21.15.31:0/3740168999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cebf7b480 con 0x561cec04d060 2024-04-15T00:21:15.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.567+0000 7f149e59c640 1 --2- 172.21.15.31:0/3740168999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cec04d060 0x561cec07c580 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1490087f40 tx=0x7f1490054350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9126ba62c694ea0d server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:15.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.567+0000 7f147ffff640 1 -- 172.21.15.31:0/3740168999 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1490060900 con 0x561cec04d060 2024-04-15T00:21:15.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.567+0000 7f147ffff640 1 -- 172.21.15.31:0/3740168999 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1490056330 con 0x561cec04d060 2024-04-15T00:21:15.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.567+0000 7f147ffff640 1 -- 172.21.15.31:0/3740168999 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1490004bc0 con 0x561cec04d060 2024-04-15T00:21:15.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.568+0000 7f14a7bdd740 1 -- 172.21.15.31:0/3740168999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cec04d060 msgr2=0x561cec07c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:15.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.568+0000 7f14a7bdd740 1 --2- 172.21.15.31:0/3740168999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cec04d060 0x561cec07c580 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1490087f40 tx=0x7f1490054350 comp rx=0 tx=0).stop 2024-04-15T00:21:15.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.568+0000 7f14a7bdd740 1 -- 172.21.15.31:0/3740168999 shutdown_connections 2024-04-15T00:21:15.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.568+0000 7f14a7bdd740 1 --2- 172.21.15.31:0/3740168999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cec075a60 0x561cec075ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.568+0000 7f14a7bdd740 1 --2- 172.21.15.31:0/3740168999 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x561cec07cac0 0x561cec075520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.568+0000 7f14a7bdd740 1 --2- 172.21.15.31:0/3740168999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cec04d060 0x561cec07c580 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.568+0000 7f14a7bdd740 1 -- 172.21.15.31:0/3740168999 >> 172.21.15.31:0/3740168999 conn(0x561cec04a630 msgr2=0x561cec04c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:15.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.568+0000 7f14a7bdd740 1 -- 172.21.15.31:0/3740168999 shutdown_connections 2024-04-15T00:21:15.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.568+0000 7f14a7bdd740 1 -- 172.21.15.31:0/3740168999 wait complete. 2024-04-15T00:21:15.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.569+0000 7f14a7bdd740 1 -- start start 2024-04-15T00:21:15.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.569+0000 7f14a7bdd740 1 Processor -- start 2024-04-15T00:21:15.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.569+0000 7f14a7bdd740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x561cec075a60 0x561cec0715a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.569+0000 7f14a7bdd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cec07cac0 0x561cec08ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.569+0000 7f14a7bdd740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cec06f580 0x561cec08d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.569+0000 7f14a7bdd740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561cec07bdf0 con 0x561cec06f580 2024-04-15T00:21:15.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.569+0000 7f14a7bdd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561cebf6df40 con 0x561cec07cac0 2024-04-15T00:21:15.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.569+0000 7f14a7bdd740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x561cec07cf20 con 0x561cec075a60 2024-04-15T00:21:15.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.569+0000 7f14a7bdd740 10 client.0 _ll_register_callbacks cb 0x561cebf689a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-15T00:21:15.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.570+0000 7f149ed9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cec06f580 0x561cec08d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.570+0000 7f149ed9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cec06f580 0x561cec08d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49986/0 (socket says 172.21.15.31:49986) 2024-04-15T00:21:15.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.570+0000 7f149ed9d640 1 -- 172.21.15.31:0/2618190755 learned_addr learned my addr 172.21.15.31:0/2618190755 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:15.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.570+0000 7f149e59c640 1 --2- 172.21.15.31:0/2618190755 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x561cec075a60 0x561cec0715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.570+0000 7f1497fff640 1 --2- 172.21.15.31:0/2618190755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cec07cac0 0x561cec08ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.570+0000 7f149ed9d640 1 -- 172.21.15.31:0/2618190755 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x561cec075a60 msgr2=0x561cec0715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:15.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.570+0000 7f149ed9d640 1 --2- 172.21.15.31:0/2618190755 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x561cec075a60 0x561cec0715a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.570+0000 7f149ed9d640 1 -- 172.21.15.31:0/2618190755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cec07cac0 msgr2=0x561cec08ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:15.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.570+0000 7f149ed9d640 1 --2- 172.21.15.31:0/2618190755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cec07cac0 0x561cec08ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.570+0000 7f149ed9d640 1 -- 172.21.15.31:0/2618190755 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cebcc62d0 con 0x561cec06f580 2024-04-15T00:21:15.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.570+0000 7f149ed9d640 1 --2- 172.21.15.31:0/2618190755 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cec06f580 0x561cec08d3a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1498037040 tx=0x7f1498004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=258598f335e33907 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:15.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.570+0000 7f147d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-04-15T00:21:15.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.570+0000 7f147d7fa640 1 -- 172.21.15.31:0/2618190755 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1498039040 con 0x561cec06f580 2024-04-15T00:21:15.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.570+0000 7f147d7fa640 1 -- 172.21.15.31:0/2618190755 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1498034bc0 con 0x561cec06f580 2024-04-15T00:21:15.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.570+0000 7f14a7bdd740 1 -- 172.21.15.31:0/2618190755 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1490056330 con 0x561cec06f580 2024-04-15T00:21:15.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.570+0000 7f147d7fa640 1 -- 172.21.15.31:0/2618190755 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f1498053050 con 0x561cec06f580 2024-04-15T00:21:15.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.570+0000 7f14a7bdd740 10 client.4419 fetch_fsmap learned FSMap version 6 2024-04-15T00:21:15.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.570+0000 7f14a7bdd740 1 -- 172.21.15.31:0/2618190755 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x561cebd906b0 con 0x561cec06f580 2024-04-15T00:21:15.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.570+0000 7f147d7fa640 1 -- 172.21.15.31:0/2618190755 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1490056330 con 0x561cec06f580 2024-04-15T00:21:15.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.571+0000 7f147d7fa640 1 -- 172.21.15.31:0/2618190755 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 6) ==== 2292+0+0 (secure 0 0 0) 0x7f1498056020 con 0x561cec06f580 2024-04-15T00:21:15.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.571+0000 7f14a7bdd740 10 client.4419 fetch_fsmap finished waiting for FSMap version 6 2024-04-15T00:21:15.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.571+0000 7f14a7bdd740 10 client.4419 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-15T00:21:15.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.571+0000 7f14a7bdd740 20 client.4419 populate_metadata read hostname 'smithi031' 2024-04-15T00:21:15.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.571+0000 7f14a7bdd740 1 --2- 172.21.15.31:0/2618190755 >> [v2:172.21.15.31:6834/93464605,v1:172.21.15.31:6835/93464605] conn(0x561cec099a10 0x561cec09be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.571+0000 7f14a7bdd740 4 client.4419 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-15T00:21:15.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.571+0000 7f14a7bdd740 1 -- 172.21.15.31:0/2618190755 --> [v2:172.21.15.31:6834/93464605,v1:172.21.15.31:6835/93464605] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561cebfbf4c0 con 0x561cec099a10 2024-04-15T00:21:15.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.571+0000 7f149e59c640 1 --2- 172.21.15.31:0/2618190755 >> [v2:172.21.15.31:6834/93464605,v1:172.21.15.31:6835/93464605] conn(0x561cec099a10 0x561cec09be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.571+0000 7f147d7fa640 10 client.4419 ms_handle_connect on v2:172.21.15.31:6834/93464605 2024-04-15T00:21:15.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.571+0000 7f149e59c640 1 --2- 172.21.15.31:0/2618190755 >> [v2:172.21.15.31:6834/93464605,v1:172.21.15.31:6835/93464605] conn(0x561cec099a10 0x561cec09be00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3034cc0d73ae9926 server_cookie=13f197bbe47b6674 in_seq=0 out_seq=0 2024-04-15T00:21:15.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.572+0000 7f147d7fa640 1 -- 172.21.15.31:0/2618190755 <== mds.0 v2:172.21.15.31:6834/93464605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561cebfbf4c0 con 0x561cec099a10 2024-04-15T00:21:15.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.572+0000 7f147d7fa640 10 client.4419 handle_command_reply: tid=0 2024-04-15T00:21:15.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.572+0000 7f14a7bdd740 1 client.4419 shutdown 2024-04-15T00:21:15.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.572+0000 7f14a7bdd740 1 -- 172.21.15.31:0/2618190755 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cec06f580 msgr2=0x561cec08d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:15.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.572+0000 7f14a7bdd740 1 --2- 172.21.15.31:0/2618190755 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cec06f580 0x561cec08d3a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1498037040 tx=0x7f1498004ab0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.572+0000 7f14a7bdd740 1 -- 172.21.15.31:0/2618190755 shutdown_connections 2024-04-15T00:21:15.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.572+0000 7f14a7bdd740 1 --2- 172.21.15.31:0/2618190755 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cec06f580 0x561cec08d3a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.572+0000 7f14a7bdd740 1 --2- 172.21.15.31:0/2618190755 >> [v2:172.21.15.31:6834/93464605,v1:172.21.15.31:6835/93464605] conn(0x561cec099a10 0x561cec09be00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.572+0000 7f14a7bdd740 1 --2- 172.21.15.31:0/2618190755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cec07cac0 0x561cec08ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.572+0000 7f14a7bdd740 1 --2- 172.21.15.31:0/2618190755 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x561cec075a60 0x561cec0715a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.572+0000 7f147d7fa640 0 client.4419 ms_handle_reset on v2:172.21.15.31:6834/93464605 2024-04-15T00:21:15.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.572+0000 7f14a7bdd740 1 -- 172.21.15.31:0/2618190755 >> 172.21.15.31:0/2618190755 conn(0x561cec04d060 msgr2=0x561cec047680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:15.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.572+0000 7f14a7bdd740 1 -- 172.21.15.31:0/2618190755 shutdown_connections 2024-04-15T00:21:15.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.572+0000 7f14a7bdd740 1 -- 172.21.15.31:0/2618190755 wait complete. 2024-04-15T00:21:15.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.572+0000 7f14a7bdd740 20 client.4419 trim_cache size 0 max 16384 2024-04-15T00:21:15.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.591+0000 7f14a7bdd740 1 Processor -- start 2024-04-15T00:21:15.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.591+0000 7f14a7bdd740 1 -- start start 2024-04-15T00:21:15.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.592+0000 7f14a7bdd740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cec06f580 0x561cec04c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.592+0000 7f14a7bdd740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x561cec075a60 0x561cec08ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.592+0000 7f14a7bdd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cec07cac0 0x561cec095e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.592+0000 7f14a7bdd740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f14a01eafa0 con 0x561cec06f580 2024-04-15T00:21:15.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.592+0000 7f14a7bdd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f14a01ea0c0 con 0x561cec07cac0 2024-04-15T00:21:15.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.592+0000 7f14a7bdd740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x561cec071c40 con 0x561cec075a60 2024-04-15T00:21:15.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.592+0000 7f149e59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cec06f580 0x561cec04c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.592+0000 7f149e59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cec06f580 0x561cec04c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49994/0 (socket says 172.21.15.31:49994) 2024-04-15T00:21:15.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.592+0000 7f149e59c640 1 -- 172.21.15.31:0/3148641319 learned_addr learned my addr 172.21.15.31:0/3148641319 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:15.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.592+0000 7f149e59c640 1 -- 172.21.15.31:0/3148641319 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x561cec075a60 msgr2=0x561cec08ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:15.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.592+0000 7f149e59c640 1 --2- 172.21.15.31:0/3148641319 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x561cec075a60 0x561cec08ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.592+0000 7f149e59c640 1 -- 172.21.15.31:0/3148641319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cec07cac0 msgr2=0x561cec095e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:15.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.592+0000 7f149e59c640 1 --2- 172.21.15.31:0/3148641319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cec07cac0 0x561cec095e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.592+0000 7f149e59c640 1 -- 172.21.15.31:0/3148641319 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cec0706c0 con 0x561cec06f580 2024-04-15T00:21:15.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.592+0000 7f149e59c640 1 --2- 172.21.15.31:0/3148641319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cec06f580 0x561cec04c5b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f149008a040 tx=0x7f149001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38413433a0907009 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:15.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.592+0000 7f147f7fe640 1 -- 172.21.15.31:0/3148641319 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14900542d0 con 0x561cec06f580 2024-04-15T00:21:15.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.592+0000 7f147f7fe640 1 -- 172.21.15.31:0/3148641319 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14900560d0 con 0x561cec06f580 2024-04-15T00:21:15.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.592+0000 7f147f7fe640 1 -- 172.21.15.31:0/3148641319 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14900546a0 con 0x561cec06f580 2024-04-15T00:21:15.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.593+0000 7f14a7bdd740 1 -- 172.21.15.31:0/3148641319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cec06f580 msgr2=0x561cec04c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:15.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.593+0000 7f14a7bdd740 1 --2- 172.21.15.31:0/3148641319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cec06f580 0x561cec04c5b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f149008a040 tx=0x7f149001e000 comp rx=0 tx=0).stop 2024-04-15T00:21:15.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.593+0000 7f14a7bdd740 1 -- 172.21.15.31:0/3148641319 shutdown_connections 2024-04-15T00:21:15.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.593+0000 7f14a7bdd740 1 --2- 172.21.15.31:0/3148641319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cec07cac0 0x561cec095e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.593+0000 7f14a7bdd740 1 --2- 172.21.15.31:0/3148641319 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x561cec075a60 0x561cec08ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.593+0000 7f14a7bdd740 1 --2- 172.21.15.31:0/3148641319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cec06f580 0x561cec04c5b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.593+0000 7f14a7bdd740 1 -- 172.21.15.31:0/3148641319 >> 172.21.15.31:0/3148641319 conn(0x561cec04d060 msgr2=0x561cec0713b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:15.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.593+0000 7f14a7bdd740 1 -- 172.21.15.31:0/3148641319 shutdown_connections 2024-04-15T00:21:15.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.593+0000 7f14a7bdd740 1 -- 172.21.15.31:0/3148641319 wait complete. 2024-04-15T00:21:15.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.593+0000 7f14a7bdd740 1 -- start start 2024-04-15T00:21:15.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.593+0000 7f14a7bdd740 1 Processor -- start 2024-04-15T00:21:15.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.594+0000 7f14a7bdd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cec06f580 0x561cec0a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.594+0000 7f14a7bdd740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cec075a60 0x561cec080160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.594+0000 7f14a7bdd740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x561cec07cac0 0x561cec04db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.594+0000 7f14a7bdd740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561cec071c40 con 0x561cec075a60 2024-04-15T00:21:15.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.594+0000 7f14a7bdd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561cec08c8c0 con 0x561cec06f580 2024-04-15T00:21:15.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.594+0000 7f14a7bdd740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x561cec0f6f20 con 0x561cec07cac0 2024-04-15T00:21:15.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.594+0000 7f14a7bdd740 10 client.0 _ll_register_callbacks cb 0x7f1498009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-15T00:21:15.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.594+0000 7f1497fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cec075a60 0x561cec080160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.594+0000 7f1497fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cec075a60 0x561cec080160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50000/0 (socket says 172.21.15.31:50000) 2024-04-15T00:21:15.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.594+0000 7f1497fff640 1 -- 172.21.15.31:0/113330078 learned_addr learned my addr 172.21.15.31:0/113330078 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:15.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.594+0000 7f149ed9d640 1 --2- 172.21.15.31:0/113330078 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x561cec07cac0 0x561cec04db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.594+0000 7f149e59c640 1 --2- 172.21.15.31:0/113330078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cec06f580 0x561cec0a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.595+0000 7f1497fff640 1 -- 172.21.15.31:0/113330078 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x561cec07cac0 msgr2=0x561cec04db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:15.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.595+0000 7f1497fff640 1 --2- 172.21.15.31:0/113330078 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x561cec07cac0 0x561cec04db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.595+0000 7f1497fff640 1 -- 172.21.15.31:0/113330078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cec06f580 msgr2=0x561cec0a0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:15.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.595+0000 7f1497fff640 1 --2- 172.21.15.31:0/113330078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cec06f580 0x561cec0a0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.595+0000 7f1497fff640 1 -- 172.21.15.31:0/113330078 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cec0a0020 con 0x561cec075a60 2024-04-15T00:21:15.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.595+0000 7f149ed9d640 1 --2- 172.21.15.31:0/113330078 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x561cec07cac0 0x561cec04db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:15.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.595+0000 7f149e59c640 1 --2- 172.21.15.31:0/113330078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cec06f580 0x561cec0a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:15.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.595+0000 7f1497fff640 1 --2- 172.21.15.31:0/113330078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cec075a60 0x561cec080160 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f148800fdf0 tx=0x7f14880039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b51e4487d7d42e49 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:15.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.595+0000 7f147d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-04-15T00:21:15.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.595+0000 7f147d7fa640 1 -- 172.21.15.31:0/113330078 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1488015860 con 0x561cec075a60 2024-04-15T00:21:15.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.595+0000 7f147d7fa640 1 -- 172.21.15.31:0/113330078 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1488015a00 con 0x561cec075a60 2024-04-15T00:21:15.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.595+0000 7f14a7bdd740 1 -- 172.21.15.31:0/113330078 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14900560d0 con 0x561cec075a60 2024-04-15T00:21:15.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.595+0000 7f147d7fa640 1 -- 172.21.15.31:0/113330078 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f1488031050 con 0x561cec075a60 2024-04-15T00:21:15.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.595+0000 7f14a7bdd740 10 client.4425 fetch_fsmap learned FSMap version 6 2024-04-15T00:21:15.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.595+0000 7f14a7bdd740 1 -- 172.21.15.31:0/113330078 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x561cec08cf50 con 0x561cec075a60 2024-04-15T00:21:15.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.595+0000 7f147d7fa640 1 -- 172.21.15.31:0/113330078 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14900560d0 con 0x561cec075a60 2024-04-15T00:21:15.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.595+0000 7f147d7fa640 1 -- 172.21.15.31:0/113330078 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 6) ==== 2292+0+0 (secure 0 0 0) 0x7f1488034020 con 0x561cec075a60 2024-04-15T00:21:15.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.595+0000 7f14a7bdd740 10 client.4425 fetch_fsmap finished waiting for FSMap version 6 2024-04-15T00:21:15.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.595+0000 7f14a7bdd740 10 client.4425 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-15T00:21:15.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.595+0000 7f14a7bdd740 20 client.4425 populate_metadata read hostname 'smithi031' 2024-04-15T00:21:15.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.595+0000 7f14a7bdd740 1 --2- 172.21.15.31:0/113330078 >> [v2:172.21.15.31:6834/93464605,v1:172.21.15.31:6835/93464605] conn(0x561cec073f60 0x561cec074340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.595+0000 7f14a7bdd740 4 client.4425 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-15T00:21:15.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.595+0000 7f14a7bdd740 1 -- 172.21.15.31:0/113330078 --> [v2:172.21.15.31:6834/93464605,v1:172.21.15.31:6835/93464605] -- command(tid 0: {"prefix": "status"}) -- 0x561cebfb9810 con 0x561cec073f60 2024-04-15T00:21:15.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.595+0000 7f149e59c640 1 --2- 172.21.15.31:0/113330078 >> [v2:172.21.15.31:6834/93464605,v1:172.21.15.31:6835/93464605] conn(0x561cec073f60 0x561cec074340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.596+0000 7f147d7fa640 10 client.4425 ms_handle_connect on v2:172.21.15.31:6834/93464605 2024-04-15T00:21:15.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.596+0000 7f149e59c640 1 --2- 172.21.15.31:0/113330078 >> [v2:172.21.15.31:6834/93464605,v1:172.21.15.31:6835/93464605] conn(0x561cec073f60 0x561cec074340 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d8be33f9fbad70e server_cookie=b08d94e5fc217ec6 in_seq=0 out_seq=0 2024-04-15T00:21:15.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.596+0000 7f147d7fa640 1 -- 172.21.15.31:0/113330078 <== mds.0 v2:172.21.15.31:6834/93464605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x561cebfb9810 con 0x561cec073f60 2024-04-15T00:21:15.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.596+0000 7f147d7fa640 10 client.4425 handle_command_reply: tid=0 2024-04-15T00:21:15.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.596+0000 7f14a7bdd740 1 client.4425 shutdown 2024-04-15T00:21:15.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.596+0000 7f14a7bdd740 1 -- 172.21.15.31:0/113330078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cec075a60 msgr2=0x561cec080160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:15.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.596+0000 7f14a7bdd740 1 --2- 172.21.15.31:0/113330078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cec075a60 0x561cec080160 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f148800fdf0 tx=0x7f14880039e0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.596+0000 7f14a7bdd740 1 -- 172.21.15.31:0/113330078 shutdown_connections 2024-04-15T00:21:15.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.596+0000 7f14a7bdd740 1 --2- 172.21.15.31:0/113330078 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x561cec07cac0 0x561cec04db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.596+0000 7f14a7bdd740 1 --2- 172.21.15.31:0/113330078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cec075a60 0x561cec080160 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.596+0000 7f14a7bdd740 1 --2- 172.21.15.31:0/113330078 >> [v2:172.21.15.31:6834/93464605,v1:172.21.15.31:6835/93464605] conn(0x561cec073f60 0x561cec074340 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.596+0000 7f14a7bdd740 1 --2- 172.21.15.31:0/113330078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561cec06f580 0x561cec0a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.596+0000 7f147d7fa640 0 client.4425 ms_handle_reset on v2:172.21.15.31:6834/93464605 2024-04-15T00:21:15.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.596+0000 7f14a7bdd740 1 -- 172.21.15.31:0/113330078 >> 172.21.15.31:0/113330078 conn(0x561cec04d060 msgr2=0x561cec04c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:15.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.596+0000 7f14a7bdd740 1 -- 172.21.15.31:0/113330078 shutdown_connections 2024-04-15T00:21:15.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.596+0000 7f14a7bdd740 1 -- 172.21.15.31:0/113330078 wait complete. 2024-04-15T00:21:15.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.596+0000 7f14a7bdd740 20 client.4425 trim_cache size 0 max 16384 2024-04-15T00:21:15.611 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-15T00:21:15.611 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "b57c03ab-2810-4ea5-b233-6164468328c0", 2024-04-15T00:21:15.611 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-04-15T00:21:15.611 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 4272, 2024-04-15T00:21:15.611 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-04-15T00:21:15.611 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-04-15T00:21:15.612 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-04-15T00:21:15.612 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 7.0225185699999999, 2024-04-15T00:21:15.612 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 6, 2024-04-15T00:21:15.612 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 25, 2024-04-15T00:21:15.612 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 24, 2024-04-15T00:21:15.612 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 13.659650637 2024-04-15T00:21:15.612 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-15T00:21:15.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.597+0000 7f14a4d1e640 1 -- 172.21.15.31:0/1422322576 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f148006b9c0 msgr2=0x7f148006de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:15.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.597+0000 7f14a4d1e640 1 --2- 172.21.15.31:0/1422322576 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f148006b9c0 0x7f148006de80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f14a0145400 tx=0x7f1488008040 comp rx=0 tx=0).stop 2024-04-15T00:21:15.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.597+0000 7f14a4d1e640 1 -- 172.21.15.31:0/1422322576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14a0141990 msgr2=0x7f14a0140eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:15.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.597+0000 7f14a4d1e640 1 --2- 172.21.15.31:0/1422322576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14a0141990 0x7f14a0140eb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f149000c4d0 tx=0x7f149000c990 comp rx=0 tx=0).stop 2024-04-15T00:21:15.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.597+0000 7f14a4d1e640 1 -- 172.21.15.31:0/1422322576 shutdown_connections 2024-04-15T00:21:15.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.597+0000 7f14a4d1e640 1 --2- 172.21.15.31:0/1422322576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14a0072950 0x7f14a01e0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.597+0000 7f14a4d1e640 1 --2- 172.21.15.31:0/1422322576 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f148006b9c0 0x7f148006de80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.597+0000 7f14a4d1e640 1 --2- 172.21.15.31:0/1422322576 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f14a0147ed0 0x7f14a0072410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.597+0000 7f14a4d1e640 1 --2- 172.21.15.31:0/1422322576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14a0141990 0x7f14a0140eb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.597+0000 7f14a4d1e640 1 -- 172.21.15.31:0/1422322576 >> 172.21.15.31:0/1422322576 conn(0x7f14a009b0f0 msgr2=0x7f14a0146e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:15.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.597+0000 7f14a4d1e640 1 -- 172.21.15.31:0/1422322576 shutdown_connections 2024-04-15T00:21:15.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.597+0000 7f14a4d1e640 1 -- 172.21.15.31:0/1422322576 wait complete. 2024-04-15T00:21:15.615 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-15T00:21:15.615 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-15T00:21:15.615 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-15T00:21:15.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.710+0000 7f7347ade640 1 Processor -- start 2024-04-15T00:21:15.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.710+0000 7f7347ade640 1 -- start start 2024-04-15T00:21:15.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.711+0000 7f7347ade640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f73400b94f0 0x7f73400bb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.711+0000 7f7347ade640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f734014b870 0x7f73400b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.711+0000 7f7347ade640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73400b9fb0 con 0x7f73400b9bd0 2024-04-15T00:21:15.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.711+0000 7f7347ade640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f734014b3e0 con 0x7f734014b870 2024-04-15T00:21:15.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.711+0000 7f7347ade640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f734014ad90 con 0x7f73400b94f0 2024-04-15T00:21:15.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.711+0000 7f734607b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f734014b870 0x7f73400b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.711+0000 7f734607b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f734014b870 0x7f73400b8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50014/0 (socket says 172.21.15.31:50014) 2024-04-15T00:21:15.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.711+0000 7f734607b640 1 -- 172.21.15.31:0/476632595 learned_addr learned my addr 172.21.15.31:0/476632595 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:15.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.711+0000 7f7345079640 1 --2- 172.21.15.31:0/476632595 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f73400b94f0 0x7f73400bb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.712+0000 7f734607b640 1 -- 172.21.15.31:0/476632595 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f73400b94f0 msgr2=0x7f73400bb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:15.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.712+0000 7f734607b640 1 --2- 172.21.15.31:0/476632595 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f73400b94f0 0x7f73400bb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.712+0000 7f734607b640 1 -- 172.21.15.31:0/476632595 >> v1:172.21.15.50:6789/0 conn(0x7f73400b9bd0 legacy=0x7f7340147600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:15.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.712+0000 7f734607b640 1 -- 172.21.15.31:0/476632595 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734014b070 con 0x7f734014b870 2024-04-15T00:21:15.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.712+0000 7f734607b640 1 --2- 172.21.15.31:0/476632595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f734014b870 0x7f73400b8a60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7338009e50 tx=0x7f733802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83f61f7b17703df server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:15.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.712+0000 7f7344878640 1 -- 172.21.15.31:0/476632595 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733802c9e0 con 0x7f734014b870 2024-04-15T00:21:15.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.712+0000 7f7344878640 1 -- 172.21.15.31:0/476632595 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f733802cb80 con 0x7f734014b870 2024-04-15T00:21:15.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.712+0000 7f7344878640 1 -- 172.21.15.31:0/476632595 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73380343f0 con 0x7f734014b870 2024-04-15T00:21:15.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.713+0000 7f7347ade640 1 -- 172.21.15.31:0/476632595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f734014b870 msgr2=0x7f73400b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:15.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.713+0000 7f7347ade640 1 --2- 172.21.15.31:0/476632595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f734014b870 0x7f73400b8a60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7338009e50 tx=0x7f733802be40 comp rx=0 tx=0).stop 2024-04-15T00:21:15.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.713+0000 7f7347ade640 1 -- 172.21.15.31:0/476632595 shutdown_connections 2024-04-15T00:21:15.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.713+0000 7f7347ade640 1 --2- 172.21.15.31:0/476632595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f734014b870 0x7f73400b8a60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.713+0000 7f7347ade640 1 --2- 172.21.15.31:0/476632595 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f73400b94f0 0x7f73400bb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.713+0000 7f7347ade640 1 -- 172.21.15.31:0/476632595 >> 172.21.15.31:0/476632595 conn(0x7f734009ed70 msgr2=0x7f734009f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:15.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.713+0000 7f7347ade640 1 -- 172.21.15.31:0/476632595 shutdown_connections 2024-04-15T00:21:15.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.713+0000 7f7347ade640 1 -- 172.21.15.31:0/476632595 wait complete. 2024-04-15T00:21:15.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.714+0000 7f7347ade640 1 Processor -- start 2024-04-15T00:21:15.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.714+0000 7f7347ade640 1 -- start start 2024-04-15T00:21:15.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.715+0000 7f7347ade640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73400b94f0 0x7f734009d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.715+0000 7f7347ade640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f73400b9bd0 0x7f7340144170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.715+0000 7f7347ade640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f734014b870 0x7f73401429d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.715+0000 7f7347ade640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f73400b9120 con 0x7f734014b870 2024-04-15T00:21:15.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.715+0000 7f7347ade640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f73400b8fa0 con 0x7f73400b94f0 2024-04-15T00:21:15.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.715+0000 7f7347ade640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f73400b92a0 con 0x7f73400b9bd0 2024-04-15T00:21:15.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.715+0000 7f734607b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f734014b870 0x7f73401429d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.715+0000 7f734607b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f734014b870 0x7f73401429d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50024/0 (socket says 172.21.15.31:50024) 2024-04-15T00:21:15.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.715+0000 7f734607b640 1 -- 172.21.15.31:0/1483397087 learned_addr learned my addr 172.21.15.31:0/1483397087 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:15.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.715+0000 7f734587a640 1 --2- 172.21.15.31:0/1483397087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73400b94f0 0x7f734009d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.715+0000 7f7345079640 1 --2- 172.21.15.31:0/1483397087 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f73400b9bd0 0x7f7340144170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.715+0000 7f734607b640 1 -- 172.21.15.31:0/1483397087 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f73400b9bd0 msgr2=0x7f7340144170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:15.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.715+0000 7f734607b640 1 --2- 172.21.15.31:0/1483397087 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f73400b9bd0 0x7f7340144170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.715+0000 7f734607b640 1 -- 172.21.15.31:0/1483397087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73400b94f0 msgr2=0x7f734009d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:15.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.715+0000 7f734607b640 1 --2- 172.21.15.31:0/1483397087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73400b94f0 0x7f734009d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.715+0000 7f734607b640 1 -- 172.21.15.31:0/1483397087 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7340145200 con 0x7f734014b870 2024-04-15T00:21:15.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.715+0000 7f7345079640 1 --2- 172.21.15.31:0/1483397087 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f73400b9bd0 0x7f7340144170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:15.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.715+0000 7f734607b640 1 --2- 172.21.15.31:0/1483397087 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f734014b870 0x7f73401429d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7338036040 tx=0x7f7338004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:15.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.715+0000 7f73367fc640 1 -- 172.21.15.31:0/1483397087 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7338043020 con 0x7f734014b870 2024-04-15T00:21:15.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.715+0000 7f73367fc640 1 -- 172.21.15.31:0/1483397087 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f733803e450 con 0x7f734014b870 2024-04-15T00:21:15.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.715+0000 7f7347ade640 1 -- 172.21.15.31:0/1483397087 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73401ddab0 con 0x7f734014b870 2024-04-15T00:21:15.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.715+0000 7f73367fc640 1 -- 172.21.15.31:0/1483397087 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7338009510 con 0x7f734014b870 2024-04-15T00:21:15.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.715+0000 7f7347ade640 1 -- 172.21.15.31:0/1483397087 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73400a0340 con 0x7f734014b870 2024-04-15T00:21:15.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.716+0000 7f7347ade640 1 -- 172.21.15.31:0/1483397087 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7340147d60 con 0x7f734014b870 2024-04-15T00:21:15.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.717+0000 7f73367fc640 1 -- 172.21.15.31:0/1483397087 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f7338046020 con 0x7f734014b870 2024-04-15T00:21:15.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.717+0000 7f73367fc640 1 --2- 172.21.15.31:0/1483397087 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f732406b990 0x7f732406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:15.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.717+0000 7f73367fc640 1 -- 172.21.15.31:0/1483397087 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f73380ad200 con 0x7f734014b870 2024-04-15T00:21:15.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.717+0000 7f734587a640 1 --2- 172.21.15.31:0/1483397087 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f732406b990 0x7f732406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:15.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.718+0000 7f734587a640 1 --2- 172.21.15.31:0/1483397087 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f732406b990 0x7f732406de50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f733c001780 tx=0x7f733c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:15.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.721+0000 7f73367fc640 1 -- 172.21.15.31:0/1483397087 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7340147d60 con 0x7f734014b870 2024-04-15T00:21:15.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.939+0000 7f7347ade640 1 -- 172.21.15.31:0/1483397087 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7340148af0 con 0x7f734014b870 2024-04-15T00:21:15.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.939+0000 7f73367fc640 1 -- 172.21.15.31:0/1483397087 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7f733804d030 con 0x7f734014b870 2024-04-15T00:21:15.947 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-15T00:21:15.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.941+0000 7f7347ade640 1 -- 172.21.15.31:0/1483397087 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f732406b990 msgr2=0x7f732406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:15.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.941+0000 7f7347ade640 1 --2- 172.21.15.31:0/1483397087 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f732406b990 0x7f732406de50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f733c001780 tx=0x7f733c009040 comp rx=0 tx=0).stop 2024-04-15T00:21:15.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.941+0000 7f7347ade640 1 -- 172.21.15.31:0/1483397087 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f734014b870 msgr2=0x7f73401429d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:15.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.941+0000 7f7347ade640 1 --2- 172.21.15.31:0/1483397087 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f734014b870 0x7f73401429d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7338036040 tx=0x7f7338004a40 comp rx=0 tx=0).stop 2024-04-15T00:21:15.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.941+0000 7f7347ade640 1 -- 172.21.15.31:0/1483397087 shutdown_connections 2024-04-15T00:21:15.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.941+0000 7f7347ade640 1 --2- 172.21.15.31:0/1483397087 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f734014b870 0x7f73401429d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.941+0000 7f7347ade640 1 --2- 172.21.15.31:0/1483397087 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f732406b990 0x7f732406de50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.941+0000 7f7347ade640 1 --2- 172.21.15.31:0/1483397087 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f73400b9bd0 0x7f7340144170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.941+0000 7f7347ade640 1 --2- 172.21.15.31:0/1483397087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73400b94f0 0x7f734009d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:15.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.941+0000 7f7347ade640 1 -- 172.21.15.31:0/1483397087 >> 172.21.15.31:0/1483397087 conn(0x7f734009ed70 msgr2=0x7f7340072d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:15.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.941+0000 7f7347ade640 1 -- 172.21.15.31:0/1483397087 shutdown_connections 2024-04-15T00:21:15.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:15.941+0000 7f7347ade640 1 -- 172.21.15.31:0/1483397087 wait complete. 2024-04-15T00:21:15.959 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-15T00:21:15.959 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-15T00:21:15.959 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2024-04-15T00:21:15.959 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-15T00:21:15.959 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-15T00:21:15.959 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-15T00:21:15.959 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-15T00:21:15.960 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-15T00:21:15.960 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-15T00:21:15.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:21:15.960 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2024-04-15T00:21:15.975 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-15T00:21:15.975 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-15T00:21:15.975 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-04-15T00:21:15.975 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-04-15T00:21:15.975 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-04-15T00:21:15.975 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-04-15T00:21:15.975 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-15T00:21:15.975 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2024-04-15T00:21:15.975 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2024-04-15T00:21:15.975 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-15T00:21:15.975 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2024-04-15T00:21:15.975 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2024-04-15T00:21:15.976 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-15T00:21:15.976 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2024-04-15T00:21:15.976 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2024-04-15T00:21:15.976 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-15T00:21:15.976 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42669sec preferred_lft 42669sec 2024-04-15T00:21:15.976 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link noprefixroute 2024-04-15T00:21:15.976 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-04-15T00:21:15.976 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-15T00:21:15.976 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2024-04-15T00:21:15.976 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2024-04-15T00:21:15.977 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-15T00:21:15.977 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T00:21:15.977 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-04-15T00:21:15.977 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link add name ceph-brx type bridge 2024-04-15T00:21:15.977 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip addr flush dev ceph-brx 2024-04-15T00:21:15.977 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set ceph-brx up 2024-04-15T00:21:15.977 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-15T00:21:15.977 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-04-15T00:21:16.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T00:21:16.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T00:21:16.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:21:16.185 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-15T00:21:16.213 INFO:teuthology.orchestra.run.smithi031.stdout:1 2024-04-15T00:21:16.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:21:16.215 DEBUG:teuthology.orchestra.run.smithi031:> route 2024-04-15T00:21:16.281 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2024-04-15T00:21:16.281 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-15T00:21:16.281 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-15T00:21:16.281 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-15T00:21:16.281 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-15T00:21:16.281 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T00:21:16.281 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-04-15T00:21:16.281 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-15T00:21:16.282 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-15T00:21:16.282 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-15T00:21:16.282 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-04-15T00:21:16.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T00:21:16.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T00:21:16.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:21:16.596 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-04-15T00:21:16.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:21:16.613 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list-id 2024-04-15T00:21:16.667 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T00:21:16.667 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-04-15T00:21:16.667 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-15T00:21:16.667 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-15T00:21:16.667 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-04-15T00:21:16.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T00:21:16.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T00:21:16.789 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-15T00:21:16.789 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T00:21:16.789 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-04-15T00:21:16.789 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-15T00:21:16.789 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-15T00:21:16.789 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-15T00:21:16.789 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-15T00:21:16.789 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-15T00:21:16.790 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-04-15T00:21:16.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T00:21:16.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T00:21:16.923 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T00:21:16.923 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-04-15T00:21:16.923 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2024-04-15T00:21:16.923 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set dev brx.0 master ceph-brx 2024-04-15T00:21:16.924 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-04-15T00:21:16.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T00:21:16.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T00:21:17.004 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-15T00:21:17.004 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T00:21:17.005 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-15T00:21:17.018 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-15T00:21:17.019 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T00:21:17.019 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-15T00:21:17.073 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2024-04-15T00:21:17.140 DEBUG:teuthology.orchestra.run.smithi031:> cat /proc/self/mounts | awk '{print $2}' 2024-04-15T00:21:17.195 INFO:teuthology.orchestra.run.smithi031.stdout:/proc 2024-04-15T00:21:17.195 INFO:teuthology.orchestra.run.smithi031.stdout:/sys 2024-04-15T00:21:17.195 INFO:teuthology.orchestra.run.smithi031.stdout:/dev 2024-04-15T00:21:17.195 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/security 2024-04-15T00:21:17.195 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/shm 2024-04-15T00:21:17.195 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/pts 2024-04-15T00:21:17.195 INFO:teuthology.orchestra.run.smithi031.stdout:/run 2024-04-15T00:21:17.195 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/cgroup 2024-04-15T00:21:17.196 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/pstore 2024-04-15T00:21:17.196 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/bpf 2024-04-15T00:21:17.196 INFO:teuthology.orchestra.run.smithi031.stdout:/ 2024-04-15T00:21:17.196 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/selinux 2024-04-15T00:21:17.196 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T00:21:17.196 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/hugepages 2024-04-15T00:21:17.196 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/mqueue 2024-04-15T00:21:17.196 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/debug 2024-04-15T00:21:17.196 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/tracing 2024-04-15T00:21:17.196 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/fuse/connections 2024-04-15T00:21:17.196 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/config 2024-04-15T00:21:17.196 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-sysctl.service 2024-04-15T00:21:17.196 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-15T00:21:17.196 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-15T00:21:17.197 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/nfs/rpc_pipefs 2024-04-15T00:21:17.197 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/1000 2024-04-15T00:21:17.197 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph 2024-04-15T00:21:17.197 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-0 2024-04-15T00:21:17.197 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-1 2024-04-15T00:21:17.197 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-2 2024-04-15T00:21:17.197 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-3 2024-04-15T00:21:17.197 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns 2024-04-15T00:21:17.197 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-15T00:21:17.197 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-15T00:21:17.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:21:17.197 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2024-04-15T00:21:17.249 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-15T00:21:17.249 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-15T00:21:17.292 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2024-04-15T00:21:17.318 DEBUG:teuthology.orchestra.run.smithi031:> cat /proc/self/mounts | awk '{print $2}' 2024-04-15T00:21:17.373 INFO:teuthology.orchestra.run.smithi031.stdout:/proc 2024-04-15T00:21:17.373 INFO:teuthology.orchestra.run.smithi031.stdout:/sys 2024-04-15T00:21:17.373 INFO:teuthology.orchestra.run.smithi031.stdout:/dev 2024-04-15T00:21:17.373 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/security 2024-04-15T00:21:17.374 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/shm 2024-04-15T00:21:17.374 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/pts 2024-04-15T00:21:17.374 INFO:teuthology.orchestra.run.smithi031.stdout:/run 2024-04-15T00:21:17.374 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/cgroup 2024-04-15T00:21:17.374 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/pstore 2024-04-15T00:21:17.374 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/bpf 2024-04-15T00:21:17.374 INFO:teuthology.orchestra.run.smithi031.stdout:/ 2024-04-15T00:21:17.374 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/selinux 2024-04-15T00:21:17.374 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T00:21:17.374 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/hugepages 2024-04-15T00:21:17.374 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/mqueue 2024-04-15T00:21:17.374 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/debug 2024-04-15T00:21:17.374 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/tracing 2024-04-15T00:21:17.375 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/fuse/connections 2024-04-15T00:21:17.375 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/config 2024-04-15T00:21:17.375 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-sysctl.service 2024-04-15T00:21:17.375 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-15T00:21:17.375 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-15T00:21:17.375 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/nfs/rpc_pipefs 2024-04-15T00:21:17.375 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/1000 2024-04-15T00:21:17.375 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph 2024-04-15T00:21:17.375 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-0 2024-04-15T00:21:17.375 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-1 2024-04-15T00:21:17.375 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-2 2024-04-15T00:21:17.375 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-3 2024-04-15T00:21:17.375 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns 2024-04-15T00:21:17.375 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-15T00:21:17.375 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-15T00:21:17.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:21:17.376 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2024-04-15T00:21:17.378 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi031.stderr:2024-04-15T00:21:17.371+0000 7fde5286d480 -1 init, newargv = 0x5582e98a0a20 newargc=15 2024-04-15T00:21:17.378 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi031.stderr:ceph-fuse[44556]: starting ceph client 2024-04-15T00:21:17.384 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi031.stderr:ceph-fuse[44556]: starting fuse 2024-04-15T00:21:17.393 INFO:teuthology.orchestra.run.smithi031.stdout:42 2024-04-15T00:21:17.393 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-04-15T00:21:17.393 DEBUG:teuthology.orchestra.run.smithi031:> sudo stdin-killer -- python3 -c ' 2024-04-15T00:21:17.393 DEBUG:teuthology.orchestra.run.smithi031:> import glob 2024-04-15T00:21:17.393 DEBUG:teuthology.orchestra.run.smithi031:> import re 2024-04-15T00:21:17.393 DEBUG:teuthology.orchestra.run.smithi031:> import os 2024-04-15T00:21:17.393 DEBUG:teuthology.orchestra.run.smithi031:> import subprocess 2024-04-15T00:21:17.393 DEBUG:teuthology.orchestra.run.smithi031:> 2024-04-15T00:21:17.393 DEBUG:teuthology.orchestra.run.smithi031:> def _find_admin_socket(client_name): 2024-04-15T00:21:17.393 DEBUG:teuthology.orchestra.run.smithi031:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-15T00:21:17.394 DEBUG:teuthology.orchestra.run.smithi031:> files = glob.glob(asok_path) 2024-04-15T00:21:17.394 DEBUG:teuthology.orchestra.run.smithi031:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-15T00:21:17.394 DEBUG:teuthology.orchestra.run.smithi031:> 2024-04-15T00:21:17.394 DEBUG:teuthology.orchestra.run.smithi031:> # Given a non-glob path, it better be there 2024-04-15T00:21:17.394 DEBUG:teuthology.orchestra.run.smithi031:> if "*" not in asok_path: 2024-04-15T00:21:17.394 DEBUG:teuthology.orchestra.run.smithi031:> assert(len(files) == 1) 2024-04-15T00:21:17.394 DEBUG:teuthology.orchestra.run.smithi031:> return files[0] 2024-04-15T00:21:17.394 DEBUG:teuthology.orchestra.run.smithi031:> 2024-04-15T00:21:17.394 DEBUG:teuthology.orchestra.run.smithi031:> for f in files: 2024-04-15T00:21:17.394 DEBUG:teuthology.orchestra.run.smithi031:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-15T00:21:17.394 DEBUG:teuthology.orchestra.run.smithi031:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-15T00:21:17.394 DEBUG:teuthology.orchestra.run.smithi031:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-15T00:21:17.394 DEBUG:teuthology.orchestra.run.smithi031:> contents = proc_f.read() 2024-04-15T00:21:17.394 DEBUG:teuthology.orchestra.run.smithi031:> if mountpoint in contents: 2024-04-15T00:21:17.394 DEBUG:teuthology.orchestra.run.smithi031:> return f 2024-04-15T00:21:17.394 DEBUG:teuthology.orchestra.run.smithi031:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-15T00:21:17.394 DEBUG:teuthology.orchestra.run.smithi031:> 2024-04-15T00:21:17.395 DEBUG:teuthology.orchestra.run.smithi031:> print(_find_admin_socket("client.admin")) 2024-04-15T00:21:17.395 DEBUG:teuthology.orchestra.run.smithi031:> ' 2024-04-15T00:21:17.514 INFO:teuthology.orchestra.run.smithi031.stdout:/var/run/ceph/ceph-client.admin.44556.asok 2024-04-15T00:21:17.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T00:21:17.524 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.44556.asok 2024-04-15T00:21:17.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:21:17.524 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.44556.asok status 2024-04-15T00:21:17.663 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-15T00:21:17.663 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": { 2024-04-15T00:21:17.663 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_sha1": "a9a752df26c63acad72e1b3569fd79a515ca0765", 2024-04-15T00:21:17.663 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_version": "ceph version 19.0.0-2114-ga9a752df (a9a752df26c63acad72e1b3569fd79a515ca0765) squid (dev)", 2024-04-15T00:21:17.664 INFO:teuthology.orchestra.run.smithi031.stdout: "entity_id": "admin", 2024-04-15T00:21:17.664 INFO:teuthology.orchestra.run.smithi031.stdout: "hostname": "smithi031", 2024-04-15T00:21:17.664 INFO:teuthology.orchestra.run.smithi031.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-15T00:21:17.664 INFO:teuthology.orchestra.run.smithi031.stdout: "pid": "44556", 2024-04-15T00:21:17.664 INFO:teuthology.orchestra.run.smithi031.stdout: "root": "/" 2024-04-15T00:21:17.664 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:21:17.664 INFO:teuthology.orchestra.run.smithi031.stdout: "dentry_count": 0, 2024-04-15T00:21:17.664 INFO:teuthology.orchestra.run.smithi031.stdout: "dentry_pinned_count": 0, 2024-04-15T00:21:17.664 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 4440, 2024-04-15T00:21:17.664 INFO:teuthology.orchestra.run.smithi031.stdout: "inst": { 2024-04-15T00:21:17.664 INFO:teuthology.orchestra.run.smithi031.stdout: "name": { 2024-04-15T00:21:17.664 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "client", 2024-04-15T00:21:17.665 INFO:teuthology.orchestra.run.smithi031.stdout: "num": 4440 2024-04-15T00:21:17.665 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:21:17.665 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": { 2024-04-15T00:21:17.665 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-04-15T00:21:17.665 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "192.168.0.1:0", 2024-04-15T00:21:17.665 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 3103374828 2024-04-15T00:21:17.665 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:21:17.665 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:21:17.665 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": { 2024-04-15T00:21:17.665 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-04-15T00:21:17.665 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "192.168.0.1:0", 2024-04-15T00:21:17.665 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 3103374828 2024-04-15T00:21:17.665 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:21:17.665 INFO:teuthology.orchestra.run.smithi031.stdout: "inst_str": "client.4440 192.168.0.1:0/3103374828", 2024-04-15T00:21:17.666 INFO:teuthology.orchestra.run.smithi031.stdout: "addr_str": "192.168.0.1:0/3103374828", 2024-04-15T00:21:17.666 INFO:teuthology.orchestra.run.smithi031.stdout: "inode_count": 1, 2024-04-15T00:21:17.666 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_epoch": 6, 2024-04-15T00:21:17.666 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_epoch": 25, 2024-04-15T00:21:17.666 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_epoch_barrier": 0, 2024-04-15T00:21:17.666 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklisted": false, 2024-04-15T00:21:17.666 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs" 2024-04-15T00:21:17.666 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-15T00:21:17.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:21:17.671 DEBUG:teuthology.orchestra.run.smithi031:> stat --file-system '--printf=%T 2024-04-15T00:21:17.671 DEBUG:teuthology.orchestra.run.smithi031:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-15T00:21:17.686 INFO:teuthology.orchestra.run.smithi031.stdout:fuseblk 2024-04-15T00:21:17.686 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-15T00:21:17.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:21:17.686 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-15T00:21:17.754 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-15T00:21:17.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-15T00:21:17.858 INFO:teuthology.orchestra.run.smithi031.stdout:# file: . 2024-04-15T00:21:17.858 INFO:teuthology.orchestra.run.smithi031.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-15T00:21:17.858 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:21:17.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T00:21:17.864 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-15T00:21:17.864 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T00:21:17.879 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:21:18.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.013+0000 7ffad9faa640 1 Processor -- start 2024-04-15T00:21:18.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.013+0000 7ffad9faa640 1 -- start start 2024-04-15T00:21:18.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.013+0000 7ffad9faa640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffad40baef0 0x7ffad4147670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:18.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.013+0000 7ffad9faa640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ffad40b8bf0 0x7ffad4151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:18.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.013+0000 7ffad9faa640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffad40bb2d0 con 0x7ffad414b8e0 2024-04-15T00:21:18.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.013+0000 7ffad9faa640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7ffad4147bb0 con 0x7ffad40b8bf0 2024-04-15T00:21:18.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.013+0000 7ffad9faa640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7ffad414ae00 con 0x7ffad40baef0 2024-04-15T00:21:18.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.013+0000 7ffad3fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ffad40b8bf0 0x7ffad4151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:18.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.013+0000 7ffad3fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ffad40b8bf0 0x7ffad4151ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50036/0 (socket says 172.21.15.31:50036) 2024-04-15T00:21:18.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.013+0000 7ffad3fff640 1 -- 172.21.15.31:0/234304830 learned_addr learned my addr 172.21.15.31:0/234304830 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:18.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.014+0000 7ffad37fe640 1 --2- 172.21.15.31:0/234304830 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffad40baef0 0x7ffad4147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:18.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.014+0000 7ffad3fff640 1 -- 172.21.15.31:0/234304830 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffad40baef0 msgr2=0x7ffad4147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:18.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.014+0000 7ffad3fff640 1 --2- 172.21.15.31:0/234304830 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffad40baef0 0x7ffad4147670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.014+0000 7ffad3fff640 1 -- 172.21.15.31:0/234304830 >> v1:172.21.15.50:6789/0 conn(0x7ffad414b8e0 legacy=0x7ffad40b9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:18.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.014+0000 7ffad3fff640 1 -- 172.21.15.31:0/234304830 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad414b0e0 con 0x7ffad40b8bf0 2024-04-15T00:21:18.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.014+0000 7ffad3fff640 1 --2- 172.21.15.31:0/234304830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffad40b8bf0 0x7ffad4151ff0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffacc009e50 tx=0x7ffacc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f54b5dd878ea4f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:18.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.015+0000 7ffad27fc640 1 -- 172.21.15.31:0/234304830 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffacc02ca70 con 0x7ffad40b8bf0 2024-04-15T00:21:18.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.015+0000 7ffad27fc640 1 -- 172.21.15.31:0/234304830 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffacc02cc10 con 0x7ffad40b8bf0 2024-04-15T00:21:18.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.015+0000 7ffad27fc640 1 -- 172.21.15.31:0/234304830 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffacc0343f0 con 0x7ffad40b8bf0 2024-04-15T00:21:18.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.015+0000 7ffad9faa640 1 -- 172.21.15.31:0/234304830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffad40b8bf0 msgr2=0x7ffad4151ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:18.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.015+0000 7ffad9faa640 1 --2- 172.21.15.31:0/234304830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffad40b8bf0 0x7ffad4151ff0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffacc009e50 tx=0x7ffacc02bed0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.015+0000 7ffad9faa640 1 -- 172.21.15.31:0/234304830 shutdown_connections 2024-04-15T00:21:18.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.015+0000 7ffad9faa640 1 --2- 172.21.15.31:0/234304830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffad40b8bf0 0x7ffad4151ff0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.015+0000 7ffad9faa640 1 --2- 172.21.15.31:0/234304830 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffad40baef0 0x7ffad4147670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.015+0000 7ffad9faa640 1 -- 172.21.15.31:0/234304830 >> 172.21.15.31:0/234304830 conn(0x7ffad409ed70 msgr2=0x7ffad409f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:18.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.015+0000 7ffad9faa640 1 -- 172.21.15.31:0/234304830 shutdown_connections 2024-04-15T00:21:18.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.015+0000 7ffad9faa640 1 -- 172.21.15.31:0/234304830 wait complete. 2024-04-15T00:21:18.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.016+0000 7ffad9faa640 1 Processor -- start 2024-04-15T00:21:18.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.016+0000 7ffad9faa640 1 -- start start 2024-04-15T00:21:18.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.017+0000 7ffad9faa640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffad40b8bf0 0x7ffad4143cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:18.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.017+0000 7ffad9faa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffad40baef0 0x7ffad41e0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:18.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.017+0000 7ffad9faa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffad414b8e0 0x7ffad41e0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:18.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.017+0000 7ffad9faa640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ffad40b91e0 con 0x7ffad414b8e0 2024-04-15T00:21:18.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.017+0000 7ffad9faa640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffad40b9060 con 0x7ffad40baef0 2024-04-15T00:21:18.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.017+0000 7ffad9faa640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7ffad40b9360 con 0x7ffad40b8bf0 2024-04-15T00:21:18.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.017+0000 7ffad3fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffad414b8e0 0x7ffad41e0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:18.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.017+0000 7ffad3fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffad414b8e0 0x7ffad41e0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50040/0 (socket says 172.21.15.31:50040) 2024-04-15T00:21:18.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.017+0000 7ffad3fff640 1 -- 172.21.15.31:0/2147310549 learned_addr learned my addr 172.21.15.31:0/2147310549 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:18.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.017+0000 7ffad37fe640 1 --2- 172.21.15.31:0/2147310549 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffad40b8bf0 0x7ffad4143cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:18.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.017+0000 7ffad2ffd640 1 --2- 172.21.15.31:0/2147310549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffad40baef0 0x7ffad41e0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:18.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.017+0000 7ffad3fff640 1 -- 172.21.15.31:0/2147310549 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffad40b8bf0 msgr2=0x7ffad4143cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:18.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.017+0000 7ffad3fff640 1 --2- 172.21.15.31:0/2147310549 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffad40b8bf0 0x7ffad4143cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.017+0000 7ffad3fff640 1 -- 172.21.15.31:0/2147310549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffad40baef0 msgr2=0x7ffad41e0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:18.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.017+0000 7ffad3fff640 1 --2- 172.21.15.31:0/2147310549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffad40baef0 0x7ffad41e0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.017+0000 7ffad3fff640 1 -- 172.21.15.31:0/2147310549 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad41d16c0 con 0x7ffad414b8e0 2024-04-15T00:21:18.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.017+0000 7ffad2ffd640 1 --2- 172.21.15.31:0/2147310549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffad40baef0 0x7ffad41e0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:21:18.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.017+0000 7ffad37fe640 1 --2- 172.21.15.31:0/2147310549 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffad40b8bf0 0x7ffad4143cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:21:18.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.018+0000 7ffad3fff640 1 --2- 172.21.15.31:0/2147310549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffad414b8e0 0x7ffad41e0b40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffacc009e50 tx=0x7ffacc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:18.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.018+0000 7ffabbfff640 1 -- 172.21.15.31:0/2147310549 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffacc043020 con 0x7ffad414b8e0 2024-04-15T00:21:18.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.018+0000 7ffabbfff640 1 -- 172.21.15.31:0/2147310549 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffacc03e450 con 0x7ffad414b8e0 2024-04-15T00:21:18.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.018+0000 7ffabbfff640 1 -- 172.21.15.31:0/2147310549 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffacc009510 con 0x7ffad414b8e0 2024-04-15T00:21:18.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.018+0000 7ffad9faa640 1 -- 172.21.15.31:0/2147310549 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffad41d19a0 con 0x7ffad414b8e0 2024-04-15T00:21:18.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.018+0000 7ffad9faa640 1 -- 172.21.15.31:0/2147310549 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffad40a2660 con 0x7ffad414b8e0 2024-04-15T00:21:18.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.019+0000 7ffad9faa640 1 -- 172.21.15.31:0/2147310549 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffad404f620 con 0x7ffad414b8e0 2024-04-15T00:21:18.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.019+0000 7ffabbfff640 1 -- 172.21.15.31:0/2147310549 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7ffacc046020 con 0x7ffad414b8e0 2024-04-15T00:21:18.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.020+0000 7ffabbfff640 1 --2- 172.21.15.31:0/2147310549 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7ffac006b990 0x7ffac006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:18.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.020+0000 7ffabbfff640 1 -- 172.21.15.31:0/2147310549 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ffacc0ad2f0 con 0x7ffad414b8e0 2024-04-15T00:21:18.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.020+0000 7ffad37fe640 1 --2- 172.21.15.31:0/2147310549 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7ffac006b990 0x7ffac006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:18.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.020+0000 7ffad37fe640 1 --2- 172.21.15.31:0/2147310549 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7ffac006b990 0x7ffac006de50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffac4006fd0 tx=0x7ffac4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:18.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.024+0000 7ffabbfff640 1 -- 172.21.15.31:0/2147310549 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ffacc04d030 con 0x7ffad414b8e0 2024-04-15T00:21:18.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.205+0000 7ffad9faa640 1 -- 172.21.15.31:0/2147310549 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffad4145680 con 0x7ffad414b8e0 2024-04-15T00:21:18.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.206+0000 7ffabbfff640 1 -- 172.21.15.31:0/2147310549 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7ffacc07bc50 con 0x7ffad414b8e0 2024-04-15T00:21:18.213 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:21:18.214 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"fsid":"b57c03ab-2810-4ea5-b233-6164468328c0","created":"2024-04-15T00:20:44.073217+0000","modified":"2024-04-15T00:21:12.971956+0000","last_up_change":"2024-04-15T00:20:55.515596+0000","last_in_change":"2024-04-15T00:20:46.364541+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:20:56.423161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:21:06.436169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:21:06.888505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:21:10.610300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b085a2f4-5565-4ccc-a98e-e56180791550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6817","nonce":2355720818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6819","nonce":2355720818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6823","nonce":2355720818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6821","nonce":2355720818}]},"public_addr":"172.21.15.31:6817/2355720818","cluster_addr":"172.21.15.31:6819/2355720818","heartbeat_back_addr":"172.21.15.31:6823/2355720818","heartbeat_front_addr":"172.21.15.31:6821/2355720818","state":["exists","up"]},{"osd":1,"uuid":"0f751557-3f18-464f-8b78-614d19549f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6809","nonce":2705297130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6811","nonce":2705297130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6815","nonce":2705297130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6813","nonce":2705297130}]},"public_addr":"172.21.15.31:6809/2705297130","cluster_addr":"172.21.15.31:6811/2705297130","heartbeat_back_addr":"172.21.15.31:6815/2705297130","heartbeat_front_addr":"172.21.15.31:6813/2705297130","state":["exists","up"]},{"osd":2,"uuid":"17371b09-2bd7-4ef7-926f-e7706319f064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6801","nonce":225061474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6803","nonce":225061474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6807","nonce":225061474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6805","nonce":225061474}]},"public_addr":"172.21.15.31:6801/225061474","cluster_addr":"172.21.15.31:6803/225061474","heartbeat_back_addr":"172.21.15.31:6807/225061474","heartbeat_front_addr":"172.21.15.31:6805/225061474","state":["exists","up"]},{"osd":3,"uuid":"315b6949-f009-4291-9581-aa4912642dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6825","nonce":3722449780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6827","nonce":3722449780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6831","nonce":3722449780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6829","nonce":3722449780}]},"public_addr":"172.21.15.31:6825/3722449780","cluster_addr":"172.21.15.31:6827/3722449780","heartbeat_back_addr":"172.21.15.31:6831/3722449780","heartbeat_front_addr":"172.21.15.31:6829/3722449780","state":["exists","up"]},{"osd":4,"uuid":"e3659369-cc78-4aa8-bd10-a199d4a1569d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6801","nonce":1279970071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6803","nonce":1279970071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6807","nonce":1279970071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6805","nonce":1279970071}]},"public_addr":"172.21.15.50:6801/1279970071","cluster_addr":"172.21.15.50:6803/1279970071","heartbeat_back_addr":"172.21.15.50:6807/1279970071","heartbeat_front_addr":"172.21.15.50:6805/1279970071","state":["exists","up"]},{"osd":5,"uuid":"35c3a4c0-0b45-45d2-85b9-301c347602f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6809","nonce":1589417182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6811","nonce":1589417182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6815","nonce":1589417182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6813","nonce":1589417182}]},"public_addr":"172.21.15.50:6809/1589417182","cluster_addr":"172.21.15.50:6811/1589417182","heartbeat_back_addr":"172.21.15.50:6815/1589417182","heartbeat_front_addr":"172.21.15.50:6813/1589417182","state":["exists","up"]},{"osd":6,"uuid":"20df7a76-245f-4946-9624-6ca9e949227b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6817","nonce":682288274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6819","nonce":682288274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6823","nonce":682288274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6821","nonce":682288274}]},"public_addr":"172.21.15.50:6817/682288274","cluster_addr":"172.21.15.50:6819/682288274","heartbeat_back_addr":"172.21.15.50:6823/682288274","heartbeat_front_addr":"172.21.15.50:6821/682288274","state":["exists","up"]},{"osd":7,"uuid":"95a504b7-e13a-49e6-8484-9dff4d5fc048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6825","nonce":4129060906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6827","nonce":4129060906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6831","nonce":4129060906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6829","nonce":4129060906}]},"public_addr":"172.21.15.50:6825/4129060906","cluster_addr":"172.21.15.50:6827/4129060906","heartbeat_back_addr":"172.21.15.50:6831/4129060906","heartbeat_front_addr":"172.21.15.50:6829/4129060906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.501980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.529961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.540913+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.521396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.448364+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.514136+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.527229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.508950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:21:18.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.208+0000 7ffad9faa640 1 -- 172.21.15.31:0/2147310549 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7ffac006b990 msgr2=0x7ffac006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:18.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.208+0000 7ffad9faa640 1 --2- 172.21.15.31:0/2147310549 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7ffac006b990 0x7ffac006de50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffac4006fd0 tx=0x7ffac4008040 comp rx=0 tx=0).stop 2024-04-15T00:21:18.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.208+0000 7ffad9faa640 1 -- 172.21.15.31:0/2147310549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffad414b8e0 msgr2=0x7ffad41e0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:18.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.208+0000 7ffad9faa640 1 --2- 172.21.15.31:0/2147310549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffad414b8e0 0x7ffad41e0b40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffacc009e50 tx=0x7ffacc004a40 comp rx=0 tx=0).stop 2024-04-15T00:21:18.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.208+0000 7ffad9faa640 1 -- 172.21.15.31:0/2147310549 shutdown_connections 2024-04-15T00:21:18.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.208+0000 7ffad9faa640 1 --2- 172.21.15.31:0/2147310549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffad414b8e0 0x7ffad41e0b40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.208+0000 7ffad9faa640 1 --2- 172.21.15.31:0/2147310549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffad40baef0 0x7ffad41e0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.208+0000 7ffad9faa640 1 --2- 172.21.15.31:0/2147310549 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7ffac006b990 0x7ffac006de50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.208+0000 7ffad9faa640 1 --2- 172.21.15.31:0/2147310549 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffad40b8bf0 0x7ffad4143cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.208+0000 7ffad9faa640 1 -- 172.21.15.31:0/2147310549 >> 172.21.15.31:0/2147310549 conn(0x7ffad409ed70 msgr2=0x7ffad40bd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:18.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.208+0000 7ffad9faa640 1 -- 172.21.15.31:0/2147310549 shutdown_connections 2024-04-15T00:21:18.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.208+0000 7ffad9faa640 1 -- 172.21.15.31:0/2147310549 wait complete. 2024-04-15T00:21:18.226 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T00:20:56.423161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T00:21:06.436169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T00:21:06.888505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-15T00:21:10.610300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-15T00:21:18.227 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T00:21:18.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.323+0000 7fec567bb640 1 Processor -- start 2024-04-15T00:21:18.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.323+0000 7fec567bb640 1 -- start start 2024-04-15T00:21:18.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.324+0000 7fec567bb640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec500b80d0 0x7fec50072570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:18.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.324+0000 7fec567bb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fec5014b4c0 0x7fec501449c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:18.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.324+0000 7fec567bb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec50072c90 con 0x7fec500b8be0 2024-04-15T00:21:18.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.324+0000 7fec567bb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fec5009c0e0 con 0x7fec5014b4c0 2024-04-15T00:21:18.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.324+0000 7fec567bb640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fec500b84b0 con 0x7fec500b80d0 2024-04-15T00:21:18.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.324+0000 7fec54d58640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fec5014b4c0 0x7fec501449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:18.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.324+0000 7fec4ffff640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec500b80d0 0x7fec50072570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:18.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.324+0000 7fec4ffff640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec500b80d0 0x7fec50072570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.31:53510/0 (socket says 172.21.15.31:53510) 2024-04-15T00:21:18.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.324+0000 7fec54d58640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fec5014b4c0 0x7fec501449c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.31:39814/0 (socket says 172.21.15.31:39814) 2024-04-15T00:21:18.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.324+0000 7fec4ffff640 1 -- 172.21.15.31:0/3627132771 learned_addr learned my addr 172.21.15.31:0/3627132771 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:18.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.324+0000 7fec4f7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fec500b8be0 0x7fec5014adb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.31:49714/0 (socket says 172.21.15.31:49714) 2024-04-15T00:21:18.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.325+0000 7fec4ffff640 1 -- 172.21.15.31:0/3627132771 >> v2:172.21.15.50:3300/0 conn(0x7fec5014b4c0 msgr2=0x7fec501449c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:18.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.325+0000 7fec4ffff640 1 --2- 172.21.15.31:0/3627132771 >> v2:172.21.15.50:3300/0 conn(0x7fec5014b4c0 0x7fec501449c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.325+0000 7fec4ffff640 1 -- 172.21.15.31:0/3627132771 >> v1:172.21.15.50:6789/0 conn(0x7fec500b8be0 legacy=0x7fec5014adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:18.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.325+0000 7fec4ffff640 1 -- 172.21.15.31:0/3627132771 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5009c380 con 0x7fec500b80d0 2024-04-15T00:21:18.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.325+0000 7fec54d58640 1 --2- 172.21.15.31:0/3627132771 >> v2:172.21.15.50:3300/0 conn(0x7fec5014b4c0 0x7fec501449c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:21:18.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.325+0000 7fec4ffff640 1 --2- 172.21.15.31:0/3627132771 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec500b80d0 0x7fec50072570 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fec38009870 tx=0x7fec3802b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfcc1fa30534f3c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:18.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.326+0000 7fec4effd640 1 -- 172.21.15.31:0/3627132771 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec380317c0 con 0x7fec500b80d0 2024-04-15T00:21:18.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.326+0000 7fec4effd640 1 -- 172.21.15.31:0/3627132771 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec38037070 con 0x7fec500b80d0 2024-04-15T00:21:18.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.326+0000 7fec4effd640 1 -- 172.21.15.31:0/3627132771 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec38031b80 con 0x7fec500b80d0 2024-04-15T00:21:18.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.326+0000 7fec567bb640 1 -- 172.21.15.31:0/3627132771 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec500b80d0 msgr2=0x7fec50072570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:18.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.326+0000 7fec567bb640 1 --2- 172.21.15.31:0/3627132771 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec500b80d0 0x7fec50072570 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fec38009870 tx=0x7fec3802b860 comp rx=0 tx=0).stop 2024-04-15T00:21:18.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.326+0000 7fec567bb640 1 -- 172.21.15.31:0/3627132771 shutdown_connections 2024-04-15T00:21:18.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.326+0000 7fec567bb640 1 --2- 172.21.15.31:0/3627132771 >> v2:172.21.15.50:3300/0 conn(0x7fec5014b4c0 0x7fec501449c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.326+0000 7fec567bb640 1 --2- 172.21.15.31:0/3627132771 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec500b80d0 0x7fec50072570 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.326+0000 7fec567bb640 1 -- 172.21.15.31:0/3627132771 >> 172.21.15.31:0/3627132771 conn(0x7fec500bd020 msgr2=0x7fec500bd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:18.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.326+0000 7fec567bb640 1 -- 172.21.15.31:0/3627132771 shutdown_connections 2024-04-15T00:21:18.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.326+0000 7fec567bb640 1 -- 172.21.15.31:0/3627132771 wait complete. 2024-04-15T00:21:18.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.327+0000 7fec567bb640 1 Processor -- start 2024-04-15T00:21:18.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.327+0000 7fec567bb640 1 -- start start 2024-04-15T00:21:18.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.328+0000 7fec567bb640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec500b80d0 0x7fec501d44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:18.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.328+0000 7fec567bb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec500b8be0 0x7fec500b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:18.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.328+0000 7fec567bb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5014b4c0 0x7fec500b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:18.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.328+0000 7fec567bb640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fec50145080 con 0x7fec5014b4c0 2024-04-15T00:21:18.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.328+0000 7fec567bb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fec50144f00 con 0x7fec500b8be0 2024-04-15T00:21:18.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.328+0000 7fec567bb640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fec50145200 con 0x7fec500b80d0 2024-04-15T00:21:18.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.328+0000 7fec54d58640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5014b4c0 0x7fec500b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:18.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.328+0000 7fec54d58640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5014b4c0 0x7fec500b5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50046/0 (socket says 172.21.15.31:50046) 2024-04-15T00:21:18.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.328+0000 7fec54d58640 1 -- 172.21.15.31:0/4157985319 learned_addr learned my addr 172.21.15.31:0/4157985319 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:18.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.328+0000 7fec4f7fe640 1 --2- 172.21.15.31:0/4157985319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec500b8be0 0x7fec500b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:18.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.328+0000 7fec4ffff640 1 --2- 172.21.15.31:0/4157985319 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec500b80d0 0x7fec501d44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:18.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.328+0000 7fec54d58640 1 -- 172.21.15.31:0/4157985319 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec500b80d0 msgr2=0x7fec501d44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:18.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.328+0000 7fec54d58640 1 --2- 172.21.15.31:0/4157985319 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec500b80d0 0x7fec501d44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.328+0000 7fec54d58640 1 -- 172.21.15.31:0/4157985319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec500b8be0 msgr2=0x7fec500b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:18.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.328+0000 7fec54d58640 1 --2- 172.21.15.31:0/4157985319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec500b8be0 0x7fec500b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.328+0000 7fec54d58640 1 -- 172.21.15.31:0/4157985319 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec500b65f0 con 0x7fec5014b4c0 2024-04-15T00:21:18.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.329+0000 7fec54d58640 1 --2- 172.21.15.31:0/4157985319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5014b4c0 0x7fec500b5f10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fec4800efc0 tx=0x7fec4800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:18.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.329+0000 7fec4cff9640 1 -- 172.21.15.31:0/4157985319 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec48018030 con 0x7fec5014b4c0 2024-04-15T00:21:18.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.329+0000 7fec4cff9640 1 -- 172.21.15.31:0/4157985319 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec4800cdf0 con 0x7fec5014b4c0 2024-04-15T00:21:18.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.329+0000 7fec567bb640 1 -- 172.21.15.31:0/4157985319 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec5014a8a0 con 0x7fec5014b4c0 2024-04-15T00:21:18.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.329+0000 7fec4cff9640 1 -- 172.21.15.31:0/4157985319 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec48003bb0 con 0x7fec5014b4c0 2024-04-15T00:21:18.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.329+0000 7fec567bb640 1 -- 172.21.15.31:0/4157985319 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec501dd7a0 con 0x7fec5014b4c0 2024-04-15T00:21:18.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.330+0000 7fec567bb640 1 -- 172.21.15.31:0/4157985319 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec5014ae00 con 0x7fec5014b4c0 2024-04-15T00:21:18.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.330+0000 7fec4cff9640 1 -- 172.21.15.31:0/4157985319 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fec4801b070 con 0x7fec5014b4c0 2024-04-15T00:21:18.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.331+0000 7fec4cff9640 1 --2- 172.21.15.31:0/4157985319 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fec3006b9c0 0x7fec3006de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:18.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.331+0000 7fec4cff9640 1 -- 172.21.15.31:0/4157985319 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fec4808b4c0 con 0x7fec5014b4c0 2024-04-15T00:21:18.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.331+0000 7fec4ffff640 1 --2- 172.21.15.31:0/4157985319 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fec3006b9c0 0x7fec3006de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:18.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.331+0000 7fec4ffff640 1 --2- 172.21.15.31:0/4157985319 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fec3006b9c0 0x7fec3006de80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fec38036000 tx=0x7fec3803d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:18.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.335+0000 7fec4cff9640 1 -- 172.21.15.31:0/4157985319 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fec5014ae00 con 0x7fec5014b4c0 2024-04-15T00:21:18.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.516+0000 7fec567bb640 1 -- 172.21.15.31:0/4157985319 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fec5009f730 con 0x7fec5014b4c0 2024-04-15T00:21:18.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.517+0000 7fec4cff9640 1 -- 172.21.15.31:0/4157985319 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7fec48010040 con 0x7fec5014b4c0 2024-04-15T00:21:18.524 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-15T00:21:18.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.519+0000 7fec567bb640 1 -- 172.21.15.31:0/4157985319 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fec3006b9c0 msgr2=0x7fec3006de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:18.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.519+0000 7fec567bb640 1 --2- 172.21.15.31:0/4157985319 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fec3006b9c0 0x7fec3006de80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fec38036000 tx=0x7fec3803d040 comp rx=0 tx=0).stop 2024-04-15T00:21:18.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.519+0000 7fec567bb640 1 -- 172.21.15.31:0/4157985319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5014b4c0 msgr2=0x7fec500b5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:18.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.519+0000 7fec567bb640 1 --2- 172.21.15.31:0/4157985319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5014b4c0 0x7fec500b5f10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fec4800efc0 tx=0x7fec4800c490 comp rx=0 tx=0).stop 2024-04-15T00:21:18.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.519+0000 7fec567bb640 1 -- 172.21.15.31:0/4157985319 shutdown_connections 2024-04-15T00:21:18.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.519+0000 7fec567bb640 1 --2- 172.21.15.31:0/4157985319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5014b4c0 0x7fec500b5f10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.519+0000 7fec567bb640 1 --2- 172.21.15.31:0/4157985319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec500b8be0 0x7fec500b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.519+0000 7fec567bb640 1 --2- 172.21.15.31:0/4157985319 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fec3006b9c0 0x7fec3006de80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.519+0000 7fec567bb640 1 --2- 172.21.15.31:0/4157985319 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec500b80d0 0x7fec501d44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.519+0000 7fec567bb640 1 -- 172.21.15.31:0/4157985319 >> 172.21.15.31:0/4157985319 conn(0x7fec500bd020 msgr2=0x7fec500bd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:18.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.519+0000 7fec567bb640 1 -- 172.21.15.31:0/4157985319 shutdown_connections 2024-04-15T00:21:18.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.519+0000 7fec567bb640 1 -- 172.21.15.31:0/4157985319 wait complete. 2024-04-15T00:21:18.537 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T00:21:18.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.634+0000 7f6f562de640 1 Processor -- start 2024-04-15T00:21:18.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.634+0000 7f6f562de640 1 -- start start 2024-04-15T00:21:18.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.635+0000 7f6f562de640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6f5006e3f0 0x7f6f5014b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:18.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.635+0000 7f6f562de640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6f5006c650 0x7f6f50151f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:18.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.635+0000 7f6f562de640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f5014abd0 con 0x7f6f5006d010 2024-04-15T00:21:18.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.635+0000 7f6f562de640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f6f5006e7d0 con 0x7f6f5006e3f0 2024-04-15T00:21:18.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.635+0000 7f6f562de640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f6f5006cae0 con 0x7f6f5006c650 2024-04-15T00:21:18.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.635+0000 7f6f4ffff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6f5006e3f0 0x7f6f5014b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:18.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.635+0000 7f6f4ffff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6f5006e3f0 0x7f6f5014b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50054/0 (socket says 172.21.15.31:50054) 2024-04-15T00:21:18.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.635+0000 7f6f4ffff640 1 -- 172.21.15.31:0/2615334555 learned_addr learned my addr 172.21.15.31:0/2615334555 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:18.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.635+0000 7f6f5487b640 1 --2- 172.21.15.31:0/2615334555 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6f5006c650 0x7f6f50151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:18.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.635+0000 7f6f4ffff640 1 -- 172.21.15.31:0/2615334555 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6f5006c650 msgr2=0x7f6f50151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:18.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.635+0000 7f6f4ffff640 1 --2- 172.21.15.31:0/2615334555 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6f5006c650 0x7f6f50151f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.635+0000 7f6f4ffff640 1 -- 172.21.15.31:0/2615334555 >> v1:172.21.15.50:6789/0 conn(0x7f6f5006d010 legacy=0x7f6f5006f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:18.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.635+0000 7f6f4ffff640 1 -- 172.21.15.31:0/2615334555 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f5014ae70 con 0x7f6f5006e3f0 2024-04-15T00:21:18.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.636+0000 7f6f4ffff640 1 --2- 172.21.15.31:0/2615334555 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f5006e3f0 0x7f6f5014b390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009870 tx=0x7f6f4002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36fd58ea89bc6efd server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:18.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.636+0000 7f6f4effd640 1 -- 172.21.15.31:0/2615334555 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f40035020 con 0x7f6f5006e3f0 2024-04-15T00:21:18.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.636+0000 7f6f4effd640 1 -- 172.21.15.31:0/2615334555 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f40031640 con 0x7f6f5006e3f0 2024-04-15T00:21:18.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.636+0000 7f6f4effd640 1 -- 172.21.15.31:0/2615334555 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4002d040 con 0x7f6f5006e3f0 2024-04-15T00:21:18.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.637+0000 7f6f562de640 1 -- 172.21.15.31:0/2615334555 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f5006e3f0 msgr2=0x7f6f5014b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:18.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.637+0000 7f6f562de640 1 --2- 172.21.15.31:0/2615334555 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f5006e3f0 0x7f6f5014b390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009870 tx=0x7f6f4002b8f0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.637+0000 7f6f562de640 1 -- 172.21.15.31:0/2615334555 shutdown_connections 2024-04-15T00:21:18.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.637+0000 7f6f562de640 1 --2- 172.21.15.31:0/2615334555 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6f5006c650 0x7f6f50151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.637+0000 7f6f562de640 1 --2- 172.21.15.31:0/2615334555 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f5006e3f0 0x7f6f5014b390 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.637+0000 7f6f562de640 1 -- 172.21.15.31:0/2615334555 >> 172.21.15.31:0/2615334555 conn(0x7f6f500713c0 msgr2=0x7f6f500717d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:18.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.637+0000 7f6f562de640 1 -- 172.21.15.31:0/2615334555 shutdown_connections 2024-04-15T00:21:18.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.637+0000 7f6f562de640 1 -- 172.21.15.31:0/2615334555 wait complete. 2024-04-15T00:21:18.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.638+0000 7f6f562de640 1 Processor -- start 2024-04-15T00:21:18.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.638+0000 7f6f562de640 1 -- start start 2024-04-15T00:21:18.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.639+0000 7f6f562de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f5006d010 0x7f6f50149c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:18.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.639+0000 7f6f562de640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f5006e3f0 0x7f6f5009ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:18.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.639+0000 7f6f562de640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6f501d2250 0x7f6f501e01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:18.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.639+0000 7f6f562de640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6f500b7640 con 0x7f6f5006e3f0 2024-04-15T00:21:18.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.639+0000 7f6f562de640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6f500b74c0 con 0x7f6f5006d010 2024-04-15T00:21:18.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.639+0000 7f6f562de640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f6f5014b8d0 con 0x7f6f501d2250 2024-04-15T00:21:18.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.639+0000 7f6f4f7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f5006e3f0 0x7f6f5009ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:18.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.639+0000 7f6f4f7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f5006e3f0 0x7f6f5009ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50060/0 (socket says 172.21.15.31:50060) 2024-04-15T00:21:18.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.639+0000 7f6f4f7fe640 1 -- 172.21.15.31:0/1073965893 learned_addr learned my addr 172.21.15.31:0/1073965893 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:18.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.639+0000 7f6f4ffff640 1 --2- 172.21.15.31:0/1073965893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f5006d010 0x7f6f50149c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:18.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.639+0000 7f6f5487b640 1 --2- 172.21.15.31:0/1073965893 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6f501d2250 0x7f6f501e01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:18.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.639+0000 7f6f4f7fe640 1 -- 172.21.15.31:0/1073965893 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6f501d2250 msgr2=0x7f6f501e01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:18.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.639+0000 7f6f4f7fe640 1 --2- 172.21.15.31:0/1073965893 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6f501d2250 0x7f6f501e01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.639+0000 7f6f4f7fe640 1 -- 172.21.15.31:0/1073965893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f5006d010 msgr2=0x7f6f50149c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:18.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.639+0000 7f6f4f7fe640 1 --2- 172.21.15.31:0/1073965893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f5006d010 0x7f6f50149c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.639+0000 7f6f4f7fe640 1 -- 172.21.15.31:0/1073965893 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f5009f350 con 0x7f6f5006e3f0 2024-04-15T00:21:18.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.639+0000 7f6f4f7fe640 1 --2- 172.21.15.31:0/1073965893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f5006e3f0 0x7f6f5009ee10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6f3800c3c0 tx=0x7f6f3800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:18.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.639+0000 7f6f4cff9640 1 -- 172.21.15.31:0/1073965893 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f38017070 con 0x7f6f5006e3f0 2024-04-15T00:21:18.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.639+0000 7f6f4cff9640 1 -- 172.21.15.31:0/1073965893 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f380052f0 con 0x7f6f5006e3f0 2024-04-15T00:21:18.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.639+0000 7f6f562de640 1 -- 172.21.15.31:0/1073965893 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f501d2730 con 0x7f6f5006e3f0 2024-04-15T00:21:18.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.639+0000 7f6f4cff9640 1 -- 172.21.15.31:0/1073965893 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f38003850 con 0x7f6f5006e3f0 2024-04-15T00:21:18.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.640+0000 7f6f562de640 1 -- 172.21.15.31:0/1073965893 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f5014a2f0 con 0x7f6f5006e3f0 2024-04-15T00:21:18.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.641+0000 7f6f562de640 1 -- 172.21.15.31:0/1073965893 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f5004f540 con 0x7f6f5006e3f0 2024-04-15T00:21:18.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.641+0000 7f6f4cff9640 1 -- 172.21.15.31:0/1073965893 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f6f3801a070 con 0x7f6f5006e3f0 2024-04-15T00:21:18.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.641+0000 7f6f4cff9640 1 --2- 172.21.15.31:0/1073965893 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f6f3006b990 0x7f6f3006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:18.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.641+0000 7f6f4cff9640 1 -- 172.21.15.31:0/1073965893 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6f38089df0 con 0x7f6f5006e3f0 2024-04-15T00:21:18.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.641+0000 7f6f4ffff640 1 --2- 172.21.15.31:0/1073965893 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f6f3006b990 0x7f6f3006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:18.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.642+0000 7f6f4ffff640 1 --2- 172.21.15.31:0/1073965893 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f6f3006b990 0x7f6f3006de50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6f40036000 tx=0x7f6f4003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:18.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.645+0000 7f6f4cff9640 1 -- 172.21.15.31:0/1073965893 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6f501d2730 con 0x7f6f5006e3f0 2024-04-15T00:21:18.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.827+0000 7f6f562de640 1 -- 172.21.15.31:0/1073965893 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6f50000930 con 0x7f6f5006e3f0 2024-04-15T00:21:18.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.827+0000 7f6f4cff9640 1 -- 172.21.15.31:0/1073965893 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f6f38058750 con 0x7f6f5006e3f0 2024-04-15T00:21:18.835 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-15T00:21:18.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.829+0000 7f6f562de640 1 -- 172.21.15.31:0/1073965893 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f6f3006b990 msgr2=0x7f6f3006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:18.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.829+0000 7f6f562de640 1 --2- 172.21.15.31:0/1073965893 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f6f3006b990 0x7f6f3006de50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6f40036000 tx=0x7f6f4003c040 comp rx=0 tx=0).stop 2024-04-15T00:21:18.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.829+0000 7f6f562de640 1 -- 172.21.15.31:0/1073965893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f5006e3f0 msgr2=0x7f6f5009ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:18.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.829+0000 7f6f562de640 1 --2- 172.21.15.31:0/1073965893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f5006e3f0 0x7f6f5009ee10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6f3800c3c0 tx=0x7f6f3800c880 comp rx=0 tx=0).stop 2024-04-15T00:21:18.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.829+0000 7f6f562de640 1 -- 172.21.15.31:0/1073965893 shutdown_connections 2024-04-15T00:21:18.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.829+0000 7f6f562de640 1 --2- 172.21.15.31:0/1073965893 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f6f3006b990 0x7f6f3006de50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.829+0000 7f6f562de640 1 --2- 172.21.15.31:0/1073965893 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6f501d2250 0x7f6f501e01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.829+0000 7f6f562de640 1 --2- 172.21.15.31:0/1073965893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f5006e3f0 0x7f6f5009ee10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.829+0000 7f6f562de640 1 --2- 172.21.15.31:0/1073965893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f5006d010 0x7f6f50149c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.829+0000 7f6f562de640 1 -- 172.21.15.31:0/1073965893 >> 172.21.15.31:0/1073965893 conn(0x7f6f500713c0 msgr2=0x7f6f500b0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:18.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.829+0000 7f6f562de640 1 -- 172.21.15.31:0/1073965893 shutdown_connections 2024-04-15T00:21:18.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.829+0000 7f6f562de640 1 -- 172.21.15.31:0/1073965893 wait complete. 2024-04-15T00:21:18.847 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T00:21:18.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.944+0000 7f568b8de640 1 Processor -- start 2024-04-15T00:21:18.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.944+0000 7f568b8de640 1 -- start start 2024-04-15T00:21:18.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.945+0000 7f568b8de640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f56840baef0 0x7f5684147670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:18.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.945+0000 7f568b8de640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f568414b8e0 0x7f56840b9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:18.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.945+0000 7f568b8de640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56840bb2d0 con 0x7f56840b8bf0 2024-04-15T00:21:18.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.945+0000 7f568b8de640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f5684147bb0 con 0x7f56840baef0 2024-04-15T00:21:18.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.945+0000 7f568b8de640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f568414ae00 con 0x7f568414b8e0 2024-04-15T00:21:18.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.945+0000 7f568967a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f56840baef0 0x7f5684147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:18.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.945+0000 7f568967a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f56840baef0 0x7f5684147670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50066/0 (socket says 172.21.15.31:50066) 2024-04-15T00:21:18.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.945+0000 7f568967a640 1 -- 172.21.15.31:0/1114517262 learned_addr learned my addr 172.21.15.31:0/1114517262 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:18.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.945+0000 7f568967a640 1 -- 172.21.15.31:0/1114517262 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f568414b8e0 msgr2=0x7f56840b9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:18.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.945+0000 7f568967a640 1 --2- 172.21.15.31:0/1114517262 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f568414b8e0 0x7f56840b9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.945+0000 7f568967a640 1 -- 172.21.15.31:0/1114517262 >> v1:172.21.15.50:6789/0 conn(0x7f56840b8bf0 legacy=0x7f5684072600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:18.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.945+0000 7f568967a640 1 -- 172.21.15.31:0/1114517262 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f568414b0e0 con 0x7f56840baef0 2024-04-15T00:21:18.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.946+0000 7f568967a640 1 --2- 172.21.15.31:0/1114517262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56840baef0 0x7f5684147670 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f567c009870 tx=0x7f567c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d0d3380672d6d29 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:18.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.946+0000 7f567bfff640 1 -- 172.21.15.31:0/1114517262 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c0317c0 con 0x7f56840baef0 2024-04-15T00:21:18.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.946+0000 7f567bfff640 1 -- 172.21.15.31:0/1114517262 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f567c037070 con 0x7f56840baef0 2024-04-15T00:21:18.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.946+0000 7f567bfff640 1 -- 172.21.15.31:0/1114517262 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c031b80 con 0x7f56840baef0 2024-04-15T00:21:18.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.946+0000 7f568b8de640 1 -- 172.21.15.31:0/1114517262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56840baef0 msgr2=0x7f5684147670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:18.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.946+0000 7f568b8de640 1 --2- 172.21.15.31:0/1114517262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56840baef0 0x7f5684147670 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f567c009870 tx=0x7f567c02b860 comp rx=0 tx=0).stop 2024-04-15T00:21:18.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.947+0000 7f568b8de640 1 -- 172.21.15.31:0/1114517262 shutdown_connections 2024-04-15T00:21:18.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.947+0000 7f568b8de640 1 --2- 172.21.15.31:0/1114517262 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f568414b8e0 0x7f56840b9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.947+0000 7f568b8de640 1 --2- 172.21.15.31:0/1114517262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56840baef0 0x7f5684147670 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.947+0000 7f568b8de640 1 -- 172.21.15.31:0/1114517262 >> 172.21.15.31:0/1114517262 conn(0x7f568409ed70 msgr2=0x7f568409f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:18.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.947+0000 7f568b8de640 1 -- 172.21.15.31:0/1114517262 shutdown_connections 2024-04-15T00:21:18.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.947+0000 7f568b8de640 1 -- 172.21.15.31:0/1114517262 wait complete. 2024-04-15T00:21:18.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.948+0000 7f568b8de640 1 Processor -- start 2024-04-15T00:21:18.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.948+0000 7f568b8de640 1 -- start start 2024-04-15T00:21:18.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.948+0000 7f568b8de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56840b8bf0 0x7f5684144220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:18.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.948+0000 7f568b8de640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56840baef0 0x7f56841d1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:18.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.948+0000 7f568b8de640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f568414b8e0 0x7f56841dce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:18.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.948+0000 7f568b8de640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f56840ba0d0 con 0x7f56840baef0 2024-04-15T00:21:18.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.948+0000 7f568b8de640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f56840b9f50 con 0x7f56840b8bf0 2024-04-15T00:21:18.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.948+0000 7f568b8de640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f56840b9060 con 0x7f568414b8e0 2024-04-15T00:21:18.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.948+0000 7f5688e79640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56840baef0 0x7f56841d1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:18.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.948+0000 7f5688e79640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56840baef0 0x7f56841d1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50078/0 (socket says 172.21.15.31:50078) 2024-04-15T00:21:18.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.948+0000 7f5688e79640 1 -- 172.21.15.31:0/2817078352 learned_addr learned my addr 172.21.15.31:0/2817078352 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:18.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.948+0000 7f568967a640 1 --2- 172.21.15.31:0/2817078352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56840b8bf0 0x7f5684144220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:18.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.948+0000 7f5689e7b640 1 --2- 172.21.15.31:0/2817078352 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f568414b8e0 0x7f56841dce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:18.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.949+0000 7f5688e79640 1 -- 172.21.15.31:0/2817078352 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f568414b8e0 msgr2=0x7f56841dce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:18.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.949+0000 7f5688e79640 1 --2- 172.21.15.31:0/2817078352 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f568414b8e0 0x7f56841dce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.949+0000 7f5688e79640 1 -- 172.21.15.31:0/2817078352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56840b8bf0 msgr2=0x7f5684144220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:18.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.949+0000 7f5688e79640 1 --2- 172.21.15.31:0/2817078352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56840b8bf0 0x7f5684144220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:18.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.949+0000 7f5688e79640 1 -- 172.21.15.31:0/2817078352 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56841d19d0 con 0x7f56840baef0 2024-04-15T00:21:18.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.949+0000 7f5688e79640 1 --2- 172.21.15.31:0/2817078352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56840baef0 0x7f56841d1330 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f567400b440 tx=0x7f567400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:18.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.949+0000 7f5679ffb640 1 -- 172.21.15.31:0/2817078352 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5674015020 con 0x7f56840baef0 2024-04-15T00:21:18.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.949+0000 7f5679ffb640 1 -- 172.21.15.31:0/2817078352 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5674011890 con 0x7f56840baef0 2024-04-15T00:21:18.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.949+0000 7f568b8de640 1 -- 172.21.15.31:0/2817078352 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5684144e70 con 0x7f56840baef0 2024-04-15T00:21:18.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.949+0000 7f5679ffb640 1 -- 172.21.15.31:0/2817078352 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5674011c80 con 0x7f56840baef0 2024-04-15T00:21:18.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.949+0000 7f568b8de640 1 -- 172.21.15.31:0/2817078352 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56841d0bb0 con 0x7f56840baef0 2024-04-15T00:21:18.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.950+0000 7f568b8de640 1 -- 172.21.15.31:0/2817078352 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5684068470 con 0x7f56840baef0 2024-04-15T00:21:18.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.950+0000 7f5679ffb640 1 -- 172.21.15.31:0/2817078352 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f5674018020 con 0x7f56840baef0 2024-04-15T00:21:18.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.951+0000 7f5679ffb640 1 --2- 172.21.15.31:0/2817078352 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f566806b990 0x7f566806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:18.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.951+0000 7f5679ffb640 1 -- 172.21.15.31:0/2817078352 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f567408aac0 con 0x7f56840baef0 2024-04-15T00:21:18.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.951+0000 7f568967a640 1 --2- 172.21.15.31:0/2817078352 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f566806b990 0x7f566806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:18.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.951+0000 7f568967a640 1 --2- 172.21.15.31:0/2817078352 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f566806b990 0x7f566806de50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f567c036000 tx=0x7f567c03d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:18.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:18.955+0000 7f5679ffb640 1 -- 172.21.15.31:0/2817078352 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f567401f020 con 0x7f56840baef0 2024-04-15T00:21:19.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.135+0000 7f568b8de640 1 -- 172.21.15.31:0/2817078352 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f568404f620 con 0x7f56840baef0 2024-04-15T00:21:19.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.135+0000 7f5679ffb640 1 -- 172.21.15.31:0/2817078352 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f56841d19d0 con 0x7f56840baef0 2024-04-15T00:21:19.143 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-04-15T00:21:19.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.137+0000 7f568b8de640 1 -- 172.21.15.31:0/2817078352 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f566806b990 msgr2=0x7f566806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:19.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.137+0000 7f568b8de640 1 --2- 172.21.15.31:0/2817078352 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f566806b990 0x7f566806de50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f567c036000 tx=0x7f567c03d040 comp rx=0 tx=0).stop 2024-04-15T00:21:19.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.137+0000 7f568b8de640 1 -- 172.21.15.31:0/2817078352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56840baef0 msgr2=0x7f56841d1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:19.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.137+0000 7f568b8de640 1 --2- 172.21.15.31:0/2817078352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56840baef0 0x7f56841d1330 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f567400b440 tx=0x7f567400b900 comp rx=0 tx=0).stop 2024-04-15T00:21:19.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.137+0000 7f568b8de640 1 -- 172.21.15.31:0/2817078352 shutdown_connections 2024-04-15T00:21:19.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.137+0000 7f568b8de640 1 --2- 172.21.15.31:0/2817078352 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f566806b990 0x7f566806de50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:19.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.137+0000 7f568b8de640 1 --2- 172.21.15.31:0/2817078352 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f568414b8e0 0x7f56841dce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:19.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.137+0000 7f568b8de640 1 --2- 172.21.15.31:0/2817078352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56840baef0 0x7f56841d1330 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:19.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.137+0000 7f568b8de640 1 --2- 172.21.15.31:0/2817078352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56840b8bf0 0x7f5684144220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:19.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.137+0000 7f568b8de640 1 -- 172.21.15.31:0/2817078352 >> 172.21.15.31:0/2817078352 conn(0x7f568409ed70 msgr2=0x7f5684145e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:19.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.137+0000 7f568b8de640 1 -- 172.21.15.31:0/2817078352 shutdown_connections 2024-04-15T00:21:19.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.137+0000 7f568b8de640 1 -- 172.21.15.31:0/2817078352 wait complete. 2024-04-15T00:21:19.155 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-15T00:21:19.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.251+0000 7f9bfcd55640 1 Processor -- start 2024-04-15T00:21:19.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.251+0000 7f9bfcd55640 1 -- start start 2024-04-15T00:21:19.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.252+0000 7f9bfcd55640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bf809f470 0x7f9bf8073040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:19.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.252+0000 7f9bfcd55640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bf80bb790 con 0x7f9bf814ff60 2024-04-15T00:21:19.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.252+0000 7f9bfcd55640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bf8141e00 con 0x7f9bf80bbe90 2024-04-15T00:21:19.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.252+0000 7f9bfcd55640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f9bf8073830 con 0x7f9bf809f470 2024-04-15T00:21:19.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.252+0000 7f9bf6d9d640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9bf814ff60 0x7f9bf8152350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:36536/0 (socket says 172.21.15.31:36536) 2024-04-15T00:21:19.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.252+0000 7f9bf6d9d640 1 -- 172.21.15.31:0/2103493825 learned_addr learned my addr 172.21.15.31:0/2103493825 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:19.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.253+0000 7f9bf659c640 1 --2- 172.21.15.31:0/2103493825 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bf809f470 0x7f9bf8073040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:19.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.253+0000 7f9bf559a640 1 -- 172.21.15.31:0/2103493825 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2351317170 0 0) 0x7f9bf80bb790 con 0x7f9bf814ff60 2024-04-15T00:21:19.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.253+0000 7f9bf559a640 1 -- 172.21.15.31:0/2103493825 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9be4003520 con 0x7f9bf814ff60 2024-04-15T00:21:19.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.253+0000 7f9bf559a640 1 -- 172.21.15.31:0/2103493825 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1618201560 0 0) 0x7f9be0001110 con 0x7f9bf80bbe90 2024-04-15T00:21:19.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.253+0000 7f9bf659c640 1 -- 172.21.15.31:0/2103493825 >> v1:172.21.15.50:6789/0 conn(0x7f9bf80bbe90 legacy=0x7f9bf81416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:19.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.253+0000 7f9bf659c640 1 -- 172.21.15.31:0/2103493825 >> v1:172.21.15.31:6789/0 conn(0x7f9bf814ff60 legacy=0x7f9bf8152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:19.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.253+0000 7f9bf659c640 1 -- 172.21.15.31:0/2103493825 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf809f850 con 0x7f9bf809f470 2024-04-15T00:21:19.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.254+0000 7f9bf659c640 1 --2- 172.21.15.31:0/2103493825 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bf809f470 0x7f9bf8073040 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9bf00097d0 tx=0x7f9bf002b690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20179455d7b9456e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:19.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.254+0000 7f9bf559a640 1 -- 172.21.15.31:0/2103493825 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0037070 con 0x7f9bf809f470 2024-04-15T00:21:19.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.254+0000 7f9bf559a640 1 -- 172.21.15.31:0/2103493825 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bf0030510 con 0x7f9bf809f470 2024-04-15T00:21:19.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.254+0000 7f9bf559a640 1 -- 172.21.15.31:0/2103493825 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be80019f0 con 0x7f9bf809f470 2024-04-15T00:21:19.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.254+0000 7f9bfcd55640 1 -- 172.21.15.31:0/2103493825 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bf809f470 msgr2=0x7f9bf8073040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:19.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.254+0000 7f9bfcd55640 1 --2- 172.21.15.31:0/2103493825 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bf809f470 0x7f9bf8073040 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9bf00097d0 tx=0x7f9bf002b690 comp rx=0 tx=0).stop 2024-04-15T00:21:19.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.255+0000 7f9bfcd55640 1 -- 172.21.15.31:0/2103493825 shutdown_connections 2024-04-15T00:21:19.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.255+0000 7f9bfcd55640 1 --2- 172.21.15.31:0/2103493825 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bf809f470 0x7f9bf8073040 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:19.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.255+0000 7f9bfcd55640 1 -- 172.21.15.31:0/2103493825 >> 172.21.15.31:0/2103493825 conn(0x7f9bf80a2a60 msgr2=0x7f9bf809eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:19.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.255+0000 7f9bfcd55640 1 -- 172.21.15.31:0/2103493825 shutdown_connections 2024-04-15T00:21:19.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.255+0000 7f9bfcd55640 1 -- 172.21.15.31:0/2103493825 wait complete. 2024-04-15T00:21:19.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.256+0000 7f9bfcd55640 1 Processor -- start 2024-04-15T00:21:19.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.256+0000 7f9bfcd55640 1 -- start start 2024-04-15T00:21:19.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.256+0000 7f9bfcd55640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bf809f470 0x7f9bf8137040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:19.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.256+0000 7f9bfcd55640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bf80bbe90 0x7f9bf80b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:19.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.256+0000 7f9bfcd55640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bf814ff60 0x7f9bf80b2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:19.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.256+0000 7f9bfcd55640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf809b9d0 con 0x7f9bf80bbe90 2024-04-15T00:21:19.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.256+0000 7f9bfcd55640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf809bd40 con 0x7f9bf809f470 2024-04-15T00:21:19.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.256+0000 7f9bfcd55640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f9bf809af00 con 0x7f9bf814ff60 2024-04-15T00:21:19.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.256+0000 7f9bf5d9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bf80bbe90 0x7f9bf80b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:19.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.256+0000 7f9bf5d9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bf80bbe90 0x7f9bf80b1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50088/0 (socket says 172.21.15.31:50088) 2024-04-15T00:21:19.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.256+0000 7f9bf5d9b640 1 -- 172.21.15.31:0/182859488 learned_addr learned my addr 172.21.15.31:0/182859488 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:19.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.256+0000 7f9bf6d9d640 1 --2- 172.21.15.31:0/182859488 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bf814ff60 0x7f9bf80b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:19.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.257+0000 7f9bf659c640 1 --2- 172.21.15.31:0/182859488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bf809f470 0x7f9bf8137040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:19.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.257+0000 7f9bf5d9b640 1 -- 172.21.15.31:0/182859488 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bf814ff60 msgr2=0x7f9bf80b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:19.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.257+0000 7f9bf5d9b640 1 --2- 172.21.15.31:0/182859488 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bf814ff60 0x7f9bf80b2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:19.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.257+0000 7f9bf5d9b640 1 -- 172.21.15.31:0/182859488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bf809f470 msgr2=0x7f9bf8137040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:19.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.257+0000 7f9bf5d9b640 1 --2- 172.21.15.31:0/182859488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bf809f470 0x7f9bf8137040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:19.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.257+0000 7f9bf5d9b640 1 -- 172.21.15.31:0/182859488 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf80a0d10 con 0x7f9bf80bbe90 2024-04-15T00:21:19.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.257+0000 7f9bf5d9b640 1 --2- 172.21.15.31:0/182859488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bf80bbe90 0x7f9bf80b1f10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9be000c750 tx=0x7f9be000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:19.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.257+0000 7f9beeffd640 1 -- 172.21.15.31:0/182859488 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be0017070 con 0x7f9bf80bbe90 2024-04-15T00:21:19.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.257+0000 7f9beeffd640 1 -- 172.21.15.31:0/182859488 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9be00052b0 con 0x7f9bf80bbe90 2024-04-15T00:21:19.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.257+0000 7f9bfcd55640 1 -- 172.21.15.31:0/182859488 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bf809fe80 con 0x7f9bf80bbe90 2024-04-15T00:21:19.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.257+0000 7f9beeffd640 1 -- 172.21.15.31:0/182859488 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be000a880 con 0x7f9bf80bbe90 2024-04-15T00:21:19.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.257+0000 7f9bfcd55640 1 -- 172.21.15.31:0/182859488 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bf80b3570 con 0x7f9bf80bbe90 2024-04-15T00:21:19.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.258+0000 7f9bfcd55640 1 -- 172.21.15.31:0/182859488 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bf80a0b40 con 0x7f9bf80bbe90 2024-04-15T00:21:19.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.258+0000 7f9beeffd640 1 -- 172.21.15.31:0/182859488 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f9be001a070 con 0x7f9bf80bbe90 2024-04-15T00:21:19.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.259+0000 7f9beeffd640 1 --2- 172.21.15.31:0/182859488 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f9bd806b990 0x7f9bd806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:19.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.259+0000 7f9beeffd640 1 -- 172.21.15.31:0/182859488 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9be0089e60 con 0x7f9bf80bbe90 2024-04-15T00:21:19.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.259+0000 7f9bf659c640 1 --2- 172.21.15.31:0/182859488 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f9bd806b990 0x7f9bd806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:19.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.259+0000 7f9bf659c640 1 --2- 172.21.15.31:0/182859488 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f9bd806b990 0x7f9bd806de50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0034000 tx=0x7f9bf0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:19.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.263+0000 7f9beeffd640 1 -- 172.21.15.31:0/182859488 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9bf8141e00 con 0x7f9bf80bbe90 2024-04-15T00:21:19.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.446+0000 7f9bfcd55640 1 -- 172.21.15.31:0/182859488 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f9bf804f540 con 0x7f9bf80bbe90 2024-04-15T00:21:19.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.446+0000 7f9beeffd640 1 -- 172.21.15.31:0/182859488 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f9be0007d30 con 0x7f9bf80bbe90 2024-04-15T00:21:19.454 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-15T00:21:19.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.448+0000 7f9bfcd55640 1 -- 172.21.15.31:0/182859488 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f9bd806b990 msgr2=0x7f9bd806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:19.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.448+0000 7f9bfcd55640 1 --2- 172.21.15.31:0/182859488 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f9bd806b990 0x7f9bd806de50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0034000 tx=0x7f9bf0008030 comp rx=0 tx=0).stop 2024-04-15T00:21:19.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.448+0000 7f9bfcd55640 1 -- 172.21.15.31:0/182859488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bf80bbe90 msgr2=0x7f9bf80b1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:19.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.448+0000 7f9bfcd55640 1 --2- 172.21.15.31:0/182859488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bf80bbe90 0x7f9bf80b1f10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9be000c750 tx=0x7f9be000cc10 comp rx=0 tx=0).stop 2024-04-15T00:21:19.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.448+0000 7f9bfcd55640 1 -- 172.21.15.31:0/182859488 shutdown_connections 2024-04-15T00:21:19.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.448+0000 7f9bfcd55640 1 --2- 172.21.15.31:0/182859488 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f9bd806b990 0x7f9bd806de50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:19.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.448+0000 7f9bfcd55640 1 --2- 172.21.15.31:0/182859488 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9bf814ff60 0x7f9bf80b2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:19.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.448+0000 7f9bfcd55640 1 --2- 172.21.15.31:0/182859488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bf80bbe90 0x7f9bf80b1f10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:19.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.448+0000 7f9bfcd55640 1 --2- 172.21.15.31:0/182859488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bf809f470 0x7f9bf8137040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:19.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.448+0000 7f9bfcd55640 1 -- 172.21.15.31:0/182859488 >> 172.21.15.31:0/182859488 conn(0x7f9bf80a2a60 msgr2=0x7f9bf81414c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:19.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.448+0000 7f9bfcd55640 1 -- 172.21.15.31:0/182859488 shutdown_connections 2024-04-15T00:21:19.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.449+0000 7f9bfcd55640 1 -- 172.21.15.31:0/182859488 wait complete. 2024-04-15T00:21:19.467 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-15T00:21:19.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.561+0000 7fc0787fa640 1 Processor -- start 2024-04-15T00:21:19.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.561+0000 7fc0787fa640 1 -- start start 2024-04-15T00:21:19.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.562+0000 7fc0787fa640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc0700b6050 0x7fc07006c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:19.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.562+0000 7fc0787fa640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc0700b6940 0x7fc0700b6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:19.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.562+0000 7fc0787fa640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc07006f8c0 con 0x7fc07006c3b0 2024-04-15T00:21:19.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.562+0000 7fc0787fa640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fc070141ed0 con 0x7fc0700b6050 2024-04-15T00:21:19.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.562+0000 7fc0787fa640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fc070147900 con 0x7fc0700b6940 2024-04-15T00:21:19.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.562+0000 7fc075d95640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc0700b6050 0x7fc07006c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:19.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.562+0000 7fc075d95640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc0700b6050 0x7fc07006c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50104/0 (socket says 172.21.15.31:50104) 2024-04-15T00:21:19.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.562+0000 7fc075d95640 1 -- 172.21.15.31:0/6263982 learned_addr learned my addr 172.21.15.31:0/6263982 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:19.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.562+0000 7fc076d97640 1 --2- 172.21.15.31:0/6263982 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc0700b6940 0x7fc0700b6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:19.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.563+0000 7fc075d95640 1 -- 172.21.15.31:0/6263982 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc0700b6940 msgr2=0x7fc0700b6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:19.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.563+0000 7fc075d95640 1 --2- 172.21.15.31:0/6263982 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc0700b6940 0x7fc0700b6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:19.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.563+0000 7fc075d95640 1 -- 172.21.15.31:0/6263982 >> v1:172.21.15.50:6789/0 conn(0x7fc07006c3b0 legacy=0x7fc0701480e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:19.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.563+0000 7fc075d95640 1 -- 172.21.15.31:0/6263982 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc070147bc0 con 0x7fc0700b6050 2024-04-15T00:21:19.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.563+0000 7fc075d95640 1 --2- 172.21.15.31:0/6263982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0700b6050 0x7fc07006c790 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc064009870 tx=0x7fc06402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89991e0c20a52c27 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:19.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.563+0000 7fc075594640 1 -- 172.21.15.31:0/6263982 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0640317c0 con 0x7fc0700b6050 2024-04-15T00:21:19.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.563+0000 7fc075594640 1 -- 172.21.15.31:0/6263982 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc064037070 con 0x7fc0700b6050 2024-04-15T00:21:19.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.564+0000 7fc075594640 1 -- 172.21.15.31:0/6263982 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc064031b80 con 0x7fc0700b6050 2024-04-15T00:21:19.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.564+0000 7fc0787fa640 1 -- 172.21.15.31:0/6263982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0700b6050 msgr2=0x7fc07006c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:19.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.564+0000 7fc0787fa640 1 --2- 172.21.15.31:0/6263982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0700b6050 0x7fc07006c790 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc064009870 tx=0x7fc06402b860 comp rx=0 tx=0).stop 2024-04-15T00:21:19.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.564+0000 7fc0787fa640 1 -- 172.21.15.31:0/6263982 shutdown_connections 2024-04-15T00:21:19.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.564+0000 7fc0787fa640 1 --2- 172.21.15.31:0/6263982 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc0700b6940 0x7fc0700b6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:19.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.564+0000 7fc0787fa640 1 --2- 172.21.15.31:0/6263982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0700b6050 0x7fc07006c790 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:19.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.564+0000 7fc0787fa640 1 -- 172.21.15.31:0/6263982 >> 172.21.15.31:0/6263982 conn(0x7fc0700b7840 msgr2=0x7fc0700b7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:19.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.564+0000 7fc0787fa640 1 -- 172.21.15.31:0/6263982 shutdown_connections 2024-04-15T00:21:19.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.564+0000 7fc0787fa640 1 -- 172.21.15.31:0/6263982 wait complete. 2024-04-15T00:21:19.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.565+0000 7fc0787fa640 1 Processor -- start 2024-04-15T00:21:19.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.565+0000 7fc0787fa640 1 -- start start 2024-04-15T00:21:19.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.566+0000 7fc0787fa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc07006c3b0 0x7fc07013d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:19.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.566+0000 7fc0787fa640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc0700b6050 0x7fc07013c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:19.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.566+0000 7fc0787fa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0700b6940 0x7fc07013f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:19.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.566+0000 7fc0787fa640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc07006d070 con 0x7fc0700b6940 2024-04-15T00:21:19.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.566+0000 7fc0787fa640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc07006cef0 con 0x7fc07006c3b0 2024-04-15T00:21:19.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.566+0000 7fc0787fa640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fc070151fb0 con 0x7fc0700b6050 2024-04-15T00:21:19.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.566+0000 7fc076d97640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0700b6940 0x7fc07013f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:19.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.566+0000 7fc076d97640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0700b6940 0x7fc07013f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50114/0 (socket says 172.21.15.31:50114) 2024-04-15T00:21:19.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.566+0000 7fc076d97640 1 -- 172.21.15.31:0/3347625026 learned_addr learned my addr 172.21.15.31:0/3347625026 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:19.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.566+0000 7fc076596640 1 --2- 172.21.15.31:0/3347625026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc07006c3b0 0x7fc07013d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:19.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.566+0000 7fc075d95640 1 --2- 172.21.15.31:0/3347625026 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc0700b6050 0x7fc07013c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:19.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.566+0000 7fc076d97640 1 -- 172.21.15.31:0/3347625026 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc0700b6050 msgr2=0x7fc07013c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:19.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.566+0000 7fc076d97640 1 --2- 172.21.15.31:0/3347625026 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc0700b6050 0x7fc07013c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:19.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.566+0000 7fc076d97640 1 -- 172.21.15.31:0/3347625026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc07006c3b0 msgr2=0x7fc07013d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:19.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.566+0000 7fc076d97640 1 --2- 172.21.15.31:0/3347625026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc07006c3b0 0x7fc07013d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:19.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.566+0000 7fc076d97640 1 -- 172.21.15.31:0/3347625026 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc070142390 con 0x7fc0700b6940 2024-04-15T00:21:19.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.566+0000 7fc076d97640 1 --2- 172.21.15.31:0/3347625026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0700b6940 0x7fc07013f9d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc06800d800 tx=0x7fc06800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:19.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.566+0000 7fc06effd640 1 -- 172.21.15.31:0/3347625026 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06800b6c0 con 0x7fc0700b6940 2024-04-15T00:21:19.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.566+0000 7fc06effd640 1 -- 172.21.15.31:0/3347625026 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc068019070 con 0x7fc0700b6940 2024-04-15T00:21:19.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.566+0000 7fc0787fa640 1 -- 172.21.15.31:0/3347625026 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc07013d290 con 0x7fc0700b6940 2024-04-15T00:21:19.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.566+0000 7fc06effd640 1 -- 172.21.15.31:0/3347625026 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06800bac0 con 0x7fc0700b6940 2024-04-15T00:21:19.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.566+0000 7fc0787fa640 1 -- 172.21.15.31:0/3347625026 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc07013cd90 con 0x7fc0700b6940 2024-04-15T00:21:19.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.567+0000 7fc0787fa640 1 -- 172.21.15.31:0/3347625026 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc07013d080 con 0x7fc0700b6940 2024-04-15T00:21:19.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.568+0000 7fc06effd640 1 -- 172.21.15.31:0/3347625026 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc06800bc60 con 0x7fc0700b6940 2024-04-15T00:21:19.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.568+0000 7fc06effd640 1 --2- 172.21.15.31:0/3347625026 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc05c06b990 0x7fc05c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:19.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.568+0000 7fc06effd640 1 -- 172.21.15.31:0/3347625026 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc06808af40 con 0x7fc0700b6940 2024-04-15T00:21:19.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.568+0000 7fc076596640 1 --2- 172.21.15.31:0/3347625026 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc05c06b990 0x7fc05c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:19.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.569+0000 7fc076596640 1 --2- 172.21.15.31:0/3347625026 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc05c06b990 0x7fc05c06de50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc060001ca0 tx=0x7fc060009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:19.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.573+0000 7fc06effd640 1 -- 172.21.15.31:0/3347625026 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc0680598a0 con 0x7fc0700b6940 2024-04-15T00:21:19.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.767+0000 7fc0787fa640 1 -- 172.21.15.31:0/3347625026 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc070074a30 con 0x7fc0700b6940 2024-04-15T00:21:19.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.767+0000 7fc06effd640 1 -- 172.21.15.31:0/3347625026 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fc0680591a0 con 0x7fc0700b6940 2024-04-15T00:21:19.775 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-04-15T00:21:19.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.770+0000 7fc0787fa640 1 -- 172.21.15.31:0/3347625026 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc05c06b990 msgr2=0x7fc05c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:19.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.770+0000 7fc0787fa640 1 --2- 172.21.15.31:0/3347625026 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc05c06b990 0x7fc05c06de50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc060001ca0 tx=0x7fc060009040 comp rx=0 tx=0).stop 2024-04-15T00:21:19.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.770+0000 7fc0787fa640 1 -- 172.21.15.31:0/3347625026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0700b6940 msgr2=0x7fc07013f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:19.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.770+0000 7fc0787fa640 1 --2- 172.21.15.31:0/3347625026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0700b6940 0x7fc07013f9d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc06800d800 tx=0x7fc06800dcc0 comp rx=0 tx=0).stop 2024-04-15T00:21:19.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.770+0000 7fc0787fa640 1 -- 172.21.15.31:0/3347625026 shutdown_connections 2024-04-15T00:21:19.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.770+0000 7fc0787fa640 1 --2- 172.21.15.31:0/3347625026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0700b6940 0x7fc07013f9d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:19.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.770+0000 7fc0787fa640 1 --2- 172.21.15.31:0/3347625026 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc05c06b990 0x7fc05c06de50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:19.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.770+0000 7fc0787fa640 1 --2- 172.21.15.31:0/3347625026 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc0700b6050 0x7fc07013c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:19.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.770+0000 7fc0787fa640 1 --2- 172.21.15.31:0/3347625026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc07006c3b0 0x7fc07013d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:19.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.770+0000 7fc0787fa640 1 -- 172.21.15.31:0/3347625026 >> 172.21.15.31:0/3347625026 conn(0x7fc0700b7840 msgr2=0x7fc070071360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:19.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.770+0000 7fc0787fa640 1 -- 172.21.15.31:0/3347625026 shutdown_connections 2024-04-15T00:21:19.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.770+0000 7fc0787fa640 1 -- 172.21.15.31:0/3347625026 wait complete. 2024-04-15T00:21:19.787 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-15T00:21:19.787 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T00:21:19.803 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:21:19.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.937+0000 7fd7c3260640 1 Processor -- start 2024-04-15T00:21:19.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.937+0000 7fd7c3260640 1 -- start start 2024-04-15T00:21:19.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.938+0000 7fd7c3260640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd7bc0b8bf0 0x7fd7bc153000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:19.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.938+0000 7fd7c3260640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7bc0bb2d0 con 0x7fd7bc0baef0 2024-04-15T00:21:19.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.938+0000 7fd7c3260640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7bc14ae00 con 0x7fd7bc14b8e0 2024-04-15T00:21:19.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.938+0000 7fd7c3260640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fd7bc14b0e0 con 0x7fd7bc0b8bf0 2024-04-15T00:21:19.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.938+0000 7fd7c0ffc640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd7bc0baef0 0x7fd7bc147670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:36540/0 (socket says 172.21.15.31:36540) 2024-04-15T00:21:19.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.938+0000 7fd7c0ffc640 1 -- 172.21.15.31:0/1433227865 learned_addr learned my addr 172.21.15.31:0/1433227865 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:19.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.938+0000 7fd7c17fd640 1 --2- 172.21.15.31:0/1433227865 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd7bc0b8bf0 0x7fd7bc153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:19.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.938+0000 7fd7bb7fe640 1 -- 172.21.15.31:0/1433227865 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3713053429 0 0) 0x7fd7bc0bb2d0 con 0x7fd7bc0baef0 2024-04-15T00:21:19.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.938+0000 7fd7bb7fe640 1 -- 172.21.15.31:0/1433227865 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7a4003520 con 0x7fd7bc0baef0 2024-04-15T00:21:19.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.938+0000 7fd7bb7fe640 1 -- 172.21.15.31:0/1433227865 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 915973057 0 0) 0x7fd7bc14ae00 con 0x7fd7bc14b8e0 2024-04-15T00:21:19.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.938+0000 7fd7bb7fe640 1 -- 172.21.15.31:0/1433227865 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7bc0bb2d0 con 0x7fd7bc14b8e0 2024-04-15T00:21:19.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.938+0000 7fd7c17fd640 1 -- 172.21.15.31:0/1433227865 >> v1:172.21.15.50:6789/0 conn(0x7fd7bc14b8e0 legacy=0x7fd7bc0b9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:19.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.938+0000 7fd7c17fd640 1 -- 172.21.15.31:0/1433227865 >> v1:172.21.15.31:6789/0 conn(0x7fd7bc0baef0 legacy=0x7fd7bc147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:19.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.938+0000 7fd7c17fd640 1 -- 172.21.15.31:0/1433227865 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7bc0bcbb0 con 0x7fd7bc0b8bf0 2024-04-15T00:21:19.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.939+0000 7fd7c17fd640 1 --2- 172.21.15.31:0/1433227865 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd7bc0b8bf0 0x7fd7bc153000 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac0097d0 tx=0x7fd7ac02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fd84fe30569fb96 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:19.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.939+0000 7fd7bb7fe640 1 -- 172.21.15.31:0/1433227865 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac035020 con 0x7fd7bc0b8bf0 2024-04-15T00:21:19.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.939+0000 7fd7bb7fe640 1 -- 172.21.15.31:0/1433227865 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7ac031800 con 0x7fd7bc0b8bf0 2024-04-15T00:21:19.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.939+0000 7fd7bb7fe640 1 -- 172.21.15.31:0/1433227865 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac031bd0 con 0x7fd7bc0b8bf0 2024-04-15T00:21:19.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.940+0000 7fd7c3260640 1 -- 172.21.15.31:0/1433227865 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd7bc0b8bf0 msgr2=0x7fd7bc153000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:19.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.940+0000 7fd7c3260640 1 --2- 172.21.15.31:0/1433227865 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd7bc0b8bf0 0x7fd7bc153000 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac0097d0 tx=0x7fd7ac02b8a0 comp rx=0 tx=0).stop 2024-04-15T00:21:19.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.940+0000 7fd7c3260640 1 -- 172.21.15.31:0/1433227865 shutdown_connections 2024-04-15T00:21:19.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.940+0000 7fd7c3260640 1 --2- 172.21.15.31:0/1433227865 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd7bc0b8bf0 0x7fd7bc153000 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:19.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.940+0000 7fd7c3260640 1 -- 172.21.15.31:0/1433227865 >> 172.21.15.31:0/1433227865 conn(0x7fd7bc09ed70 msgr2=0x7fd7bc09f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:19.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.940+0000 7fd7c3260640 1 -- 172.21.15.31:0/1433227865 shutdown_connections 2024-04-15T00:21:19.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.940+0000 7fd7c3260640 1 -- 172.21.15.31:0/1433227865 wait complete. 2024-04-15T00:21:19.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.941+0000 7fd7c3260640 1 Processor -- start 2024-04-15T00:21:19.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.941+0000 7fd7c3260640 1 -- start start 2024-04-15T00:21:19.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.942+0000 7fd7c3260640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd7bc0b8bf0 0x7fd7bc139dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:19.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.942+0000 7fd7c3260640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7bc0baef0 0x7fd7bc144d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:19.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.942+0000 7fd7c3260640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7bc14b8e0 0x7fd7bc141f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:19.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.942+0000 7fd7c3260640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd7bc153540 con 0x7fd7bc14b8e0 2024-04-15T00:21:19.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.942+0000 7fd7c3260640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd7bc0b92d0 con 0x7fd7bc0baef0 2024-04-15T00:21:19.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.942+0000 7fd7c3260640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fd7bc1536c0 con 0x7fd7bc0b8bf0 2024-04-15T00:21:19.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.942+0000 7fd7c17fd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7bc14b8e0 0x7fd7bc141f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:19.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.942+0000 7fd7c17fd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7bc14b8e0 0x7fd7bc141f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50124/0 (socket says 172.21.15.31:50124) 2024-04-15T00:21:19.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.942+0000 7fd7c17fd640 1 -- 172.21.15.31:0/287226104 learned_addr learned my addr 172.21.15.31:0/287226104 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:19.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.942+0000 7fd7c0ffc640 1 --2- 172.21.15.31:0/287226104 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd7bc0b8bf0 0x7fd7bc139dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:19.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.942+0000 7fd7bbfff640 1 --2- 172.21.15.31:0/287226104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7bc0baef0 0x7fd7bc144d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:19.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.942+0000 7fd7c17fd640 1 -- 172.21.15.31:0/287226104 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd7bc0b8bf0 msgr2=0x7fd7bc139dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:19.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.942+0000 7fd7c17fd640 1 --2- 172.21.15.31:0/287226104 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd7bc0b8bf0 0x7fd7bc139dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:19.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.942+0000 7fd7c17fd640 1 -- 172.21.15.31:0/287226104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7bc0baef0 msgr2=0x7fd7bc144d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:19.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.942+0000 7fd7c17fd640 1 --2- 172.21.15.31:0/287226104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7bc0baef0 0x7fd7bc144d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:19.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.942+0000 7fd7c17fd640 1 -- 172.21.15.31:0/287226104 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7bc1452b0 con 0x7fd7bc14b8e0 2024-04-15T00:21:19.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.942+0000 7fd7bbfff640 1 --2- 172.21.15.31:0/287226104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7bc0baef0 0x7fd7bc144d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:19.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.942+0000 7fd7c17fd640 1 --2- 172.21.15.31:0/287226104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7bc14b8e0 0x7fd7bc141f60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac034040 tx=0x7fd7ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:19.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.942+0000 7fd7b97fa640 1 -- 172.21.15.31:0/287226104 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac040070 con 0x7fd7bc14b8e0 2024-04-15T00:21:19.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.942+0000 7fd7b97fa640 1 -- 172.21.15.31:0/287226104 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7ac031e30 con 0x7fd7bc14b8e0 2024-04-15T00:21:19.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.942+0000 7fd7b97fa640 1 -- 172.21.15.31:0/287226104 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac035040 con 0x7fd7bc14b8e0 2024-04-15T00:21:19.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.942+0000 7fd7c3260640 1 -- 172.21.15.31:0/287226104 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7bc143d90 con 0x7fd7bc14b8e0 2024-04-15T00:21:19.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.943+0000 7fd7c3260640 1 -- 172.21.15.31:0/287226104 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7bc13a820 con 0x7fd7bc14b8e0 2024-04-15T00:21:19.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.943+0000 7fd7c3260640 1 -- 172.21.15.31:0/287226104 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7bc04f620 con 0x7fd7bc14b8e0 2024-04-15T00:21:19.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.944+0000 7fd7b97fa640 1 -- 172.21.15.31:0/287226104 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fd7ac04b060 con 0x7fd7bc14b8e0 2024-04-15T00:21:19.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.944+0000 7fd7b97fa640 1 --2- 172.21.15.31:0/287226104 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fd7a806b990 0x7fd7a806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:19.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.944+0000 7fd7b97fa640 1 -- 172.21.15.31:0/287226104 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd7ac0ac500 con 0x7fd7bc14b8e0 2024-04-15T00:21:19.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.944+0000 7fd7c0ffc640 1 --2- 172.21.15.31:0/287226104 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fd7a806b990 0x7fd7a806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:19.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.945+0000 7fd7c0ffc640 1 --2- 172.21.15.31:0/287226104 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fd7a806b990 0x7fd7a806de50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd7b40012e0 tx=0x7fd7b4001ad0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:19.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:19.948+0000 7fd7b97fa640 1 -- 172.21.15.31:0/287226104 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd7ac07adc0 con 0x7fd7bc14b8e0 2024-04-15T00:21:20.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.130+0000 7fd7c3260640 1 -- 172.21.15.31:0/287226104 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd7bc071f30 con 0x7fd7bc14b8e0 2024-04-15T00:21:20.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.131+0000 7fd7b97fa640 1 -- 172.21.15.31:0/287226104 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7fd7ac07a6c0 con 0x7fd7bc14b8e0 2024-04-15T00:21:20.139 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:21:20.139 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"fsid":"b57c03ab-2810-4ea5-b233-6164468328c0","created":"2024-04-15T00:20:44.073217+0000","modified":"2024-04-15T00:21:12.971956+0000","last_up_change":"2024-04-15T00:20:55.515596+0000","last_in_change":"2024-04-15T00:20:46.364541+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:20:56.423161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:21:06.436169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:21:06.888505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:21:10.610300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b085a2f4-5565-4ccc-a98e-e56180791550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6817","nonce":2355720818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6819","nonce":2355720818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6823","nonce":2355720818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6821","nonce":2355720818}]},"public_addr":"172.21.15.31:6817/2355720818","cluster_addr":"172.21.15.31:6819/2355720818","heartbeat_back_addr":"172.21.15.31:6823/2355720818","heartbeat_front_addr":"172.21.15.31:6821/2355720818","state":["exists","up"]},{"osd":1,"uuid":"0f751557-3f18-464f-8b78-614d19549f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6809","nonce":2705297130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6811","nonce":2705297130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6815","nonce":2705297130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6813","nonce":2705297130}]},"public_addr":"172.21.15.31:6809/2705297130","cluster_addr":"172.21.15.31:6811/2705297130","heartbeat_back_addr":"172.21.15.31:6815/2705297130","heartbeat_front_addr":"172.21.15.31:6813/2705297130","state":["exists","up"]},{"osd":2,"uuid":"17371b09-2bd7-4ef7-926f-e7706319f064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6801","nonce":225061474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6803","nonce":225061474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6807","nonce":225061474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6805","nonce":225061474}]},"public_addr":"172.21.15.31:6801/225061474","cluster_addr":"172.21.15.31:6803/225061474","heartbeat_back_addr":"172.21.15.31:6807/225061474","heartbeat_front_addr":"172.21.15.31:6805/225061474","state":["exists","up"]},{"osd":3,"uuid":"315b6949-f009-4291-9581-aa4912642dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6825","nonce":3722449780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6827","nonce":3722449780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6831","nonce":3722449780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6829","nonce":3722449780}]},"public_addr":"172.21.15.31:6825/3722449780","cluster_addr":"172.21.15.31:6827/3722449780","heartbeat_back_addr":"172.21.15.31:6831/3722449780","heartbeat_front_addr":"172.21.15.31:6829/3722449780","state":["exists","up"]},{"osd":4,"uuid":"e3659369-cc78-4aa8-bd10-a199d4a1569d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6801","nonce":1279970071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6803","nonce":1279970071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6807","nonce":1279970071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6805","nonce":1279970071}]},"public_addr":"172.21.15.50:6801/1279970071","cluster_addr":"172.21.15.50:6803/1279970071","heartbeat_back_addr":"172.21.15.50:6807/1279970071","heartbeat_front_addr":"172.21.15.50:6805/1279970071","state":["exists","up"]},{"osd":5,"uuid":"35c3a4c0-0b45-45d2-85b9-301c347602f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6809","nonce":1589417182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6811","nonce":1589417182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6815","nonce":1589417182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6813","nonce":1589417182}]},"public_addr":"172.21.15.50:6809/1589417182","cluster_addr":"172.21.15.50:6811/1589417182","heartbeat_back_addr":"172.21.15.50:6815/1589417182","heartbeat_front_addr":"172.21.15.50:6813/1589417182","state":["exists","up"]},{"osd":6,"uuid":"20df7a76-245f-4946-9624-6ca9e949227b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6817","nonce":682288274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6819","nonce":682288274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6823","nonce":682288274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6821","nonce":682288274}]},"public_addr":"172.21.15.50:6817/682288274","cluster_addr":"172.21.15.50:6819/682288274","heartbeat_back_addr":"172.21.15.50:6823/682288274","heartbeat_front_addr":"172.21.15.50:6821/682288274","state":["exists","up"]},{"osd":7,"uuid":"95a504b7-e13a-49e6-8484-9dff4d5fc048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6825","nonce":4129060906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6827","nonce":4129060906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6831","nonce":4129060906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6829","nonce":4129060906}]},"public_addr":"172.21.15.50:6825/4129060906","cluster_addr":"172.21.15.50:6827/4129060906","heartbeat_back_addr":"172.21.15.50:6831/4129060906","heartbeat_front_addr":"172.21.15.50:6829/4129060906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.501980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.529961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.540913+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.521396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.448364+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.514136+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.527229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.508950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:21:20.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.133+0000 7fd7c3260640 1 -- 172.21.15.31:0/287226104 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fd7a806b990 msgr2=0x7fd7a806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:20.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.133+0000 7fd7c3260640 1 --2- 172.21.15.31:0/287226104 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fd7a806b990 0x7fd7a806de50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd7b40012e0 tx=0x7fd7b4001ad0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.133+0000 7fd7c3260640 1 -- 172.21.15.31:0/287226104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7bc14b8e0 msgr2=0x7fd7bc141f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:20.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.133+0000 7fd7c3260640 1 --2- 172.21.15.31:0/287226104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7bc14b8e0 0x7fd7bc141f60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac034040 tx=0x7fd7ac0046c0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.133+0000 7fd7c3260640 1 -- 172.21.15.31:0/287226104 shutdown_connections 2024-04-15T00:21:20.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.133+0000 7fd7c3260640 1 --2- 172.21.15.31:0/287226104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7bc14b8e0 0x7fd7bc141f60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.133+0000 7fd7c3260640 1 --2- 172.21.15.31:0/287226104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7bc0baef0 0x7fd7bc144d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.133+0000 7fd7c3260640 1 --2- 172.21.15.31:0/287226104 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fd7a806b990 0x7fd7a806de50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.133+0000 7fd7c3260640 1 --2- 172.21.15.31:0/287226104 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd7bc0b8bf0 0x7fd7bc139dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.133+0000 7fd7c3260640 1 -- 172.21.15.31:0/287226104 >> 172.21.15.31:0/287226104 conn(0x7fd7bc09ed70 msgr2=0x7fd7bc1468b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:20.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.133+0000 7fd7c3260640 1 -- 172.21.15.31:0/287226104 shutdown_connections 2024-04-15T00:21:20.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.133+0000 7fd7c3260640 1 -- 172.21.15.31:0/287226104 wait complete. 2024-04-15T00:21:20.151 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T00:20:56.423161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T00:21:06.436169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T00:21:06.888505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-15T00:21:10.610300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-15T00:21:20.151 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T00:21:20.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.248+0000 7fa48cade640 1 Processor -- start 2024-04-15T00:21:20.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.248+0000 7fa48cade640 1 -- start start 2024-04-15T00:21:20.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.249+0000 7fa48cade640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa48806e1d0 0x7fa4880b1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:20.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.249+0000 7fa48cade640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4880b6800 0x7fa48814fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:20.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.249+0000 7fa48cade640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa488072a70 con 0x7fa488072690 2024-04-15T00:21:20.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.249+0000 7fa48cade640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fa4880b6c90 con 0x7fa48806e1d0 2024-04-15T00:21:20.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.249+0000 7fa48cade640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fa48806ebe0 con 0x7fa4880b6800 2024-04-15T00:21:20.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.249+0000 7fa485d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa48806e1d0 0x7fa4880b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:20.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.249+0000 7fa486d9d640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4880b6800 0x7fa48814fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:20.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.249+0000 7fa485d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa48806e1d0 0x7fa4880b1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.31:39844/0 (socket says 172.21.15.31:39844) 2024-04-15T00:21:20.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.249+0000 7fa485d9b640 1 -- 172.21.15.31:0/3515171625 learned_addr learned my addr 172.21.15.31:0/3515171625 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:20.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.249+0000 7fa48659c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa488072690 0x7fa48809fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.31:49768/0 (socket says 172.21.15.31:49768) 2024-04-15T00:21:20.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.249+0000 7fa485d9b640 1 -- 172.21.15.31:0/3515171625 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4880b6800 msgr2=0x7fa48814fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:20.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.249+0000 7fa485d9b640 1 --2- 172.21.15.31:0/3515171625 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4880b6800 0x7fa48814fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.249+0000 7fa485d9b640 1 -- 172.21.15.31:0/3515171625 >> v1:172.21.15.50:6789/0 conn(0x7fa488072690 legacy=0x7fa48809fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:20.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.249+0000 7fa485d9b640 1 -- 172.21.15.31:0/3515171625 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa48806eec0 con 0x7fa48806e1d0 2024-04-15T00:21:20.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.250+0000 7fa485d9b640 1 --2- 172.21.15.31:0/3515171625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa48806e1d0 0x7fa4880b1770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa47c009870 tx=0x7fa47c02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e01a4cefbcfc83bd server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:20.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.250+0000 7fa48559a640 1 -- 172.21.15.31:0/3515171625 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47c035020 con 0x7fa48806e1d0 2024-04-15T00:21:20.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.250+0000 7fa48559a640 1 -- 172.21.15.31:0/3515171625 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa47c031640 con 0x7fa48806e1d0 2024-04-15T00:21:20.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.250+0000 7fa48559a640 1 -- 172.21.15.31:0/3515171625 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47c02d040 con 0x7fa48806e1d0 2024-04-15T00:21:20.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.251+0000 7fa48cade640 1 -- 172.21.15.31:0/3515171625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa48806e1d0 msgr2=0x7fa4880b1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:20.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.251+0000 7fa48cade640 1 --2- 172.21.15.31:0/3515171625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa48806e1d0 0x7fa4880b1770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa47c009870 tx=0x7fa47c02b8f0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.251+0000 7fa48cade640 1 -- 172.21.15.31:0/3515171625 shutdown_connections 2024-04-15T00:21:20.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.251+0000 7fa48cade640 1 --2- 172.21.15.31:0/3515171625 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4880b6800 0x7fa48814fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.251+0000 7fa48cade640 1 --2- 172.21.15.31:0/3515171625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa48806e1d0 0x7fa4880b1770 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.251+0000 7fa48cade640 1 -- 172.21.15.31:0/3515171625 >> 172.21.15.31:0/3515171625 conn(0x7fa4880b7840 msgr2=0x7fa4880b7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:20.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.251+0000 7fa48cade640 1 -- 172.21.15.31:0/3515171625 shutdown_connections 2024-04-15T00:21:20.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.251+0000 7fa48cade640 1 -- 172.21.15.31:0/3515171625 wait complete. 2024-04-15T00:21:20.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.252+0000 7fa48cade640 1 Processor -- start 2024-04-15T00:21:20.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.252+0000 7fa48cade640 1 -- start start 2024-04-15T00:21:20.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.253+0000 7fa48cade640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa48806e1d0 0x7fa4881d06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:20.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.253+0000 7fa48cade640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa488072690 0x7fa4881db1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:20.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.253+0000 7fa48cade640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4881454e0 0x7fa488145990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:20.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.253+0000 7fa48cade640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa4880b75d0 con 0x7fa48806e1d0 2024-04-15T00:21:20.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.253+0000 7fa48cade640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa4880b7450 con 0x7fa4881454e0 2024-04-15T00:21:20.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.253+0000 7fa48cade640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fa4880b1cb0 con 0x7fa488072690 2024-04-15T00:21:20.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.253+0000 7fa48659c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa48806e1d0 0x7fa4881d06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:20.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.253+0000 7fa48659c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa48806e1d0 0x7fa4881d06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50130/0 (socket says 172.21.15.31:50130) 2024-04-15T00:21:20.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.253+0000 7fa48659c640 1 -- 172.21.15.31:0/4272904623 learned_addr learned my addr 172.21.15.31:0/4272904623 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:20.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.253+0000 7fa485d9b640 1 --2- 172.21.15.31:0/4272904623 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa488072690 0x7fa4881db1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:20.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.253+0000 7fa486d9d640 1 --2- 172.21.15.31:0/4272904623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4881454e0 0x7fa488145990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:20.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.253+0000 7fa48659c640 1 -- 172.21.15.31:0/4272904623 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa488072690 msgr2=0x7fa4881db1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:20.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.253+0000 7fa48659c640 1 --2- 172.21.15.31:0/4272904623 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa488072690 0x7fa4881db1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.253+0000 7fa48659c640 1 -- 172.21.15.31:0/4272904623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4881454e0 msgr2=0x7fa488145990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:20.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.253+0000 7fa48659c640 1 --2- 172.21.15.31:0/4272904623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4881454e0 0x7fa488145990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.253+0000 7fa48659c640 1 -- 172.21.15.31:0/4272904623 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4881cf6d0 con 0x7fa48806e1d0 2024-04-15T00:21:20.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.253+0000 7fa48659c640 1 --2- 172.21.15.31:0/4272904623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa48806e1d0 0x7fa4881d06e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa47800c400 tx=0x7fa47800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:20.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.253+0000 7fa476ffd640 1 -- 172.21.15.31:0/4272904623 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa478017070 con 0x7fa48806e1d0 2024-04-15T00:21:20.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.253+0000 7fa476ffd640 1 -- 172.21.15.31:0/4272904623 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa478005c70 con 0x7fa48806e1d0 2024-04-15T00:21:20.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.253+0000 7fa48cade640 1 -- 172.21.15.31:0/4272904623 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa488143250 con 0x7fa48806e1d0 2024-04-15T00:21:20.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.253+0000 7fa476ffd640 1 -- 172.21.15.31:0/4272904623 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4780072d0 con 0x7fa48806e1d0 2024-04-15T00:21:20.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.254+0000 7fa48cade640 1 -- 172.21.15.31:0/4272904623 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4881ce990 con 0x7fa48806e1d0 2024-04-15T00:21:20.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.255+0000 7fa48cade640 1 -- 172.21.15.31:0/4272904623 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4880b99b0 con 0x7fa48806e1d0 2024-04-15T00:21:20.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.255+0000 7fa476ffd640 1 -- 172.21.15.31:0/4272904623 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fa47801a070 con 0x7fa48806e1d0 2024-04-15T00:21:20.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.255+0000 7fa476ffd640 1 --2- 172.21.15.31:0/4272904623 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fa46806b990 0x7fa46806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:20.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.255+0000 7fa476ffd640 1 -- 172.21.15.31:0/4272904623 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa478089df0 con 0x7fa48806e1d0 2024-04-15T00:21:20.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.255+0000 7fa485d9b640 1 --2- 172.21.15.31:0/4272904623 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fa46806b990 0x7fa46806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:20.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.256+0000 7fa485d9b640 1 --2- 172.21.15.31:0/4272904623 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fa46806b990 0x7fa46806de50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa47c036000 tx=0x7fa47c03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:20.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.259+0000 7fa476ffd640 1 -- 172.21.15.31:0/4272904623 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa4880b99b0 con 0x7fa48806e1d0 2024-04-15T00:21:20.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.440+0000 7fa48cade640 1 -- 172.21.15.31:0/4272904623 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa4881cf930 con 0x7fa48806e1d0 2024-04-15T00:21:20.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.440+0000 7fa476ffd640 1 -- 172.21.15.31:0/4272904623 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7fa478005e20 con 0x7fa48806e1d0 2024-04-15T00:21:20.447 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-15T00:21:20.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.442+0000 7fa48cade640 1 -- 172.21.15.31:0/4272904623 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fa46806b990 msgr2=0x7fa46806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:20.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.442+0000 7fa48cade640 1 --2- 172.21.15.31:0/4272904623 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fa46806b990 0x7fa46806de50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa47c036000 tx=0x7fa47c03c040 comp rx=0 tx=0).stop 2024-04-15T00:21:20.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.442+0000 7fa48cade640 1 -- 172.21.15.31:0/4272904623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa48806e1d0 msgr2=0x7fa4881d06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:20.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.442+0000 7fa48cade640 1 --2- 172.21.15.31:0/4272904623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa48806e1d0 0x7fa4881d06e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa47800c400 tx=0x7fa47800c8c0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.442+0000 7fa48cade640 1 -- 172.21.15.31:0/4272904623 shutdown_connections 2024-04-15T00:21:20.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.442+0000 7fa48cade640 1 --2- 172.21.15.31:0/4272904623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4881454e0 0x7fa488145990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.442+0000 7fa48cade640 1 --2- 172.21.15.31:0/4272904623 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fa46806b990 0x7fa46806de50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.442+0000 7fa48cade640 1 --2- 172.21.15.31:0/4272904623 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa488072690 0x7fa4881db1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.442+0000 7fa48cade640 1 --2- 172.21.15.31:0/4272904623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa48806e1d0 0x7fa4881d06e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.442+0000 7fa48cade640 1 -- 172.21.15.31:0/4272904623 >> 172.21.15.31:0/4272904623 conn(0x7fa4880b7840 msgr2=0x7fa4880b60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:20.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.442+0000 7fa48cade640 1 -- 172.21.15.31:0/4272904623 shutdown_connections 2024-04-15T00:21:20.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.442+0000 7fa48cade640 1 -- 172.21.15.31:0/4272904623 wait complete. 2024-04-15T00:21:20.460 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T00:21:20.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.556+0000 7faeb9ea6640 1 Processor -- start 2024-04-15T00:21:20.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.556+0000 7faeb9ea6640 1 -- start start 2024-04-15T00:21:20.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.557+0000 7faeb9ea6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faeb4072660 0x7faeb40b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:20.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.557+0000 7faeb9ea6640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faeb4145700 0x7faeb4145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:20.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.557+0000 7faeb9ea6640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faeb4072a40 con 0x7faeb40b1cf0 2024-04-15T00:21:20.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.557+0000 7faeb9ea6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7faeb40b6fd0 con 0x7faeb4072660 2024-04-15T00:21:20.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.557+0000 7faeb9ea6640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7faeb41460f0 con 0x7faeb4145700 2024-04-15T00:21:20.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.557+0000 7faeb2ffd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7faeb40b1cf0 0x7faeb406e9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:36550/0 (socket says 172.21.15.31:36550) 2024-04-15T00:21:20.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.557+0000 7faeb2ffd640 1 -- 172.21.15.31:0/3782598984 learned_addr learned my addr 172.21.15.31:0/3782598984 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:20.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.557+0000 7faeb37fe640 1 --2- 172.21.15.31:0/3782598984 >> v2:172.21.15.50:3300/0 conn(0x7faeb4072660 0x7faeb40b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:20.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.557+0000 7faeb27fc640 1 -- 172.21.15.31:0/3782598984 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3381390171 0 0) 0x7faeb4072a40 con 0x7faeb40b1cf0 2024-04-15T00:21:20.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.558+0000 7faeb27fc640 1 -- 172.21.15.31:0/3782598984 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae9c003520 con 0x7faeb40b1cf0 2024-04-15T00:21:20.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.558+0000 7faeb3fff640 1 --2- 172.21.15.31:0/3782598984 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faeb4145700 0x7faeb4145bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:20.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.558+0000 7faeb27fc640 1 -- 172.21.15.31:0/3782598984 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1197037732 0 0) 0x7fae9c003520 con 0x7faeb40b1cf0 2024-04-15T00:21:20.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.558+0000 7faeb27fc640 1 -- 172.21.15.31:0/3782598984 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faeb4145700 msgr2=0x7faeb4145bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:20.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.558+0000 7faeb27fc640 1 --2- 172.21.15.31:0/3782598984 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faeb4145700 0x7faeb4145bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.558+0000 7faeb27fc640 1 -- 172.21.15.31:0/3782598984 >> v2:172.21.15.50:3300/0 conn(0x7faeb4072660 msgr2=0x7faeb40b17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:20.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.558+0000 7faeb27fc640 1 --2- 172.21.15.31:0/3782598984 >> v2:172.21.15.50:3300/0 conn(0x7faeb4072660 0x7faeb40b17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.558+0000 7faeb27fc640 1 -- 172.21.15.31:0/3782598984 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb406e210 con 0x7faeb40b1cf0 2024-04-15T00:21:20.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.558+0000 7faeb27fc640 1 -- 172.21.15.31:0/3782598984 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 697057150 0 0) 0x7faea8001670 con 0x7faeb40b1cf0 2024-04-15T00:21:20.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.558+0000 7faeb27fc640 1 -- 172.21.15.31:0/3782598984 >> v1:172.21.15.31:6789/0 conn(0x7faeb40b1cf0 legacy=0x7faeb406e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:20.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.558+0000 7faeb27fc640 1 --2- 172.21.15.31:0/3782598984 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faeb4145700 0x7fae9c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:20.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.558+0000 7faeb27fc640 1 --2- 172.21.15.31:0/3782598984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae9c003f30 0x7fae9c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:20.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.558+0000 7faeb27fc640 1 --2- 172.21.15.31:0/3782598984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae9c004d40 0x7fae9c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:20.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.558+0000 7faeb27fc640 1 -- 172.21.15.31:0/3782598984 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7faeb40b6fd0 con 0x7fae9c004d40 2024-04-15T00:21:20.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.558+0000 7faeb27fc640 1 -- 172.21.15.31:0/3782598984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7faeb41460f0 con 0x7fae9c003f30 2024-04-15T00:21:20.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.558+0000 7faeb27fc640 1 -- 172.21.15.31:0/3782598984 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fae9c00ba10 con 0x7faeb4145700 2024-04-15T00:21:20.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.558+0000 7faeb3fff640 1 --2- 172.21.15.31:0/3782598984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae9c004d40 0x7fae9c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:20.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.558+0000 7faeb37fe640 1 --2- 172.21.15.31:0/3782598984 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faeb4145700 0x7fae9c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:20.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.558+0000 7faeb2ffd640 1 --2- 172.21.15.31:0/3782598984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae9c003f30 0x7fae9c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:20.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.558+0000 7faeb3fff640 1 -- 172.21.15.31:0/3782598984 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faeb4145700 msgr2=0x7fae9c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:20.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.558+0000 7faeb3fff640 1 --2- 172.21.15.31:0/3782598984 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faeb4145700 0x7fae9c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.558+0000 7faeb3fff640 1 -- 172.21.15.31:0/3782598984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae9c003f30 msgr2=0x7fae9c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:20.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.558+0000 7faeb3fff640 1 --2- 172.21.15.31:0/3782598984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae9c003f30 0x7fae9c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.558+0000 7faeb3fff640 1 -- 172.21.15.31:0/3782598984 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae9c003520 con 0x7fae9c004d40 2024-04-15T00:21:20.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.559+0000 7faeb3fff640 1 --2- 172.21.15.31:0/3782598984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae9c004d40 0x7fae9c0051c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faeac00e170 tx=0x7fae9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d0252b1d310b96 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:20.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.559+0000 7faeb27fc640 1 -- 172.21.15.31:0/3782598984 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeac039070 con 0x7fae9c004d40 2024-04-15T00:21:20.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.559+0000 7faeb27fc640 1 -- 172.21.15.31:0/3782598984 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeac02cbf0 con 0x7fae9c004d40 2024-04-15T00:21:20.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.559+0000 7faeb27fc640 1 -- 172.21.15.31:0/3782598984 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeac009c10 con 0x7fae9c004d40 2024-04-15T00:21:20.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.560+0000 7faeb9ea6640 1 -- 172.21.15.31:0/3782598984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae9c004d40 msgr2=0x7fae9c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:20.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.560+0000 7faeb9ea6640 1 --2- 172.21.15.31:0/3782598984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae9c004d40 0x7fae9c0051c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faeac00e170 tx=0x7fae9c005830 comp rx=0 tx=0).stop 2024-04-15T00:21:20.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.560+0000 7faeb3fff640 1 -- 172.21.15.31:0/3782598984 reap_dead start 2024-04-15T00:21:20.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.560+0000 7faeb9ea6640 1 -- 172.21.15.31:0/3782598984 shutdown_connections 2024-04-15T00:21:20.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.560+0000 7faeb9ea6640 1 -- 172.21.15.31:0/3782598984 >> 172.21.15.31:0/3782598984 conn(0x7faeb40b7840 msgr2=0x7faeb40b7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:20.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.560+0000 7faeb9ea6640 1 -- 172.21.15.31:0/3782598984 shutdown_connections 2024-04-15T00:21:20.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.560+0000 7faeb9ea6640 1 -- 172.21.15.31:0/3782598984 wait complete. 2024-04-15T00:21:20.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.561+0000 7faeb9ea6640 1 Processor -- start 2024-04-15T00:21:20.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.561+0000 7faeb9ea6640 1 -- start start 2024-04-15T00:21:20.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.562+0000 7faeb9ea6640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faeb41de290 0x7faeb4141ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:20.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.562+0000 7faeb9ea6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faeb41de670 0x7faeb413aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:20.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.562+0000 7faeb9ea6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faeb413b3e0 0x7faeb41daab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:20.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.562+0000 7faeb9ea6640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7faeb406f0b0 con 0x7faeb413b3e0 2024-04-15T00:21:20.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.562+0000 7faeb9ea6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7faeb40b6c60 con 0x7faeb41de670 2024-04-15T00:21:20.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.562+0000 7faeb9ea6640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7faeb4145bb0 con 0x7faeb41de290 2024-04-15T00:21:20.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.562+0000 7faeb3fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faeb413b3e0 0x7faeb41daab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:20.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.562+0000 7faeb3fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faeb413b3e0 0x7faeb41daab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50158/0 (socket says 172.21.15.31:50158) 2024-04-15T00:21:20.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.562+0000 7faeb3fff640 1 -- 172.21.15.31:0/4188108906 learned_addr learned my addr 172.21.15.31:0/4188108906 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:20.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.562+0000 7faeb37fe640 1 --2- 172.21.15.31:0/4188108906 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faeb41de290 0x7faeb4141ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:20.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.562+0000 7faeb2ffd640 1 --2- 172.21.15.31:0/4188108906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faeb41de670 0x7faeb413aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:20.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.562+0000 7faeb3fff640 1 -- 172.21.15.31:0/4188108906 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faeb41de290 msgr2=0x7faeb4141ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:20.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.562+0000 7faeb3fff640 1 --2- 172.21.15.31:0/4188108906 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faeb41de290 0x7faeb4141ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.562+0000 7faeb3fff640 1 -- 172.21.15.31:0/4188108906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faeb41de670 msgr2=0x7faeb413aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:20.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.562+0000 7faeb3fff640 1 --2- 172.21.15.31:0/4188108906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faeb41de670 0x7faeb413aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.562+0000 7faeb3fff640 1 -- 172.21.15.31:0/4188108906 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb4142c70 con 0x7faeb413b3e0 2024-04-15T00:21:20.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.562+0000 7faeb3fff640 1 --2- 172.21.15.31:0/4188108906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faeb413b3e0 0x7faeb41daab0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faeac00e170 tx=0x7faeac009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:20.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.562+0000 7fae9bfff640 1 -- 172.21.15.31:0/4188108906 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeac039030 con 0x7faeb413b3e0 2024-04-15T00:21:20.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.562+0000 7fae9bfff640 1 -- 172.21.15.31:0/4188108906 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeac043070 con 0x7faeb413b3e0 2024-04-15T00:21:20.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.562+0000 7faeb9ea6640 1 -- 172.21.15.31:0/4188108906 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faeb4142ee0 con 0x7faeb413b3e0 2024-04-15T00:21:20.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.562+0000 7fae9bfff640 1 -- 172.21.15.31:0/4188108906 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeac009c10 con 0x7faeb413b3e0 2024-04-15T00:21:20.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.562+0000 7faeb9ea6640 1 -- 172.21.15.31:0/4188108906 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeb41411e0 con 0x7faeb413b3e0 2024-04-15T00:21:20.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.563+0000 7faeb9ea6640 1 -- 172.21.15.31:0/4188108906 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faeb404f540 con 0x7faeb413b3e0 2024-04-15T00:21:20.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.564+0000 7fae9bfff640 1 -- 172.21.15.31:0/4188108906 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7faeac005d10 con 0x7faeb413b3e0 2024-04-15T00:21:20.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.564+0000 7fae9bfff640 1 --2- 172.21.15.31:0/4188108906 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7faea006b9c0 0x7faea006de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:20.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.564+0000 7fae9bfff640 1 -- 172.21.15.31:0/4188108906 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7faeac0acaf0 con 0x7faeb413b3e0 2024-04-15T00:21:20.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.564+0000 7faeb37fe640 1 --2- 172.21.15.31:0/4188108906 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7faea006b9c0 0x7faea006de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:20.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.565+0000 7faeb37fe640 1 --2- 172.21.15.31:0/4188108906 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7faea006b9c0 0x7faea006de80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faea4009c40 tx=0x7faea4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:20.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.568+0000 7fae9bfff640 1 -- 172.21.15.31:0/4188108906 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7faeac07b510 con 0x7faeb413b3e0 2024-04-15T00:21:20.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.753+0000 7faeb9ea6640 1 -- 172.21.15.31:0/4188108906 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7faeb40b74d0 con 0x7faeb413b3e0 2024-04-15T00:21:20.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.753+0000 7fae9bfff640 1 -- 172.21.15.31:0/4188108906 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7faeac07ae10 con 0x7faeb413b3e0 2024-04-15T00:21:20.761 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-15T00:21:20.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.755+0000 7faeb9ea6640 1 -- 172.21.15.31:0/4188108906 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7faea006b9c0 msgr2=0x7faea006de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:20.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.755+0000 7faeb9ea6640 1 --2- 172.21.15.31:0/4188108906 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7faea006b9c0 0x7faea006de80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faea4009c40 tx=0x7faea4009190 comp rx=0 tx=0).stop 2024-04-15T00:21:20.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.755+0000 7faeb9ea6640 1 -- 172.21.15.31:0/4188108906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faeb413b3e0 msgr2=0x7faeb41daab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:20.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.755+0000 7faeb9ea6640 1 --2- 172.21.15.31:0/4188108906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faeb413b3e0 0x7faeb41daab0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faeac00e170 tx=0x7faeac009750 comp rx=0 tx=0).stop 2024-04-15T00:21:20.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.755+0000 7faeb9ea6640 1 -- 172.21.15.31:0/4188108906 shutdown_connections 2024-04-15T00:21:20.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.755+0000 7faeb9ea6640 1 --2- 172.21.15.31:0/4188108906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faeb413b3e0 0x7faeb41daab0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.755+0000 7faeb9ea6640 1 --2- 172.21.15.31:0/4188108906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faeb41de670 0x7faeb413aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.755+0000 7faeb9ea6640 1 --2- 172.21.15.31:0/4188108906 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7faea006b9c0 0x7faea006de80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.755+0000 7faeb9ea6640 1 --2- 172.21.15.31:0/4188108906 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7faeb41de290 0x7faeb4141ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.755+0000 7faeb9ea6640 1 -- 172.21.15.31:0/4188108906 >> 172.21.15.31:0/4188108906 conn(0x7faeb40b7840 msgr2=0x7faeb4143500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:20.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.755+0000 7faeb9ea6640 1 -- 172.21.15.31:0/4188108906 shutdown_connections 2024-04-15T00:21:20.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.755+0000 7faeb9ea6640 1 -- 172.21.15.31:0/4188108906 wait complete. 2024-04-15T00:21:20.773 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T00:21:20.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.870+0000 7f5d0dbfa640 1 Processor -- start 2024-04-15T00:21:20.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.870+0000 7f5d0dbfa640 1 -- start start 2024-04-15T00:21:20.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.871+0000 7f5d0dbfa640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5d08072690 0x7f5d0814ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:20.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.871+0000 7f5d0dbfa640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5d0806fde0 0x7f5d0814b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:20.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.871+0000 7f5d0dbfa640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d08072a70 con 0x7f5d081414a0 2024-04-15T00:21:20.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.871+0000 7f5d0dbfa640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f5d0806efa0 con 0x7f5d0806fde0 2024-04-15T00:21:20.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.871+0000 7f5d0dbfa640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f5d0806f820 con 0x7f5d08072690 2024-04-15T00:21:20.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.871+0000 7f5d07fff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5d081414a0 0x7f5d08141930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:36562/0 (socket says 172.21.15.31:36562) 2024-04-15T00:21:20.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.871+0000 7f5d07fff640 1 -- 172.21.15.31:0/1530023752 learned_addr learned my addr 172.21.15.31:0/1530023752 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:20.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.871+0000 7f5d06ffd640 1 --2- 172.21.15.31:0/1530023752 >> v2:172.21.15.50:3300/0 conn(0x7f5d0806fde0 0x7f5d0814b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:20.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.871+0000 7f5d077fe640 1 --2- 172.21.15.31:0/1530023752 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5d08072690 0x7f5d0814ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:20.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.871+0000 7f5d067fc640 1 -- 172.21.15.31:0/1530023752 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 569781345 0 0) 0x7f5d08072a70 con 0x7f5d081414a0 2024-04-15T00:21:20.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.871+0000 7f5d067fc640 1 -- 172.21.15.31:0/1530023752 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cf0003520 con 0x7f5d081414a0 2024-04-15T00:21:20.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.871+0000 7f5d067fc640 1 -- 172.21.15.31:0/1530023752 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2337720566 0 0) 0x7f5cf0003520 con 0x7f5d081414a0 2024-04-15T00:21:20.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.871+0000 7f5d067fc640 1 -- 172.21.15.31:0/1530023752 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5d08072690 msgr2=0x7f5d0814ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:20.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.871+0000 7f5d067fc640 1 --2- 172.21.15.31:0/1530023752 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5d08072690 0x7f5d0814ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.872+0000 7f5d067fc640 1 -- 172.21.15.31:0/1530023752 >> v2:172.21.15.50:3300/0 conn(0x7f5d0806fde0 msgr2=0x7f5d0814b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:20.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.872+0000 7f5d067fc640 1 --2- 172.21.15.31:0/1530023752 >> v2:172.21.15.50:3300/0 conn(0x7f5d0806fde0 0x7f5d0814b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.872+0000 7f5d067fc640 1 -- 172.21.15.31:0/1530023752 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d0806f1d0 con 0x7f5d081414a0 2024-04-15T00:21:20.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.872+0000 7f5d067fc640 1 -- 172.21.15.31:0/1530023752 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 697057150 0 0) 0x7f5d000019f0 con 0x7f5d081414a0 2024-04-15T00:21:20.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.872+0000 7f5d067fc640 1 -- 172.21.15.31:0/1530023752 >> v1:172.21.15.31:6789/0 conn(0x7f5d081414a0 legacy=0x7f5d08141930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:20.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.872+0000 7f5d067fc640 1 --2- 172.21.15.31:0/1530023752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cf00039b0 0x7f5cf0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:20.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.872+0000 7f5d067fc640 1 --2- 172.21.15.31:0/1530023752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cf0004800 0x7f5cf0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:20.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.872+0000 7f5d067fc640 1 --2- 172.21.15.31:0/1530023752 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5d08072690 0x7f5cf00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:20.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.872+0000 7f5d067fc640 1 -- 172.21.15.31:0/1530023752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5d0806f820 con 0x7f5cf0004800 2024-04-15T00:21:20.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.872+0000 7f5d067fc640 1 -- 172.21.15.31:0/1530023752 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf000b9c0 con 0x7f5cf00039b0 2024-04-15T00:21:20.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.872+0000 7f5d067fc640 1 -- 172.21.15.31:0/1530023752 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f5cf000bb40 con 0x7f5d08072690 2024-04-15T00:21:20.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.872+0000 7f5d06ffd640 1 --2- 172.21.15.31:0/1530023752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cf0004800 0x7f5cf0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:20.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.872+0000 7f5d077fe640 1 --2- 172.21.15.31:0/1530023752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cf00039b0 0x7f5cf0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:20.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.872+0000 7f5d07fff640 1 --2- 172.21.15.31:0/1530023752 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5d08072690 0x7f5cf00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:20.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.872+0000 7f5d06ffd640 1 -- 172.21.15.31:0/1530023752 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5d08072690 msgr2=0x7f5cf00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:20.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.872+0000 7f5d06ffd640 1 --2- 172.21.15.31:0/1530023752 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5d08072690 0x7f5cf00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.872+0000 7f5d06ffd640 1 -- 172.21.15.31:0/1530023752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cf00039b0 msgr2=0x7f5cf0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:20.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.872+0000 7f5d06ffd640 1 --2- 172.21.15.31:0/1530023752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cf00039b0 0x7f5cf0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.872+0000 7f5d06ffd640 1 -- 172.21.15.31:0/1530023752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf0003520 con 0x7f5cf0004800 2024-04-15T00:21:20.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.873+0000 7f5d06ffd640 1 --2- 172.21.15.31:0/1530023752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cf0004800 0x7f5cf0004c80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc009ac0 tx=0x7f5cf0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4d3f37fdae1fbbd server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:20.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.873+0000 7f5d067fc640 1 -- 172.21.15.31:0/1530023752 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc039070 con 0x7f5cf0004800 2024-04-15T00:21:20.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.873+0000 7f5d067fc640 1 -- 172.21.15.31:0/1530023752 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cfc02c710 con 0x7f5cf0004800 2024-04-15T00:21:20.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.873+0000 7f5d067fc640 1 -- 172.21.15.31:0/1530023752 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc009690 con 0x7f5cf0004800 2024-04-15T00:21:20.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.873+0000 7f5d0dbfa640 1 -- 172.21.15.31:0/1530023752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cf0004800 msgr2=0x7f5cf0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:20.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.873+0000 7f5d0dbfa640 1 --2- 172.21.15.31:0/1530023752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cf0004800 0x7f5cf0004c80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc009ac0 tx=0x7f5cf0005830 comp rx=0 tx=0).stop 2024-04-15T00:21:20.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.873+0000 7f5d07fff640 1 -- 172.21.15.31:0/1530023752 reap_dead start 2024-04-15T00:21:20.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.873+0000 7f5d0dbfa640 1 -- 172.21.15.31:0/1530023752 shutdown_connections 2024-04-15T00:21:20.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.873+0000 7f5d0dbfa640 1 -- 172.21.15.31:0/1530023752 >> 172.21.15.31:0/1530023752 conn(0x7f5d080b7840 msgr2=0x7f5d080b7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:20.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.873+0000 7f5d0dbfa640 1 -- 172.21.15.31:0/1530023752 shutdown_connections 2024-04-15T00:21:20.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.874+0000 7f5d0dbfa640 1 -- 172.21.15.31:0/1530023752 wait complete. 2024-04-15T00:21:20.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.874+0000 7f5d0dbfa640 1 Processor -- start 2024-04-15T00:21:20.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.875+0000 7f5d0dbfa640 1 -- start start 2024-04-15T00:21:20.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.875+0000 7f5d0dbfa640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5cf0004800 0x7f5d080ba0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:20.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.875+0000 7f5d0dbfa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d08140a10 0x7f5d081dcc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:20.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.875+0000 7f5d0dbfa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d0813eb20 0x7f5d081dd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:20.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.875+0000 7f5d0dbfa640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5d080b58c0 con 0x7f5d0813eb20 2024-04-15T00:21:20.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.875+0000 7f5d0dbfa640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5d080b5740 con 0x7f5d08140a10 2024-04-15T00:21:20.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.875+0000 7f5d0dbfa640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f5d080b74a0 con 0x7f5cf0004800 2024-04-15T00:21:20.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.875+0000 7f5d07fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d0813eb20 0x7f5d081dd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:20.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.875+0000 7f5d07fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d0813eb20 0x7f5d081dd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50180/0 (socket says 172.21.15.31:50180) 2024-04-15T00:21:20.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.875+0000 7f5d07fff640 1 -- 172.21.15.31:0/3307039766 learned_addr learned my addr 172.21.15.31:0/3307039766 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:20.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.876+0000 7f5d07fff640 1 -- 172.21.15.31:0/3307039766 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5cf0004800 msgr2=0x7f5d080ba0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:20.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.876+0000 7f5d07fff640 1 --2- 172.21.15.31:0/3307039766 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5cf0004800 0x7f5d080ba0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.876+0000 7f5d07fff640 1 -- 172.21.15.31:0/3307039766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d08140a10 msgr2=0x7f5d081dcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:20.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.876+0000 7f5d06ffd640 1 --2- 172.21.15.31:0/3307039766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d08140a10 0x7f5d081dcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:20.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.876+0000 7f5d07fff640 1 --2- 172.21.15.31:0/3307039766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d08140a10 0x7f5d081dcc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:20.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.876+0000 7f5d07fff640 1 -- 172.21.15.31:0/3307039766 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d0813f0d0 con 0x7f5d0813eb20 2024-04-15T00:21:20.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.876+0000 7f5d06ffd640 1 --2- 172.21.15.31:0/3307039766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d08140a10 0x7f5d081dcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:21:20.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.876+0000 7f5d07fff640 1 --2- 172.21.15.31:0/3307039766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d0813eb20 0x7f5d081dd150 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5d080bbd90 tx=0x7f5d0000a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:20.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.876+0000 7f5ceffff640 1 -- 172.21.15.31:0/3307039766 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d0000ad60 con 0x7f5d0813eb20 2024-04-15T00:21:20.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.876+0000 7f5ceffff640 1 -- 172.21.15.31:0/3307039766 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d00018070 con 0x7f5d0813eb20 2024-04-15T00:21:20.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.876+0000 7f5d0dbfa640 1 -- 172.21.15.31:0/3307039766 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d0813f3b0 con 0x7f5d0813eb20 2024-04-15T00:21:20.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.876+0000 7f5ceffff640 1 -- 172.21.15.31:0/3307039766 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d00013630 con 0x7f5d0813eb20 2024-04-15T00:21:20.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.876+0000 7f5d0dbfa640 1 -- 172.21.15.31:0/3307039766 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d0814a4d0 con 0x7f5d0813eb20 2024-04-15T00:21:20.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.877+0000 7f5d0dbfa640 1 -- 172.21.15.31:0/3307039766 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d0804f620 con 0x7f5d0813eb20 2024-04-15T00:21:20.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.877+0000 7f5ceffff640 1 -- 172.21.15.31:0/3307039766 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f5d000137d0 con 0x7f5d0813eb20 2024-04-15T00:21:20.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.878+0000 7f5ceffff640 1 --2- 172.21.15.31:0/3307039766 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f5cf406b990 0x7f5cf406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:20.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.878+0000 7f5ceffff640 1 -- 172.21.15.31:0/3307039766 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5d0008b1e0 con 0x7f5d0813eb20 2024-04-15T00:21:20.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.878+0000 7f5d077fe640 1 --2- 172.21.15.31:0/3307039766 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f5cf406b990 0x7f5cf406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:20.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.878+0000 7f5d077fe640 1 --2- 172.21.15.31:0/3307039766 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f5cf406b990 0x7f5cf406de50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8009950 tx=0x7f5cf8009d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:20.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:20.882+0000 7f5ceffff640 1 -- 172.21.15.31:0/3307039766 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f5d00059b50 con 0x7f5d0813eb20 2024-04-15T00:21:21.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.066+0000 7f5d0dbfa640 1 -- 172.21.15.31:0/3307039766 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5d080b5d80 con 0x7f5d0813eb20 2024-04-15T00:21:21.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.067+0000 7f5ceffff640 1 -- 172.21.15.31:0/3307039766 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f5d00059450 con 0x7f5d0813eb20 2024-04-15T00:21:21.074 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-04-15T00:21:21.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.069+0000 7f5d0dbfa640 1 -- 172.21.15.31:0/3307039766 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f5cf406b990 msgr2=0x7f5cf406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:21.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.069+0000 7f5d0dbfa640 1 --2- 172.21.15.31:0/3307039766 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f5cf406b990 0x7f5cf406de50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8009950 tx=0x7f5cf8009d50 comp rx=0 tx=0).stop 2024-04-15T00:21:21.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.069+0000 7f5d0dbfa640 1 -- 172.21.15.31:0/3307039766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d0813eb20 msgr2=0x7f5d081dd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:21.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.069+0000 7f5d0dbfa640 1 --2- 172.21.15.31:0/3307039766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d0813eb20 0x7f5d081dd150 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5d080bbd90 tx=0x7f5d0000a730 comp rx=0 tx=0).stop 2024-04-15T00:21:21.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.069+0000 7f5d0dbfa640 1 -- 172.21.15.31:0/3307039766 shutdown_connections 2024-04-15T00:21:21.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.069+0000 7f5d0dbfa640 1 --2- 172.21.15.31:0/3307039766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d0813eb20 0x7f5d081dd150 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:21.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.069+0000 7f5d0dbfa640 1 --2- 172.21.15.31:0/3307039766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d08140a10 0x7f5d081dcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:21.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.069+0000 7f5d0dbfa640 1 --2- 172.21.15.31:0/3307039766 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f5cf406b990 0x7f5cf406de50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:21.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.069+0000 7f5d0dbfa640 1 --2- 172.21.15.31:0/3307039766 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5cf0004800 0x7f5d080ba0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:21.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.069+0000 7f5d0dbfa640 1 -- 172.21.15.31:0/3307039766 >> 172.21.15.31:0/3307039766 conn(0x7f5d080b7840 msgr2=0x7f5d08147880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:21.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.069+0000 7f5d0dbfa640 1 -- 172.21.15.31:0/3307039766 shutdown_connections 2024-04-15T00:21:21.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.069+0000 7f5d0dbfa640 1 -- 172.21.15.31:0/3307039766 wait complete. 2024-04-15T00:21:21.087 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-15T00:21:21.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.184+0000 7fa4f1368640 1 Processor -- start 2024-04-15T00:21:21.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.184+0000 7fa4f1368640 1 -- start start 2024-04-15T00:21:21.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.185+0000 7fa4f1368640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4ec072820 0x7fa4ec0b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:21.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.185+0000 7fa4f1368640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa4ec0b2d50 0x7fa4ec152060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:21.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.185+0000 7fa4f1368640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4ec072c00 con 0x7fa4ec0b7800 2024-04-15T00:21:21.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.185+0000 7fa4f1368640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fa4ec09c150 con 0x7fa4ec0b2d50 2024-04-15T00:21:21.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.185+0000 7fa4f1368640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fa4ec09c430 con 0x7fa4ec072820 2024-04-15T00:21:21.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.185+0000 7fa4eb7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa4ec0b2d50 0x7fa4ec152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:21.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.185+0000 7fa4eb7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa4ec0b2d50 0x7fa4ec152060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50188/0 (socket says 172.21.15.31:50188) 2024-04-15T00:21:21.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.185+0000 7fa4eb7fe640 1 -- 172.21.15.31:0/3215540662 learned_addr learned my addr 172.21.15.31:0/3215540662 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:21.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.185+0000 7fa4eaffd640 1 --2- 172.21.15.31:0/3215540662 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4ec072820 0x7fa4ec0b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:21.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.185+0000 7fa4eb7fe640 1 -- 172.21.15.31:0/3215540662 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4ec072820 msgr2=0x7fa4ec0b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:21.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.185+0000 7fa4eb7fe640 1 --2- 172.21.15.31:0/3215540662 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4ec072820 0x7fa4ec0b2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:21.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.185+0000 7fa4eb7fe640 1 -- 172.21.15.31:0/3215540662 >> v1:172.21.15.50:6789/0 conn(0x7fa4ec0b7800 legacy=0x7fa4ec1416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:21.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.185+0000 7fa4eb7fe640 1 -- 172.21.15.31:0/3215540662 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4ec0b3cb0 con 0x7fa4ec0b2d50 2024-04-15T00:21:21.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.186+0000 7fa4eb7fe640 1 --2- 172.21.15.31:0/3215540662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4ec0b2d50 0x7fa4ec152060 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc009e50 tx=0x7fa4dc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63626e2198d0a85f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:21.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.186+0000 7fa4e9ffb640 1 -- 172.21.15.31:0/3215540662 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc02ca70 con 0x7fa4ec0b2d50 2024-04-15T00:21:21.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.186+0000 7fa4e9ffb640 1 -- 172.21.15.31:0/3215540662 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4dc02cc10 con 0x7fa4ec0b2d50 2024-04-15T00:21:21.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.186+0000 7fa4e9ffb640 1 -- 172.21.15.31:0/3215540662 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc0343f0 con 0x7fa4ec0b2d50 2024-04-15T00:21:21.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.187+0000 7fa4f1368640 1 -- 172.21.15.31:0/3215540662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4ec0b2d50 msgr2=0x7fa4ec152060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:21.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.187+0000 7fa4f1368640 1 --2- 172.21.15.31:0/3215540662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4ec0b2d50 0x7fa4ec152060 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc009e50 tx=0x7fa4dc02bed0 comp rx=0 tx=0).stop 2024-04-15T00:21:21.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.187+0000 7fa4f1368640 1 -- 172.21.15.31:0/3215540662 shutdown_connections 2024-04-15T00:21:21.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.187+0000 7fa4f1368640 1 --2- 172.21.15.31:0/3215540662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4ec0b2d50 0x7fa4ec152060 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:21.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.187+0000 7fa4f1368640 1 --2- 172.21.15.31:0/3215540662 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4ec072820 0x7fa4ec0b2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:21.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.187+0000 7fa4f1368640 1 -- 172.21.15.31:0/3215540662 >> 172.21.15.31:0/3215540662 conn(0x7fa4ec0bce80 msgr2=0x7fa4ec0bd290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:21.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.187+0000 7fa4f1368640 1 -- 172.21.15.31:0/3215540662 shutdown_connections 2024-04-15T00:21:21.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.187+0000 7fa4f1368640 1 -- 172.21.15.31:0/3215540662 wait complete. 2024-04-15T00:21:21.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.188+0000 7fa4f1368640 1 Processor -- start 2024-04-15T00:21:21.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.188+0000 7fa4f1368640 1 -- start start 2024-04-15T00:21:21.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.188+0000 7fa4f1368640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4ec072820 0x7fa4ec143490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:21.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.188+0000 7fa4f1368640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4ec0b2d50 0x7fa4ec1dd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:21.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.188+0000 7fa4f1368640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4ec0b7800 0x7fa4ec142340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:21.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.188+0000 7fa4f1368640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ec0b8ed0 con 0x7fa4ec0b2d50 2024-04-15T00:21:21.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.188+0000 7fa4f1368640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ec0b8d50 con 0x7fa4ec072820 2024-04-15T00:21:21.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.188+0000 7fa4f1368640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fa4ec0b82b0 con 0x7fa4ec0b7800 2024-04-15T00:21:21.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.188+0000 7fa4ea7fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4ec0b2d50 0x7fa4ec1dd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:21.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.188+0000 7fa4ea7fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4ec0b2d50 0x7fa4ec1dd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50200/0 (socket says 172.21.15.31:50200) 2024-04-15T00:21:21.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.188+0000 7fa4ea7fc640 1 -- 172.21.15.31:0/3452424872 learned_addr learned my addr 172.21.15.31:0/3452424872 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:21.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.189+0000 7fa4eaffd640 1 --2- 172.21.15.31:0/3452424872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4ec072820 0x7fa4ec143490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:21.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.189+0000 7fa4eb7fe640 1 --2- 172.21.15.31:0/3452424872 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4ec0b7800 0x7fa4ec142340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:21.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.189+0000 7fa4ea7fc640 1 -- 172.21.15.31:0/3452424872 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4ec0b7800 msgr2=0x7fa4ec142340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:21.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.189+0000 7fa4ea7fc640 1 --2- 172.21.15.31:0/3452424872 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4ec0b7800 0x7fa4ec142340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:21.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.189+0000 7fa4ea7fc640 1 -- 172.21.15.31:0/3452424872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4ec072820 msgr2=0x7fa4ec143490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:21.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.189+0000 7fa4ea7fc640 1 --2- 172.21.15.31:0/3452424872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4ec072820 0x7fa4ec143490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:21.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.189+0000 7fa4ea7fc640 1 -- 172.21.15.31:0/3452424872 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4ec144a30 con 0x7fa4ec0b2d50 2024-04-15T00:21:21.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.189+0000 7fa4ea7fc640 1 --2- 172.21.15.31:0/3452424872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4ec0b2d50 0x7fa4ec1dd140 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa4e000c3c0 tx=0x7fa4e000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:21.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.189+0000 7fa4d37fe640 1 -- 172.21.15.31:0/3452424872 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e00052d0 con 0x7fa4ec0b2d50 2024-04-15T00:21:21.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.189+0000 7fa4d37fe640 1 -- 172.21.15.31:0/3452424872 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4e0005490 con 0x7fa4ec0b2d50 2024-04-15T00:21:21.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.189+0000 7fa4f1368640 1 -- 172.21.15.31:0/3452424872 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4ec144f80 con 0x7fa4ec0b2d50 2024-04-15T00:21:21.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.189+0000 7fa4d37fe640 1 -- 172.21.15.31:0/3452424872 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e0007260 con 0x7fa4ec0b2d50 2024-04-15T00:21:21.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.189+0000 7fa4f1368640 1 -- 172.21.15.31:0/3452424872 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4ec1481c0 con 0x7fa4ec0b2d50 2024-04-15T00:21:21.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.190+0000 7fa4f1368640 1 -- 172.21.15.31:0/3452424872 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4ec04f540 con 0x7fa4ec0b2d50 2024-04-15T00:21:21.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.190+0000 7fa4d37fe640 1 -- 172.21.15.31:0/3452424872 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fa4e0007400 con 0x7fa4ec0b2d50 2024-04-15T00:21:21.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.191+0000 7fa4d37fe640 1 --2- 172.21.15.31:0/3452424872 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fa4d806b990 0x7fa4d806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:21.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.191+0000 7fa4eaffd640 1 --2- 172.21.15.31:0/3452424872 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fa4d806b990 0x7fa4d806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:21.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.191+0000 7fa4d37fe640 1 -- 172.21.15.31:0/3452424872 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa4e0089f20 con 0x7fa4ec0b2d50 2024-04-15T00:21:21.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.191+0000 7fa4eaffd640 1 --2- 172.21.15.31:0/3452424872 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fa4d806b990 0x7fa4d806de50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4006fd0 tx=0x7fa4e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:21.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.195+0000 7fa4d37fe640 1 -- 172.21.15.31:0/3452424872 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa4e0058230 con 0x7fa4ec0b2d50 2024-04-15T00:21:21.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.375+0000 7fa4f1368640 1 -- 172.21.15.31:0/3452424872 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fa4ec145390 con 0x7fa4ec0b2d50 2024-04-15T00:21:21.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.375+0000 7fa4d37fe640 1 -- 172.21.15.31:0/3452424872 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7fa4e005c2d0 con 0x7fa4ec0b2d50 2024-04-15T00:21:21.383 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-15T00:21:21.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.377+0000 7fa4f1368640 1 -- 172.21.15.31:0/3452424872 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fa4d806b990 msgr2=0x7fa4d806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:21.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.377+0000 7fa4f1368640 1 --2- 172.21.15.31:0/3452424872 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fa4d806b990 0x7fa4d806de50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4006fd0 tx=0x7fa4e4008040 comp rx=0 tx=0).stop 2024-04-15T00:21:21.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.377+0000 7fa4f1368640 1 -- 172.21.15.31:0/3452424872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4ec0b2d50 msgr2=0x7fa4ec1dd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:21.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.377+0000 7fa4f1368640 1 --2- 172.21.15.31:0/3452424872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4ec0b2d50 0x7fa4ec1dd140 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa4e000c3c0 tx=0x7fa4e000c880 comp rx=0 tx=0).stop 2024-04-15T00:21:21.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.377+0000 7fa4f1368640 1 -- 172.21.15.31:0/3452424872 shutdown_connections 2024-04-15T00:21:21.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.377+0000 7fa4f1368640 1 --2- 172.21.15.31:0/3452424872 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fa4d806b990 0x7fa4d806de50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:21.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.377+0000 7fa4f1368640 1 --2- 172.21.15.31:0/3452424872 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa4ec0b7800 0x7fa4ec142340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:21.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.377+0000 7fa4f1368640 1 --2- 172.21.15.31:0/3452424872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4ec0b2d50 0x7fa4ec1dd140 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:21.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.377+0000 7fa4f1368640 1 --2- 172.21.15.31:0/3452424872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4ec072820 0x7fa4ec143490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:21.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.377+0000 7fa4f1368640 1 -- 172.21.15.31:0/3452424872 >> 172.21.15.31:0/3452424872 conn(0x7fa4ec0bce80 msgr2=0x7fa4ec09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:21.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.377+0000 7fa4f1368640 1 -- 172.21.15.31:0/3452424872 shutdown_connections 2024-04-15T00:21:21.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.377+0000 7fa4f1368640 1 -- 172.21.15.31:0/3452424872 wait complete. 2024-04-15T00:21:21.396 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-15T00:21:21.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.492+0000 7f59b3408640 1 Processor -- start 2024-04-15T00:21:21.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.492+0000 7f59b3408640 1 -- start start 2024-04-15T00:21:21.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.492+0000 7f59b3408640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59ac074550 0x7f59ac13f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:21.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.492+0000 7f59b3408640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f59ac0b3d40 0x7f59ac145810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:21.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.492+0000 7f59b3408640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59ac074930 con 0x7f59ac13f870 2024-04-15T00:21:21.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.492+0000 7f59b3408640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f59ac0b4760 con 0x7f59ac0b3d40 2024-04-15T00:21:21.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.492+0000 7f59b3408640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f59ac0b4a40 con 0x7f59ac074550 2024-04-15T00:21:21.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.493+0000 7f59b09a3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f59ac0b3d40 0x7f59ac145810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:21.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.493+0000 7f59b09a3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f59ac0b3d40 0x7f59ac145810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50214/0 (socket says 172.21.15.31:50214) 2024-04-15T00:21:21.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.493+0000 7f59b09a3640 1 -- 172.21.15.31:0/3852973844 learned_addr learned my addr 172.21.15.31:0/3852973844 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:21.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.493+0000 7f59b11a4640 1 --2- 172.21.15.31:0/3852973844 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59ac074550 0x7f59ac13f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:21.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.493+0000 7f59b09a3640 1 -- 172.21.15.31:0/3852973844 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59ac074550 msgr2=0x7f59ac13f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:21.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.493+0000 7f59b09a3640 1 --2- 172.21.15.31:0/3852973844 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59ac074550 0x7f59ac13f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:21.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.493+0000 7f59b09a3640 1 -- 172.21.15.31:0/3852973844 >> v1:172.21.15.50:6789/0 conn(0x7f59ac13f870 legacy=0x7f59ac148a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:21.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.493+0000 7f59a3fff640 1 -- 172.21.15.31:0/3852973844 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2421052344 0 0) 0x7f59ac074930 con 0x7f59ac13f870 2024-04-15T00:21:21.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.493+0000 7f59b09a3640 1 -- 172.21.15.31:0/3852973844 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59ac06fdf0 con 0x7f59ac0b3d40 2024-04-15T00:21:21.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.494+0000 7f59b09a3640 1 --2- 172.21.15.31:0/3852973844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ac0b3d40 0x7f59ac145810 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f599c009870 tx=0x7f599c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=791bc8ac39ba0bd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:21.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.494+0000 7f59a3fff640 1 -- 172.21.15.31:0/3852973844 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599c035020 con 0x7f59ac0b3d40 2024-04-15T00:21:21.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.494+0000 7f59a3fff640 1 -- 172.21.15.31:0/3852973844 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f599c031640 con 0x7f59ac0b3d40 2024-04-15T00:21:21.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.494+0000 7f59a3fff640 1 -- 172.21.15.31:0/3852973844 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599c02d040 con 0x7f59ac0b3d40 2024-04-15T00:21:21.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.494+0000 7f59b3408640 1 -- 172.21.15.31:0/3852973844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ac0b3d40 msgr2=0x7f59ac145810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:21.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.494+0000 7f59b3408640 1 --2- 172.21.15.31:0/3852973844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ac0b3d40 0x7f59ac145810 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f599c009870 tx=0x7f599c02b8f0 comp rx=0 tx=0).stop 2024-04-15T00:21:21.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.494+0000 7f59b3408640 1 -- 172.21.15.31:0/3852973844 shutdown_connections 2024-04-15T00:21:21.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.494+0000 7f59b3408640 1 --2- 172.21.15.31:0/3852973844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ac0b3d40 0x7f59ac145810 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:21.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.494+0000 7f59b3408640 1 --2- 172.21.15.31:0/3852973844 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59ac074550 0x7f59ac13f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:21.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.494+0000 7f59b3408640 1 -- 172.21.15.31:0/3852973844 >> 172.21.15.31:0/3852973844 conn(0x7f59ac09b0f0 msgr2=0x7f59ac09b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:21.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.494+0000 7f59b3408640 1 -- 172.21.15.31:0/3852973844 shutdown_connections 2024-04-15T00:21:21.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.495+0000 7f59b3408640 1 -- 172.21.15.31:0/3852973844 wait complete. 2024-04-15T00:21:21.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.495+0000 7f59b3408640 1 Processor -- start 2024-04-15T00:21:21.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.495+0000 7f59b3408640 1 -- start start 2024-04-15T00:21:21.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.496+0000 7f59b3408640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59ac074550 0x7f59ac13e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:21.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.496+0000 7f59b3408640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ac0b3d40 0x7f59ac13ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:21.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.496+0000 7f59b3408640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59ac13f870 0x7f59ac1dedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:21.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.496+0000 7f59b3408640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f59ac0b5c80 con 0x7f59ac0b3d40 2024-04-15T00:21:21.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.496+0000 7f59b3408640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f59ac0b5b00 con 0x7f59ac074550 2024-04-15T00:21:21.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.496+0000 7f59b3408640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f59ac145d50 con 0x7f59ac13f870 2024-04-15T00:21:21.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.496+0000 7f59b09a3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ac0b3d40 0x7f59ac13ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:21.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.496+0000 7f59b09a3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ac0b3d40 0x7f59ac13ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50220/0 (socket says 172.21.15.31:50220) 2024-04-15T00:21:21.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.496+0000 7f59b09a3640 1 -- 172.21.15.31:0/1155002016 learned_addr learned my addr 172.21.15.31:0/1155002016 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:21.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.496+0000 7f59b11a4640 1 --2- 172.21.15.31:0/1155002016 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59ac074550 0x7f59ac13e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:21.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.496+0000 7f59b09a3640 1 -- 172.21.15.31:0/1155002016 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59ac13f870 msgr2=0x7f59ac1dedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:21.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.496+0000 7f59b09a3640 1 --2- 172.21.15.31:0/1155002016 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59ac13f870 0x7f59ac1dedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:21.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.496+0000 7f59b09a3640 1 -- 172.21.15.31:0/1155002016 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59ac074550 msgr2=0x7f59ac13e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:21.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.496+0000 7f59b09a3640 1 --2- 172.21.15.31:0/1155002016 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59ac074550 0x7f59ac13e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:21.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.496+0000 7f59b09a3640 1 -- 172.21.15.31:0/1155002016 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59ac071970 con 0x7f59ac0b3d40 2024-04-15T00:21:21.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.497+0000 7f59b09a3640 1 --2- 172.21.15.31:0/1155002016 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ac0b3d40 0x7f59ac13ea80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f599c02b930 tx=0x7f599c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:21.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.497+0000 7f59a1ffb640 1 -- 172.21.15.31:0/1155002016 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599c040070 con 0x7f59ac0b3d40 2024-04-15T00:21:21.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.497+0000 7f59a1ffb640 1 -- 172.21.15.31:0/1155002016 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f599c03e070 con 0x7f59ac0b3d40 2024-04-15T00:21:21.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.497+0000 7f59b3408640 1 -- 172.21.15.31:0/1155002016 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59ac0b0ea0 con 0x7f59ac0b3d40 2024-04-15T00:21:21.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.497+0000 7f59a1ffb640 1 -- 172.21.15.31:0/1155002016 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599c035040 con 0x7f59ac0b3d40 2024-04-15T00:21:21.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.497+0000 7f59b3408640 1 -- 172.21.15.31:0/1155002016 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59ac0712f0 con 0x7f59ac0b3d40 2024-04-15T00:21:21.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.498+0000 7f59b3408640 1 -- 172.21.15.31:0/1155002016 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59ac073790 con 0x7f59ac0b3d40 2024-04-15T00:21:21.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.498+0000 7f59a1ffb640 1 -- 172.21.15.31:0/1155002016 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f599c038020 con 0x7f59ac0b3d40 2024-04-15T00:21:21.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.499+0000 7f59a1ffb640 1 --2- 172.21.15.31:0/1155002016 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f599006b9c0 0x7f599006de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:21.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.499+0000 7f59a1ffb640 1 -- 172.21.15.31:0/1155002016 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f599c0ac590 con 0x7f59ac0b3d40 2024-04-15T00:21:21.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.499+0000 7f59b11a4640 1 --2- 172.21.15.31:0/1155002016 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f599006b9c0 0x7f599006de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:21.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.499+0000 7f59b11a4640 1 --2- 172.21.15.31:0/1155002016 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f599006b9c0 0x7f599006de80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f59a8009a10 tx=0x7f59a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:21.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.503+0000 7f59a1ffb640 1 -- 172.21.15.31:0/1155002016 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f599c07ae60 con 0x7f59ac0b3d40 2024-04-15T00:21:21.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.695+0000 7f59b3408640 1 -- 172.21.15.31:0/1155002016 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f59ac04f620 con 0x7f59ac0b3d40 2024-04-15T00:21:21.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.695+0000 7f59a1ffb640 1 -- 172.21.15.31:0/1155002016 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f599c043e40 con 0x7f59ac0b3d40 2024-04-15T00:21:21.703 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-04-15T00:21:21.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.697+0000 7f59b3408640 1 -- 172.21.15.31:0/1155002016 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f599006b9c0 msgr2=0x7f599006de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:21.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.697+0000 7f59b3408640 1 --2- 172.21.15.31:0/1155002016 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f599006b9c0 0x7f599006de80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f59a8009a10 tx=0x7f59a8008040 comp rx=0 tx=0).stop 2024-04-15T00:21:21.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.697+0000 7f59b3408640 1 -- 172.21.15.31:0/1155002016 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ac0b3d40 msgr2=0x7f59ac13ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:21.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.697+0000 7f59b3408640 1 --2- 172.21.15.31:0/1155002016 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ac0b3d40 0x7f59ac13ea80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f599c02b930 tx=0x7f599c0046c0 comp rx=0 tx=0).stop 2024-04-15T00:21:21.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.697+0000 7f59b3408640 1 -- 172.21.15.31:0/1155002016 shutdown_connections 2024-04-15T00:21:21.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.697+0000 7f59b3408640 1 --2- 172.21.15.31:0/1155002016 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f599006b9c0 0x7f599006de80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:21.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.697+0000 7f59b3408640 1 --2- 172.21.15.31:0/1155002016 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59ac13f870 0x7f59ac1dedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:21.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.697+0000 7f59b3408640 1 --2- 172.21.15.31:0/1155002016 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ac0b3d40 0x7f59ac13ea80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:21.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.697+0000 7f59b3408640 1 --2- 172.21.15.31:0/1155002016 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59ac074550 0x7f59ac13e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:21.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.697+0000 7f59b3408640 1 -- 172.21.15.31:0/1155002016 >> 172.21.15.31:0/1155002016 conn(0x7f59ac09b0f0 msgr2=0x7f59ac1446d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:21.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.697+0000 7f59b3408640 1 -- 172.21.15.31:0/1155002016 shutdown_connections 2024-04-15T00:21:21.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.697+0000 7f59b3408640 1 -- 172.21.15.31:0/1155002016 wait complete. 2024-04-15T00:21:21.715 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi031.front.sepia.ceph.com... 2024-04-15T00:21:21.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:21:21.715 DEBUG:teuthology.orchestra.run.smithi031:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-15T00:21:21.740 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi031.stderr:ceph-fuse[44556]: fuse finished with error 0 and tester_r 0 2024-04-15T00:21:21.742 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T00:21:21.770 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2024-04-15T00:21:21.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:21:21.771 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-15T00:21:21.839 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:21:21.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.973+0000 7fc387836640 1 Processor -- start 2024-04-15T00:21:21.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.973+0000 7fc387836640 1 -- start start 2024-04-15T00:21:21.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.974+0000 7fc387836640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc3800b8bf0 0x7fc380153000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:21.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.974+0000 7fc387836640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3800bb2d0 con 0x7fc3800baef0 2024-04-15T00:21:21.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.974+0000 7fc387836640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc38014ae00 con 0x7fc38014b8e0 2024-04-15T00:21:21.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.974+0000 7fc387836640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fc38014b0e0 con 0x7fc3800b8bf0 2024-04-15T00:21:21.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.974+0000 7fc385dd3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc3800b8bf0 0x7fc380153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:21.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.974+0000 7fc3855d2640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc3800baef0 0x7fc380147670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:36574/0 (socket says 172.21.15.31:36574) 2024-04-15T00:21:21.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.974+0000 7fc3855d2640 1 -- 172.21.15.31:0/2183525506 learned_addr learned my addr 172.21.15.31:0/2183525506 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:21.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.974+0000 7fc385dd3640 1 -- 172.21.15.31:0/2183525506 >> v1:172.21.15.50:6789/0 conn(0x7fc38014b8e0 legacy=0x7fc3800b9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:21.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.974+0000 7fc385dd3640 1 -- 172.21.15.31:0/2183525506 >> v1:172.21.15.31:6789/0 conn(0x7fc3800baef0 legacy=0x7fc380147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:21.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.974+0000 7fc377fff640 1 -- 172.21.15.31:0/2183525506 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2370418065 0 0) 0x7fc3800bb2d0 con 0x7fc3800baef0 2024-04-15T00:21:21.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.974+0000 7fc385dd3640 1 -- 172.21.15.31:0/2183525506 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3800bcbb0 con 0x7fc3800b8bf0 2024-04-15T00:21:21.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.975+0000 7fc385dd3640 1 --2- 172.21.15.31:0/2183525506 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3800b8bf0 0x7fc380153000 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc378009d90 tx=0x7fc37802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=453a54d0dc47559 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:21.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.975+0000 7fc377fff640 1 -- 172.21.15.31:0/2183525506 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc378039070 con 0x7fc3800b8bf0 2024-04-15T00:21:21.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.975+0000 7fc377fff640 1 -- 172.21.15.31:0/2183525506 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc37802cbd0 con 0x7fc3800b8bf0 2024-04-15T00:21:21.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.975+0000 7fc377fff640 1 -- 172.21.15.31:0/2183525506 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc378034440 con 0x7fc3800b8bf0 2024-04-15T00:21:21.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.975+0000 7fc387836640 1 -- 172.21.15.31:0/2183525506 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3800b8bf0 msgr2=0x7fc380153000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:21.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.976+0000 7fc387836640 1 --2- 172.21.15.31:0/2183525506 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3800b8bf0 0x7fc380153000 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc378009d90 tx=0x7fc37802be20 comp rx=0 tx=0).stop 2024-04-15T00:21:21.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.976+0000 7fc387836640 1 -- 172.21.15.31:0/2183525506 shutdown_connections 2024-04-15T00:21:21.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.976+0000 7fc387836640 1 --2- 172.21.15.31:0/2183525506 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3800b8bf0 0x7fc380153000 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:21.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.976+0000 7fc387836640 1 -- 172.21.15.31:0/2183525506 >> 172.21.15.31:0/2183525506 conn(0x7fc38009ed70 msgr2=0x7fc38009f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:21.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.976+0000 7fc387836640 1 -- 172.21.15.31:0/2183525506 shutdown_connections 2024-04-15T00:21:21.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.976+0000 7fc387836640 1 -- 172.21.15.31:0/2183525506 wait complete. 2024-04-15T00:21:21.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.977+0000 7fc387836640 1 Processor -- start 2024-04-15T00:21:21.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.977+0000 7fc387836640 1 -- start start 2024-04-15T00:21:21.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.977+0000 7fc387836640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3800b8bf0 0x7fc38014a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:21.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.977+0000 7fc387836640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc3800baef0 0x7fc380143c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:21.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.977+0000 7fc387836640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc38014b8e0 0x7fc380142480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:21.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.977+0000 7fc387836640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc380153540 con 0x7fc3800b8bf0 2024-04-15T00:21:21.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.977+0000 7fc387836640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc3800b92d0 con 0x7fc38014b8e0 2024-04-15T00:21:21.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.977+0000 7fc387836640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fc3801536c0 con 0x7fc3800baef0 2024-04-15T00:21:21.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.977+0000 7fc3855d2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3800b8bf0 0x7fc38014a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:21.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.977+0000 7fc3855d2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3800b8bf0 0x7fc38014a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50246/0 (socket says 172.21.15.31:50246) 2024-04-15T00:21:21.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.977+0000 7fc3855d2640 1 -- 172.21.15.31:0/4232673765 learned_addr learned my addr 172.21.15.31:0/4232673765 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:21.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.978+0000 7fc385dd3640 1 --2- 172.21.15.31:0/4232673765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc38014b8e0 0x7fc380142480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:21.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.978+0000 7fc3855d2640 1 -- 172.21.15.31:0/4232673765 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc3800baef0 msgr2=0x7fc380143c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:21.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.978+0000 7fc3855d2640 1 --2- 172.21.15.31:0/4232673765 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc3800baef0 0x7fc380143c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:21.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.978+0000 7fc3855d2640 1 -- 172.21.15.31:0/4232673765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc38014b8e0 msgr2=0x7fc380142480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:21.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.978+0000 7fc3855d2640 1 --2- 172.21.15.31:0/4232673765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc38014b8e0 0x7fc380142480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:21.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.978+0000 7fc3855d2640 1 -- 172.21.15.31:0/4232673765 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc380144460 con 0x7fc3800b8bf0 2024-04-15T00:21:21.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.978+0000 7fc3855d2640 1 --2- 172.21.15.31:0/4232673765 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3800b8bf0 0x7fc38014a1c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc37c00c500 tx=0x7fc37c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:21.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.978+0000 7fc375ffb640 1 -- 172.21.15.31:0/4232673765 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37c018070 con 0x7fc3800b8bf0 2024-04-15T00:21:21.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.978+0000 7fc375ffb640 1 -- 172.21.15.31:0/4232673765 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc37c007580 con 0x7fc3800b8bf0 2024-04-15T00:21:21.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.978+0000 7fc375ffb640 1 -- 172.21.15.31:0/4232673765 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37c004a20 con 0x7fc3800b8bf0 2024-04-15T00:21:21.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.978+0000 7fc387836640 1 -- 172.21.15.31:0/4232673765 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc380144740 con 0x7fc3800b8bf0 2024-04-15T00:21:21.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.978+0000 7fc387836640 1 -- 172.21.15.31:0/4232673765 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc380144170 con 0x7fc3800b8bf0 2024-04-15T00:21:21.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.979+0000 7fc387836640 1 -- 172.21.15.31:0/4232673765 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc380141f90 con 0x7fc3800b8bf0 2024-04-15T00:21:21.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.980+0000 7fc375ffb640 1 -- 172.21.15.31:0/4232673765 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc37c01b070 con 0x7fc3800b8bf0 2024-04-15T00:21:21.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.980+0000 7fc375ffb640 1 --2- 172.21.15.31:0/4232673765 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc36406b990 0x7fc36406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:21.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.980+0000 7fc375ffb640 1 -- 172.21.15.31:0/4232673765 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc37c089e10 con 0x7fc3800b8bf0 2024-04-15T00:21:21.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.980+0000 7fc384dd1640 1 --2- 172.21.15.31:0/4232673765 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc36406b990 0x7fc36406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:21.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.980+0000 7fc384dd1640 1 --2- 172.21.15.31:0/4232673765 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc36406b990 0x7fc36406de50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc380145220 tx=0x7fc3700079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:21.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:21.984+0000 7fc375ffb640 1 -- 172.21.15.31:0/4232673765 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc37c058770 con 0x7fc3800b8bf0 2024-04-15T00:21:22.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.166+0000 7fc387836640 1 -- 172.21.15.31:0/4232673765 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc38004f620 con 0x7fc3800b8bf0 2024-04-15T00:21:22.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.167+0000 7fc375ffb640 1 -- 172.21.15.31:0/4232673765 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7fc37c058070 con 0x7fc3800b8bf0 2024-04-15T00:21:22.174 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:21:22.175 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"fsid":"b57c03ab-2810-4ea5-b233-6164468328c0","created":"2024-04-15T00:20:44.073217+0000","modified":"2024-04-15T00:21:12.971956+0000","last_up_change":"2024-04-15T00:20:55.515596+0000","last_in_change":"2024-04-15T00:20:46.364541+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:20:56.423161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:21:06.436169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:21:06.888505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:21:10.610300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b085a2f4-5565-4ccc-a98e-e56180791550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6817","nonce":2355720818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6819","nonce":2355720818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6823","nonce":2355720818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6821","nonce":2355720818}]},"public_addr":"172.21.15.31:6817/2355720818","cluster_addr":"172.21.15.31:6819/2355720818","heartbeat_back_addr":"172.21.15.31:6823/2355720818","heartbeat_front_addr":"172.21.15.31:6821/2355720818","state":["exists","up"]},{"osd":1,"uuid":"0f751557-3f18-464f-8b78-614d19549f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6809","nonce":2705297130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6811","nonce":2705297130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6815","nonce":2705297130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6813","nonce":2705297130}]},"public_addr":"172.21.15.31:6809/2705297130","cluster_addr":"172.21.15.31:6811/2705297130","heartbeat_back_addr":"172.21.15.31:6815/2705297130","heartbeat_front_addr":"172.21.15.31:6813/2705297130","state":["exists","up"]},{"osd":2,"uuid":"17371b09-2bd7-4ef7-926f-e7706319f064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6801","nonce":225061474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6803","nonce":225061474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6807","nonce":225061474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6805","nonce":225061474}]},"public_addr":"172.21.15.31:6801/225061474","cluster_addr":"172.21.15.31:6803/225061474","heartbeat_back_addr":"172.21.15.31:6807/225061474","heartbeat_front_addr":"172.21.15.31:6805/225061474","state":["exists","up"]},{"osd":3,"uuid":"315b6949-f009-4291-9581-aa4912642dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6825","nonce":3722449780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6827","nonce":3722449780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6831","nonce":3722449780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6829","nonce":3722449780}]},"public_addr":"172.21.15.31:6825/3722449780","cluster_addr":"172.21.15.31:6827/3722449780","heartbeat_back_addr":"172.21.15.31:6831/3722449780","heartbeat_front_addr":"172.21.15.31:6829/3722449780","state":["exists","up"]},{"osd":4,"uuid":"e3659369-cc78-4aa8-bd10-a199d4a1569d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6801","nonce":1279970071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6803","nonce":1279970071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6807","nonce":1279970071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6805","nonce":1279970071}]},"public_addr":"172.21.15.50:6801/1279970071","cluster_addr":"172.21.15.50:6803/1279970071","heartbeat_back_addr":"172.21.15.50:6807/1279970071","heartbeat_front_addr":"172.21.15.50:6805/1279970071","state":["exists","up"]},{"osd":5,"uuid":"35c3a4c0-0b45-45d2-85b9-301c347602f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6809","nonce":1589417182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6811","nonce":1589417182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6815","nonce":1589417182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6813","nonce":1589417182}]},"public_addr":"172.21.15.50:6809/1589417182","cluster_addr":"172.21.15.50:6811/1589417182","heartbeat_back_addr":"172.21.15.50:6815/1589417182","heartbeat_front_addr":"172.21.15.50:6813/1589417182","state":["exists","up"]},{"osd":6,"uuid":"20df7a76-245f-4946-9624-6ca9e949227b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6817","nonce":682288274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6819","nonce":682288274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6823","nonce":682288274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6821","nonce":682288274}]},"public_addr":"172.21.15.50:6817/682288274","cluster_addr":"172.21.15.50:6819/682288274","heartbeat_back_addr":"172.21.15.50:6823/682288274","heartbeat_front_addr":"172.21.15.50:6821/682288274","state":["exists","up"]},{"osd":7,"uuid":"95a504b7-e13a-49e6-8484-9dff4d5fc048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6825","nonce":4129060906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6827","nonce":4129060906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6831","nonce":4129060906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6829","nonce":4129060906}]},"public_addr":"172.21.15.50:6825/4129060906","cluster_addr":"172.21.15.50:6827/4129060906","heartbeat_back_addr":"172.21.15.50:6831/4129060906","heartbeat_front_addr":"172.21.15.50:6829/4129060906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.501980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.529961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.540913+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.521396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.448364+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.514136+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.527229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.508950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:21:22.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.169+0000 7fc387836640 1 -- 172.21.15.31:0/4232673765 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc36406b990 msgr2=0x7fc36406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:22.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.169+0000 7fc387836640 1 --2- 172.21.15.31:0/4232673765 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc36406b990 0x7fc36406de50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc380145220 tx=0x7fc3700079b0 comp rx=0 tx=0).stop 2024-04-15T00:21:22.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.169+0000 7fc387836640 1 -- 172.21.15.31:0/4232673765 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3800b8bf0 msgr2=0x7fc38014a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:22.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.169+0000 7fc387836640 1 --2- 172.21.15.31:0/4232673765 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3800b8bf0 0x7fc38014a1c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc37c00c500 tx=0x7fc37c00c9c0 comp rx=0 tx=0).stop 2024-04-15T00:21:22.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.169+0000 7fc387836640 1 -- 172.21.15.31:0/4232673765 shutdown_connections 2024-04-15T00:21:22.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.169+0000 7fc387836640 1 --2- 172.21.15.31:0/4232673765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc38014b8e0 0x7fc380142480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:22.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.169+0000 7fc387836640 1 --2- 172.21.15.31:0/4232673765 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc36406b990 0x7fc36406de50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:22.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.169+0000 7fc387836640 1 --2- 172.21.15.31:0/4232673765 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc3800baef0 0x7fc380143c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:22.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.169+0000 7fc387836640 1 --2- 172.21.15.31:0/4232673765 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3800b8bf0 0x7fc38014a1c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:22.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.169+0000 7fc387836640 1 -- 172.21.15.31:0/4232673765 >> 172.21.15.31:0/4232673765 conn(0x7fc38009ed70 msgr2=0x7fc380141610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:22.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.169+0000 7fc387836640 1 -- 172.21.15.31:0/4232673765 shutdown_connections 2024-04-15T00:21:22.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.169+0000 7fc387836640 1 -- 172.21.15.31:0/4232673765 wait complete. 2024-04-15T00:21:22.187 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:21:22.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.281+0000 7f40ff764640 1 Processor -- start 2024-04-15T00:21:22.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.281+0000 7f40ff764640 1 -- start start 2024-04-15T00:21:22.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.282+0000 7f40ff764640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40f80b1b40 0x7f40f80b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:22.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.282+0000 7f40ff764640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f40f80b2530 0x7f40f814f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:22.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.282+0000 7f40ff764640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40f80b16b0 con 0x7f40f80b01c0 2024-04-15T00:21:22.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.282+0000 7f40ff764640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f40f80b11a0 con 0x7f40f80b2530 2024-04-15T00:21:22.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.282+0000 7f40ff764640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f40f80b61f0 con 0x7f40f80b1b40 2024-04-15T00:21:22.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.282+0000 7f40fd500640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f40f80b01c0 0x7f40f8147af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:36576/0 (socket says 172.21.15.31:36576) 2024-04-15T00:21:22.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.282+0000 7f40fd500640 1 -- 172.21.15.31:0/4257062432 learned_addr learned my addr 172.21.15.31:0/4257062432 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:22.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.282+0000 7f40fdd01640 1 --2- 172.21.15.31:0/4257062432 >> v2:172.21.15.50:3300/0 conn(0x7f40f80b2530 0x7f40f814f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:22.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.282+0000 7f40fccff640 1 --2- 172.21.15.31:0/4257062432 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40f80b1b40 0x7f40f80b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:22.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.282+0000 7f40effff640 1 -- 172.21.15.31:0/4257062432 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1856527721 0 0) 0x7f40f80b16b0 con 0x7f40f80b01c0 2024-04-15T00:21:22.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.282+0000 7f40effff640 1 -- 172.21.15.31:0/4257062432 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40e4003520 con 0x7f40f80b01c0 2024-04-15T00:21:22.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.282+0000 7f40fdd01640 1 -- 172.21.15.31:0/4257062432 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40f80b1b40 msgr2=0x7f40f80b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:22.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.282+0000 7f40fdd01640 1 --2- 172.21.15.31:0/4257062432 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40f80b1b40 0x7f40f80b1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:22.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.282+0000 7f40fdd01640 1 -- 172.21.15.31:0/4257062432 >> v1:172.21.15.31:6789/0 conn(0x7f40f80b01c0 legacy=0x7f40f8147af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:22.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.282+0000 7f40fdd01640 1 -- 172.21.15.31:0/4257062432 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f80af960 con 0x7f40f80b2530 2024-04-15T00:21:22.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.283+0000 7f40fdd01640 1 --2- 172.21.15.31:0/4257062432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40f80b2530 0x7f40f814f0a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009d90 tx=0x7f40f402bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91f0b75e5d6cbe0f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:22.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.283+0000 7f40effff640 1 -- 172.21.15.31:0/4257062432 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f4039070 con 0x7f40f80b2530 2024-04-15T00:21:22.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.283+0000 7f40effff640 1 -- 172.21.15.31:0/4257062432 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40f402cc50 con 0x7f40f80b2530 2024-04-15T00:21:22.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.283+0000 7f40effff640 1 -- 172.21.15.31:0/4257062432 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f4034440 con 0x7f40f80b2530 2024-04-15T00:21:22.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.284+0000 7f40ff764640 1 -- 172.21.15.31:0/4257062432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40f80b2530 msgr2=0x7f40f814f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:22.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.284+0000 7f40ff764640 1 --2- 172.21.15.31:0/4257062432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40f80b2530 0x7f40f814f0a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009d90 tx=0x7f40f402bea0 comp rx=0 tx=0).stop 2024-04-15T00:21:22.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.284+0000 7f40ff764640 1 -- 172.21.15.31:0/4257062432 shutdown_connections 2024-04-15T00:21:22.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.284+0000 7f40ff764640 1 --2- 172.21.15.31:0/4257062432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40f80b2530 0x7f40f814f0a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:22.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.284+0000 7f40ff764640 1 --2- 172.21.15.31:0/4257062432 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40f80b1b40 0x7f40f80b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:22.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.284+0000 7f40ff764640 1 -- 172.21.15.31:0/4257062432 >> 172.21.15.31:0/4257062432 conn(0x7f40f806c470 msgr2=0x7f40f806c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:22.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.284+0000 7f40ff764640 1 -- 172.21.15.31:0/4257062432 shutdown_connections 2024-04-15T00:21:22.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.284+0000 7f40ff764640 1 -- 172.21.15.31:0/4257062432 wait complete. 2024-04-15T00:21:22.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.285+0000 7f40ff764640 1 Processor -- start 2024-04-15T00:21:22.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.285+0000 7f40ff764640 1 -- start start 2024-04-15T00:21:22.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.286+0000 7f40ff764640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40f80b01c0 0x7f40f8134460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:22.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.286+0000 7f40ff764640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40f80b1b40 0x7f40f80b7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:22.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.286+0000 7f40ff764640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40f80b2530 0x7f40f80b8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:22.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.286+0000 7f40ff764640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f40f80b13d0 con 0x7f40f80b2530 2024-04-15T00:21:22.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.286+0000 7f40ff764640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f40f80b5d60 con 0x7f40f80b1b40 2024-04-15T00:21:22.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.286+0000 7f40ff764640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f40f80b59f0 con 0x7f40f80b01c0 2024-04-15T00:21:22.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.286+0000 7f40fdd01640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40f80b2530 0x7f40f80b8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:22.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.286+0000 7f40fdd01640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40f80b2530 0x7f40f80b8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50260/0 (socket says 172.21.15.31:50260) 2024-04-15T00:21:22.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.286+0000 7f40fdd01640 1 -- 172.21.15.31:0/1102325785 learned_addr learned my addr 172.21.15.31:0/1102325785 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:22.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.286+0000 7f40fccff640 1 --2- 172.21.15.31:0/1102325785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40f80b1b40 0x7f40f80b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:22.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.286+0000 7f40fd500640 1 --2- 172.21.15.31:0/1102325785 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40f80b01c0 0x7f40f8134460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:22.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.286+0000 7f40fdd01640 1 -- 172.21.15.31:0/1102325785 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40f80b01c0 msgr2=0x7f40f8134460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:22.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.286+0000 7f40fdd01640 1 --2- 172.21.15.31:0/1102325785 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40f80b01c0 0x7f40f8134460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:22.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.286+0000 7f40fdd01640 1 -- 172.21.15.31:0/1102325785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40f80b1b40 msgr2=0x7f40f80b7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:22.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.286+0000 7f40fdd01640 1 --2- 172.21.15.31:0/1102325785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40f80b1b40 0x7f40f80b7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:22.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.286+0000 7f40fdd01640 1 -- 172.21.15.31:0/1102325785 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f8140460 con 0x7f40f80b2530 2024-04-15T00:21:22.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.286+0000 7f40fdd01640 1 --2- 172.21.15.31:0/1102325785 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40f80b2530 0x7f40f80b8cf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009eb0 tx=0x7f40f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:22.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.286+0000 7f40edffb640 1 -- 172.21.15.31:0/1102325785 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f4039050 con 0x7f40f80b2530 2024-04-15T00:21:22.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.286+0000 7f40edffb640 1 -- 172.21.15.31:0/1102325785 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40f4045070 con 0x7f40f80b2530 2024-04-15T00:21:22.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.286+0000 7f40edffb640 1 -- 172.21.15.31:0/1102325785 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f4009450 con 0x7f40f80b2530 2024-04-15T00:21:22.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.286+0000 7f40ff764640 1 -- 172.21.15.31:0/1102325785 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40f8140740 con 0x7f40f80b2530 2024-04-15T00:21:22.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.287+0000 7f40ff764640 1 -- 172.21.15.31:0/1102325785 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40f8135140 con 0x7f40f80b2530 2024-04-15T00:21:22.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.288+0000 7f40ff764640 1 -- 172.21.15.31:0/1102325785 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40f8140910 con 0x7f40f80b2530 2024-04-15T00:21:22.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.288+0000 7f40edffb640 1 -- 172.21.15.31:0/1102325785 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f40f403e610 con 0x7f40f80b2530 2024-04-15T00:21:22.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.288+0000 7f40edffb640 1 --2- 172.21.15.31:0/1102325785 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f40dc06b990 0x7f40dc06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:22.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.288+0000 7f40edffb640 1 -- 172.21.15.31:0/1102325785 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f40f40ad460 con 0x7f40f80b2530 2024-04-15T00:21:22.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.288+0000 7f40fd500640 1 --2- 172.21.15.31:0/1102325785 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f40dc06b990 0x7f40dc06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:22.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.289+0000 7f40fd500640 1 --2- 172.21.15.31:0/1102325785 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f40dc06b990 0x7f40dc06de50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f40f0005880 tx=0x7f40f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:22.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.293+0000 7f40edffb640 1 -- 172.21.15.31:0/1102325785 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f40f407b7a0 con 0x7f40f80b2530 2024-04-15T00:21:22.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.476+0000 7f40ff764640 1 -- 172.21.15.31:0/1102325785 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f40f80b0e10 con 0x7f40f80b2530 2024-04-15T00:21:22.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.477+0000 7f40edffb640 1 -- 172.21.15.31:0/1102325785 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7f40f407f840 con 0x7f40f80b2530 2024-04-15T00:21:22.485 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:21:22.485 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"fsid":"b57c03ab-2810-4ea5-b233-6164468328c0","created":"2024-04-15T00:20:44.073217+0000","modified":"2024-04-15T00:21:12.971956+0000","last_up_change":"2024-04-15T00:20:55.515596+0000","last_in_change":"2024-04-15T00:20:46.364541+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:20:56.423161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:21:06.436169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:21:06.888505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:21:10.610300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b085a2f4-5565-4ccc-a98e-e56180791550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6817","nonce":2355720818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6819","nonce":2355720818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6823","nonce":2355720818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6821","nonce":2355720818}]},"public_addr":"172.21.15.31:6817/2355720818","cluster_addr":"172.21.15.31:6819/2355720818","heartbeat_back_addr":"172.21.15.31:6823/2355720818","heartbeat_front_addr":"172.21.15.31:6821/2355720818","state":["exists","up"]},{"osd":1,"uuid":"0f751557-3f18-464f-8b78-614d19549f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6809","nonce":2705297130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6811","nonce":2705297130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6815","nonce":2705297130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6813","nonce":2705297130}]},"public_addr":"172.21.15.31:6809/2705297130","cluster_addr":"172.21.15.31:6811/2705297130","heartbeat_back_addr":"172.21.15.31:6815/2705297130","heartbeat_front_addr":"172.21.15.31:6813/2705297130","state":["exists","up"]},{"osd":2,"uuid":"17371b09-2bd7-4ef7-926f-e7706319f064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6801","nonce":225061474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6803","nonce":225061474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6807","nonce":225061474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6805","nonce":225061474}]},"public_addr":"172.21.15.31:6801/225061474","cluster_addr":"172.21.15.31:6803/225061474","heartbeat_back_addr":"172.21.15.31:6807/225061474","heartbeat_front_addr":"172.21.15.31:6805/225061474","state":["exists","up"]},{"osd":3,"uuid":"315b6949-f009-4291-9581-aa4912642dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6825","nonce":3722449780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6827","nonce":3722449780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6831","nonce":3722449780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6829","nonce":3722449780}]},"public_addr":"172.21.15.31:6825/3722449780","cluster_addr":"172.21.15.31:6827/3722449780","heartbeat_back_addr":"172.21.15.31:6831/3722449780","heartbeat_front_addr":"172.21.15.31:6829/3722449780","state":["exists","up"]},{"osd":4,"uuid":"e3659369-cc78-4aa8-bd10-a199d4a1569d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6801","nonce":1279970071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6803","nonce":1279970071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6807","nonce":1279970071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6805","nonce":1279970071}]},"public_addr":"172.21.15.50:6801/1279970071","cluster_addr":"172.21.15.50:6803/1279970071","heartbeat_back_addr":"172.21.15.50:6807/1279970071","heartbeat_front_addr":"172.21.15.50:6805/1279970071","state":["exists","up"]},{"osd":5,"uuid":"35c3a4c0-0b45-45d2-85b9-301c347602f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6809","nonce":1589417182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6811","nonce":1589417182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6815","nonce":1589417182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6813","nonce":1589417182}]},"public_addr":"172.21.15.50:6809/1589417182","cluster_addr":"172.21.15.50:6811/1589417182","heartbeat_back_addr":"172.21.15.50:6815/1589417182","heartbeat_front_addr":"172.21.15.50:6813/1589417182","state":["exists","up"]},{"osd":6,"uuid":"20df7a76-245f-4946-9624-6ca9e949227b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6817","nonce":682288274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6819","nonce":682288274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6823","nonce":682288274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6821","nonce":682288274}]},"public_addr":"172.21.15.50:6817/682288274","cluster_addr":"172.21.15.50:6819/682288274","heartbeat_back_addr":"172.21.15.50:6823/682288274","heartbeat_front_addr":"172.21.15.50:6821/682288274","state":["exists","up"]},{"osd":7,"uuid":"95a504b7-e13a-49e6-8484-9dff4d5fc048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6825","nonce":4129060906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6827","nonce":4129060906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6831","nonce":4129060906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6829","nonce":4129060906}]},"public_addr":"172.21.15.50:6825/4129060906","cluster_addr":"172.21.15.50:6827/4129060906","heartbeat_back_addr":"172.21.15.50:6831/4129060906","heartbeat_front_addr":"172.21.15.50:6829/4129060906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.501980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.529961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.540913+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.521396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.448364+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.514136+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.527229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.508950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:21:22.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.480+0000 7f40ff764640 1 -- 172.21.15.31:0/1102325785 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f40dc06b990 msgr2=0x7f40dc06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:22.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.480+0000 7f40ff764640 1 --2- 172.21.15.31:0/1102325785 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f40dc06b990 0x7f40dc06de50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f40f0005880 tx=0x7f40f0009040 comp rx=0 tx=0).stop 2024-04-15T00:21:22.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.480+0000 7f40ff764640 1 -- 172.21.15.31:0/1102325785 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40f80b2530 msgr2=0x7f40f80b8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:22.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.480+0000 7f40ff764640 1 --2- 172.21.15.31:0/1102325785 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40f80b2530 0x7f40f80b8cf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009eb0 tx=0x7f40f4004a40 comp rx=0 tx=0).stop 2024-04-15T00:21:22.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.480+0000 7f40ff764640 1 -- 172.21.15.31:0/1102325785 shutdown_connections 2024-04-15T00:21:22.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.480+0000 7f40ff764640 1 --2- 172.21.15.31:0/1102325785 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40f80b2530 0x7f40f80b8cf0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:22.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.480+0000 7f40ff764640 1 --2- 172.21.15.31:0/1102325785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40f80b1b40 0x7f40f80b7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:22.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.480+0000 7f40ff764640 1 --2- 172.21.15.31:0/1102325785 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f40dc06b990 0x7f40dc06de50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:22.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.480+0000 7f40ff764640 1 --2- 172.21.15.31:0/1102325785 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f40f80b01c0 0x7f40f8134460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:22.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.480+0000 7f40ff764640 1 -- 172.21.15.31:0/1102325785 >> 172.21.15.31:0/1102325785 conn(0x7f40f806c470 msgr2=0x7f40f813dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:22.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.480+0000 7f40ff764640 1 -- 172.21.15.31:0/1102325785 shutdown_connections 2024-04-15T00:21:22.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.480+0000 7f40ff764640 1 -- 172.21.15.31:0/1102325785 wait complete. 2024-04-15T00:21:22.498 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-15T00:21:22.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.595+0000 7f585571e640 1 Processor -- start 2024-04-15T00:21:22.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.596+0000 7f585571e640 1 -- start start 2024-04-15T00:21:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.596+0000 7f585571e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5850072750 0x7f585009bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.596+0000 7f585571e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f585009c4d0 0x7f58500b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.596+0000 7f585571e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5850072b30 con 0x7f58500b8ff0 2024-04-15T00:21:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.596+0000 7f585571e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f58500b0580 con 0x7f585009c4d0 2024-04-15T00:21:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.596+0000 7f585571e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f58500bad90 con 0x7f5850072750 2024-04-15T00:21:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.596+0000 7f584e7fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f585009c4d0 0x7f58500b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.596+0000 7f584e7fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f585009c4d0 0x7f58500b8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51602/0 (socket says 172.21.15.31:51602) 2024-04-15T00:21:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.596+0000 7f584e7fc640 1 -- 172.21.15.31:0/3423744389 learned_addr learned my addr 172.21.15.31:0/3423744389 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.597+0000 7f584e7fc640 1 -- 172.21.15.31:0/3423744389 >> v2:172.21.15.50:3300/0 conn(0x7f5850072750 msgr2=0x7f585009bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.597+0000 7f584e7fc640 1 --2- 172.21.15.31:0/3423744389 >> v2:172.21.15.50:3300/0 conn(0x7f5850072750 0x7f585009bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.597+0000 7f584e7fc640 1 -- 172.21.15.31:0/3423744389 >> v1:172.21.15.50:6789/0 conn(0x7f58500b8ff0 legacy=0x7f585014ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.597+0000 7f584e7fc640 1 -- 172.21.15.31:0/3423744389 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58500bb070 con 0x7f585009c4d0 2024-04-15T00:21:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.597+0000 7f584e7fc640 1 --2- 172.21.15.31:0/3423744389 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f585009c4d0 0x7f58500b8ab0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5850074dd0 tx=0x7f583802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=297a2808ffccdb72 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.597+0000 7f584dffb640 1 -- 172.21.15.31:0/3423744389 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583802e070 con 0x7f585009c4d0 2024-04-15T00:21:22.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.597+0000 7f584dffb640 1 -- 172.21.15.31:0/3423744389 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5838037070 con 0x7f585009c4d0 2024-04-15T00:21:22.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.597+0000 7f584dffb640 1 -- 172.21.15.31:0/3423744389 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5838031a00 con 0x7f585009c4d0 2024-04-15T00:21:22.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.598+0000 7f585571e640 1 -- 172.21.15.31:0/3423744389 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f585009c4d0 msgr2=0x7f58500b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:22.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.598+0000 7f585571e640 1 --2- 172.21.15.31:0/3423744389 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f585009c4d0 0x7f58500b8ab0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5850074dd0 tx=0x7f583802b880 comp rx=0 tx=0).stop 2024-04-15T00:21:22.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.598+0000 7f585571e640 1 -- 172.21.15.31:0/3423744389 shutdown_connections 2024-04-15T00:21:22.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.598+0000 7f585571e640 1 --2- 172.21.15.31:0/3423744389 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f585009c4d0 0x7f58500b8ab0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:22.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.598+0000 7f585571e640 1 --2- 172.21.15.31:0/3423744389 >> v2:172.21.15.50:3300/0 conn(0x7f5850072750 0x7f585009bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:22.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.598+0000 7f585571e640 1 -- 172.21.15.31:0/3423744389 >> 172.21.15.31:0/3423744389 conn(0x7f58500bcef0 msgr2=0x7f58500bd300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:22.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.598+0000 7f585571e640 1 -- 172.21.15.31:0/3423744389 shutdown_connections 2024-04-15T00:21:22.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.598+0000 7f585571e640 1 -- 172.21.15.31:0/3423744389 wait complete. 2024-04-15T00:21:22.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.599+0000 7f585571e640 1 Processor -- start 2024-04-15T00:21:22.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.599+0000 7f585571e640 1 -- start start 2024-04-15T00:21:22.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.600+0000 7f585571e640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5850072750 0x7f5850142700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:22.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.600+0000 7f585571e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f585009c4d0 0x7f58500a1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:22.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.600+0000 7f585571e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58500b8ff0 0x7f58500b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:22.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.600+0000 7f585571e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5850074530 con 0x7f585009c4d0 2024-04-15T00:21:22.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.600+0000 7f585571e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f58501478f0 con 0x7f58500b8ff0 2024-04-15T00:21:22.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.600+0000 7f585571e640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f58500b9460 con 0x7f5850072750 2024-04-15T00:21:22.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.600+0000 7f584e7fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f585009c4d0 0x7f58500a1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:22.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.600+0000 7f584e7fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f585009c4d0 0x7f58500a1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51606/0 (socket says 172.21.15.31:51606) 2024-04-15T00:21:22.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.600+0000 7f584e7fc640 1 -- 172.21.15.31:0/2402904490 learned_addr learned my addr 172.21.15.31:0/2402904490 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:22.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.600+0000 7f584f7fe640 1 --2- 172.21.15.31:0/2402904490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58500b8ff0 0x7f58500b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:22.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.600+0000 7f584effd640 1 --2- 172.21.15.31:0/2402904490 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5850072750 0x7f5850142700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:22.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.600+0000 7f584e7fc640 1 -- 172.21.15.31:0/2402904490 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5850072750 msgr2=0x7f5850142700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:22.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.600+0000 7f584e7fc640 1 --2- 172.21.15.31:0/2402904490 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5850072750 0x7f5850142700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:22.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.600+0000 7f584e7fc640 1 -- 172.21.15.31:0/2402904490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58500b8ff0 msgr2=0x7f58500b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:22.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.600+0000 7f584e7fc640 1 --2- 172.21.15.31:0/2402904490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58500b8ff0 0x7f58500b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:22.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.600+0000 7f584e7fc640 1 -- 172.21.15.31:0/2402904490 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58500a0a80 con 0x7f585009c4d0 2024-04-15T00:21:22.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.600+0000 7f584e7fc640 1 --2- 172.21.15.31:0/2402904490 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f585009c4d0 0x7f58500a1240 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5838000c00 tx=0x7f58380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:22.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.600+0000 7f58477fe640 1 -- 172.21.15.31:0/2402904490 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5838032880 con 0x7f585009c4d0 2024-04-15T00:21:22.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.601+0000 7f58477fe640 1 -- 172.21.15.31:0/2402904490 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5838032a20 con 0x7f585009c4d0 2024-04-15T00:21:22.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.601+0000 7f585571e640 1 -- 172.21.15.31:0/2402904490 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58500b6560 con 0x7f585009c4d0 2024-04-15T00:21:22.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.601+0000 7f58477fe640 1 -- 172.21.15.31:0/2402904490 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5838032e10 con 0x7f585009c4d0 2024-04-15T00:21:22.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.601+0000 7f585571e640 1 -- 172.21.15.31:0/2402904490 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58500a0d20 con 0x7f585009c4d0 2024-04-15T00:21:22.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.602+0000 7f585571e640 1 -- 172.21.15.31:0/2402904490 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f585004f540 con 0x7f585009c4d0 2024-04-15T00:21:22.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.602+0000 7f58477fe640 1 -- 172.21.15.31:0/2402904490 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f58380453f0 con 0x7f585009c4d0 2024-04-15T00:21:22.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.602+0000 7f58477fe640 1 --2- 172.21.15.31:0/2402904490 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f583006b990 0x7f583006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:22.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.602+0000 7f58477fe640 1 -- 172.21.15.31:0/2402904490 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f58380acb20 con 0x7f585009c4d0 2024-04-15T00:21:22.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.602+0000 7f584effd640 1 --2- 172.21.15.31:0/2402904490 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f583006b990 0x7f583006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:22.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.603+0000 7f584effd640 1 --2- 172.21.15.31:0/2402904490 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f583006b990 0x7f583006de50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5848009990 tx=0x7f5848009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:22.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.607+0000 7f58477fe640 1 -- 172.21.15.31:0/2402904490 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f5838040070 con 0x7f585009c4d0 2024-04-15T00:21:22.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:22.827+0000 7f585571e640 1 -- 172.21.15.31:0/2402904490 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f58500b7220 con 0x7f585009c4d0 2024-04-15T00:21:23.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.633+0000 7f58477fe640 1 -- 172.21.15.31:0/2402904490 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f583807b370 con 0x7f585009c4d0 2024-04-15T00:21:23.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.636+0000 7f585571e640 1 -- 172.21.15.31:0/2402904490 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f583006b990 msgr2=0x7f583006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:23.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.636+0000 7f585571e640 1 --2- 172.21.15.31:0/2402904490 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f583006b990 0x7f583006de50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5848009990 tx=0x7f5848009110 comp rx=0 tx=0).stop 2024-04-15T00:21:23.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.636+0000 7f585571e640 1 -- 172.21.15.31:0/2402904490 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f585009c4d0 msgr2=0x7f58500a1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:23.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.636+0000 7f585571e640 1 --2- 172.21.15.31:0/2402904490 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f585009c4d0 0x7f58500a1240 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5838000c00 tx=0x7f58380046c0 comp rx=0 tx=0).stop 2024-04-15T00:21:23.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.636+0000 7f585571e640 1 -- 172.21.15.31:0/2402904490 shutdown_connections 2024-04-15T00:21:23.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.636+0000 7f585571e640 1 --2- 172.21.15.31:0/2402904490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58500b8ff0 0x7f58500b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:23.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.636+0000 7f585571e640 1 --2- 172.21.15.31:0/2402904490 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f585009c4d0 0x7f58500a1240 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:23.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.636+0000 7f585571e640 1 --2- 172.21.15.31:0/2402904490 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f583006b990 0x7f583006de50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:23.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.636+0000 7f585571e640 1 --2- 172.21.15.31:0/2402904490 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5850072750 0x7f5850142700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:23.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.636+0000 7f585571e640 1 -- 172.21.15.31:0/2402904490 >> 172.21.15.31:0/2402904490 conn(0x7f58500bcef0 msgr2=0x7f585009dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:23.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.636+0000 7f585571e640 1 -- 172.21.15.31:0/2402904490 shutdown_connections 2024-04-15T00:21:23.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.636+0000 7f585571e640 1 -- 172.21.15.31:0/2402904490 wait complete. 2024-04-15T00:21:23.657 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-04-15T00:21:23.657 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-15T00:21:23.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.760+0000 7fedab884640 1 Processor -- start 2024-04-15T00:21:23.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.760+0000 7fedab884640 1 -- start start 2024-04-15T00:21:23.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.761+0000 7fedab884640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feda4072820 0x7feda40b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:23.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.761+0000 7fedab884640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feda40b7800 0x7feda41416b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:23.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.761+0000 7fedab884640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feda4072c00 con 0x7feda40b2d50 2024-04-15T00:21:23.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.761+0000 7fedab884640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7feda409c150 con 0x7feda40b7800 2024-04-15T00:21:23.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.761+0000 7fedab884640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7feda409c430 con 0x7feda4072820 2024-04-15T00:21:23.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.761+0000 7feda9620640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feda4072820 0x7feda40b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:23.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.761+0000 7feda8e1f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feda40b7800 0x7feda41416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:23.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.761+0000 7feda9e21640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7feda40b2d50 0x7feda4147780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.31:46620/0 (socket says 172.21.15.31:46620) 2024-04-15T00:21:23.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.761+0000 7feda9e21640 1 -- 172.21.15.31:0/2149033586 learned_addr learned my addr 172.21.15.31:0/2149033586 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:23.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.762+0000 7feda9620640 1 -- 172.21.15.31:0/2149033586 >> v2:172.21.15.50:3300/0 conn(0x7feda40b7800 msgr2=0x7feda41416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:23.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.762+0000 7feda9620640 1 --2- 172.21.15.31:0/2149033586 >> v2:172.21.15.50:3300/0 conn(0x7feda40b7800 0x7feda41416b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:23.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.762+0000 7feda9620640 1 -- 172.21.15.31:0/2149033586 >> v1:172.21.15.50:6789/0 conn(0x7feda40b2d50 legacy=0x7feda4147780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:23.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.762+0000 7feda9620640 1 -- 172.21.15.31:0/2149033586 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda40b3cb0 con 0x7feda4072820 2024-04-15T00:21:23.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.762+0000 7feda8e1f640 1 --2- 172.21.15.31:0/2149033586 >> v2:172.21.15.50:3300/0 conn(0x7feda40b7800 0x7feda41416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:21:23.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.762+0000 7feda9620640 1 --2- 172.21.15.31:0/2149033586 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feda4072820 0x7feda40b2810 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fed9c0097a0 tx=0x7fed9c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8df85ac7204341e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:23.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.763+0000 7feda3fff640 1 -- 172.21.15.31:0/2149033586 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9c0315a0 con 0x7feda4072820 2024-04-15T00:21:23.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.763+0000 7feda3fff640 1 -- 172.21.15.31:0/2149033586 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed9c037070 con 0x7feda4072820 2024-04-15T00:21:23.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.763+0000 7feda3fff640 1 -- 172.21.15.31:0/2149033586 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9c031960 con 0x7feda4072820 2024-04-15T00:21:23.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.763+0000 7fedab884640 1 -- 172.21.15.31:0/2149033586 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feda4072820 msgr2=0x7feda40b2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:23.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.763+0000 7fedab884640 1 --2- 172.21.15.31:0/2149033586 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feda4072820 0x7feda40b2810 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fed9c0097a0 tx=0x7fed9c02b840 comp rx=0 tx=0).stop 2024-04-15T00:21:23.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.763+0000 7fedab884640 1 -- 172.21.15.31:0/2149033586 shutdown_connections 2024-04-15T00:21:23.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.763+0000 7fedab884640 1 --2- 172.21.15.31:0/2149033586 >> v2:172.21.15.50:3300/0 conn(0x7feda40b7800 0x7feda41416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:23.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.763+0000 7fedab884640 1 --2- 172.21.15.31:0/2149033586 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feda4072820 0x7feda40b2810 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:23.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.763+0000 7fedab884640 1 -- 172.21.15.31:0/2149033586 >> 172.21.15.31:0/2149033586 conn(0x7feda40bce80 msgr2=0x7feda40bd290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:23.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.763+0000 7fedab884640 1 -- 172.21.15.31:0/2149033586 shutdown_connections 2024-04-15T00:21:23.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.763+0000 7fedab884640 1 -- 172.21.15.31:0/2149033586 wait complete. 2024-04-15T00:21:23.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.764+0000 7fedab884640 1 Processor -- start 2024-04-15T00:21:23.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.764+0000 7fedab884640 1 -- start start 2024-04-15T00:21:23.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.765+0000 7fedab884640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feda4072820 0x7feda40b6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:23.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.765+0000 7fedab884640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feda40b2d50 0x7feda40b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:23.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.765+0000 7fedab884640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feda40b7800 0x7feda40b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:23.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.765+0000 7fedab884640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7feda4141d70 con 0x7feda40b2d50 2024-04-15T00:21:23.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.765+0000 7fedab884640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7feda4141bf0 con 0x7feda40b7800 2024-04-15T00:21:23.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.765+0000 7fedab884640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7feda4141ef0 con 0x7feda4072820 2024-04-15T00:21:23.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.765+0000 7feda8e1f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feda40b2d50 0x7feda40b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:23.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.765+0000 7feda8e1f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feda40b2d50 0x7feda40b5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51616/0 (socket says 172.21.15.31:51616) 2024-04-15T00:21:23.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.765+0000 7feda8e1f640 1 -- 172.21.15.31:0/1768233348 learned_addr learned my addr 172.21.15.31:0/1768233348 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:23.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.765+0000 7feda9e21640 1 --2- 172.21.15.31:0/1768233348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feda40b7800 0x7feda40b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:23.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.765+0000 7feda9620640 1 --2- 172.21.15.31:0/1768233348 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feda4072820 0x7feda40b6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:23.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.765+0000 7feda8e1f640 1 -- 172.21.15.31:0/1768233348 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feda4072820 msgr2=0x7feda40b6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:23.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.765+0000 7feda8e1f640 1 --2- 172.21.15.31:0/1768233348 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feda4072820 0x7feda40b6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:23.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.765+0000 7feda8e1f640 1 -- 172.21.15.31:0/1768233348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feda40b7800 msgr2=0x7feda40b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:23.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.765+0000 7feda8e1f640 1 --2- 172.21.15.31:0/1768233348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feda40b7800 0x7feda40b4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:23.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.765+0000 7feda8e1f640 1 -- 172.21.15.31:0/1768233348 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda40b6240 con 0x7feda40b2d50 2024-04-15T00:21:23.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.765+0000 7feda9e21640 1 --2- 172.21.15.31:0/1768233348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feda40b7800 0x7feda40b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:23.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.766+0000 7feda8e1f640 1 --2- 172.21.15.31:0/1768233348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feda40b2d50 0x7feda40b5a80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fed9800e990 tx=0x7fed9800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:23.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.766+0000 7feda1ffb640 1 -- 172.21.15.31:0/1768233348 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed98017070 con 0x7feda40b2d50 2024-04-15T00:21:23.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.766+0000 7feda1ffb640 1 -- 172.21.15.31:0/1768233348 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed9800c9e0 con 0x7feda40b2d50 2024-04-15T00:21:23.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.766+0000 7fedab884640 1 -- 172.21.15.31:0/1768233348 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feda4147190 con 0x7feda40b2d50 2024-04-15T00:21:23.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.766+0000 7feda1ffb640 1 -- 172.21.15.31:0/1768233348 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9800cdb0 con 0x7feda40b2d50 2024-04-15T00:21:23.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.766+0000 7fedab884640 1 -- 172.21.15.31:0/1768233348 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feda4148230 con 0x7feda40b2d50 2024-04-15T00:21:23.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.767+0000 7fedab884640 1 -- 172.21.15.31:0/1768233348 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feda404f540 con 0x7feda40b2d50 2024-04-15T00:21:23.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.767+0000 7feda1ffb640 1 -- 172.21.15.31:0/1768233348 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fed9801a070 con 0x7feda40b2d50 2024-04-15T00:21:23.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.768+0000 7feda1ffb640 1 --2- 172.21.15.31:0/1768233348 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fed9006b990 0x7fed9006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:23.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.768+0000 7feda1ffb640 1 -- 172.21.15.31:0/1768233348 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fed9808ae10 con 0x7feda40b2d50 2024-04-15T00:21:23.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.768+0000 7feda9620640 1 --2- 172.21.15.31:0/1768233348 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fed9006b990 0x7fed9006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:23.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.768+0000 7feda9620640 1 --2- 172.21.15.31:0/1768233348 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fed9006b990 0x7fed9006de50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fed9c036000 tx=0x7fed9c03d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:23.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.772+0000 7feda1ffb640 1 -- 172.21.15.31:0/1768233348 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fed980596f0 con 0x7feda40b2d50 2024-04-15T00:21:23.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:23.992+0000 7fedab884640 1 -- 172.21.15.31:0/1768233348 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7feda409b5e0 con 0x7feda40b2d50 2024-04-15T00:21:24.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.637+0000 7feda1ffb640 1 -- 172.21.15.31:0/1768233348 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7fed98058ff0 con 0x7feda40b2d50 2024-04-15T00:21:24.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.640+0000 7fedab884640 1 -- 172.21.15.31:0/1768233348 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fed9006b990 msgr2=0x7fed9006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:24.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.640+0000 7fedab884640 1 --2- 172.21.15.31:0/1768233348 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fed9006b990 0x7fed9006de50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fed9c036000 tx=0x7fed9c03d040 comp rx=0 tx=0).stop 2024-04-15T00:21:24.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.640+0000 7fedab884640 1 -- 172.21.15.31:0/1768233348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feda40b2d50 msgr2=0x7feda40b5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:24.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.640+0000 7fedab884640 1 --2- 172.21.15.31:0/1768233348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feda40b2d50 0x7feda40b5a80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fed9800e990 tx=0x7fed9800ee50 comp rx=0 tx=0).stop 2024-04-15T00:21:24.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.640+0000 7fedab884640 1 -- 172.21.15.31:0/1768233348 shutdown_connections 2024-04-15T00:21:24.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.640+0000 7fedab884640 1 --2- 172.21.15.31:0/1768233348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feda40b7800 0x7feda40b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:24.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.640+0000 7fedab884640 1 --2- 172.21.15.31:0/1768233348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feda40b2d50 0x7feda40b5a80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:24.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.640+0000 7fedab884640 1 --2- 172.21.15.31:0/1768233348 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fed9006b990 0x7fed9006de50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:24.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.640+0000 7fedab884640 1 --2- 172.21.15.31:0/1768233348 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feda4072820 0x7feda40b6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:24.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.640+0000 7fedab884640 1 -- 172.21.15.31:0/1768233348 >> 172.21.15.31:0/1768233348 conn(0x7feda40bce80 msgr2=0x7feda409aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:24.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.640+0000 7fedab884640 1 -- 172.21.15.31:0/1768233348 shutdown_connections 2024-04-15T00:21:24.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.640+0000 7fedab884640 1 -- 172.21.15.31:0/1768233348 wait complete. 2024-04-15T00:21:24.660 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-15T00:21:24.660 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T00:21:24.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.759+0000 7fac11236640 1 Processor -- start 2024-04-15T00:21:24.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.759+0000 7fac11236640 1 -- start start 2024-04-15T00:21:24.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.760+0000 7fac11236640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac0c0b8bf0 0x7fac0c153000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:24.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.760+0000 7fac11236640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac0c0bb2d0 con 0x7fac0c14b8e0 2024-04-15T00:21:24.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.760+0000 7fac11236640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac0c14ae00 con 0x7fac0c0baef0 2024-04-15T00:21:24.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.760+0000 7fac11236640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fac0c14b0e0 con 0x7fac0c0b8bf0 2024-04-15T00:21:24.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.760+0000 7fac03fff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fac0c14b8e0 0x7fac0c0b9a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:39314/0 (socket says 172.21.15.31:39314) 2024-04-15T00:21:24.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.760+0000 7fac03fff640 1 -- 172.21.15.31:0/2769753023 learned_addr learned my addr 172.21.15.31:0/2769753023 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:24.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.760+0000 7fac0a59c640 1 -- 172.21.15.31:0/2769753023 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3679400914 0 0) 0x7fac0c0bb2d0 con 0x7fac0c14b8e0 2024-04-15T00:21:24.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.760+0000 7fac0a59c640 1 -- 172.21.15.31:0/2769753023 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabf8003520 con 0x7fac0c14b8e0 2024-04-15T00:21:24.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.760+0000 7fac0b59e640 1 --2- 172.21.15.31:0/2769753023 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac0c0b8bf0 0x7fac0c153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:24.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.760+0000 7fac0a59c640 1 -- 172.21.15.31:0/2769753023 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 310535482 0 0) 0x7fabf8003520 con 0x7fac0c14b8e0 2024-04-15T00:21:24.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.760+0000 7fac0a59c640 1 -- 172.21.15.31:0/2769753023 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac0c0b8bf0 msgr2=0x7fac0c153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:24.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.760+0000 7fac0a59c640 1 --2- 172.21.15.31:0/2769753023 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac0c0b8bf0 0x7fac0c153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:24.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.760+0000 7fac0a59c640 1 -- 172.21.15.31:0/2769753023 >> v1:172.21.15.50:6789/0 conn(0x7fac0c0baef0 legacy=0x7fac0c147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:24.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.760+0000 7fac0a59c640 1 -- 172.21.15.31:0/2769753023 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac0c0bcbb0 con 0x7fac0c14b8e0 2024-04-15T00:21:24.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.760+0000 7fac0a59c640 1 -- 172.21.15.31:0/2769753023 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 697057150 0 0) 0x7fabf4001670 con 0x7fac0c14b8e0 2024-04-15T00:21:24.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.760+0000 7fac0a59c640 1 -- 172.21.15.31:0/2769753023 >> v1:172.21.15.31:6789/0 conn(0x7fac0c14b8e0 legacy=0x7fac0c0b9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:24.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.760+0000 7fac0a59c640 1 --2- 172.21.15.31:0/2769753023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabf80039e0 0x7fabf8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:24.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.760+0000 7fac0a59c640 1 --2- 172.21.15.31:0/2769753023 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabf8004800 0x7fabf8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:24.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.760+0000 7fac0a59c640 1 --2- 172.21.15.31:0/2769753023 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac0c0b8bf0 0x7fabf800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:24.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.760+0000 7fac0a59c640 1 -- 172.21.15.31:0/2769753023 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fac0c14b0e0 con 0x7fabf8004800 2024-04-15T00:21:24.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.760+0000 7fac0a59c640 1 -- 172.21.15.31:0/2769753023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fabf8005520 con 0x7fabf80039e0 2024-04-15T00:21:24.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.760+0000 7fac0a59c640 1 -- 172.21.15.31:0/2769753023 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fabf800bf00 con 0x7fac0c0b8bf0 2024-04-15T00:21:24.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.760+0000 7fac03fff640 1 --2- 172.21.15.31:0/2769753023 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabf8004800 0x7fabf8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:24.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.761+0000 7fac0ad9d640 1 --2- 172.21.15.31:0/2769753023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabf80039e0 0x7fabf8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:24.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.761+0000 7fac0b59e640 1 --2- 172.21.15.31:0/2769753023 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac0c0b8bf0 0x7fabf800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:24.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.761+0000 7fac03fff640 1 -- 172.21.15.31:0/2769753023 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac0c0b8bf0 msgr2=0x7fabf800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:24.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.761+0000 7fac03fff640 1 --2- 172.21.15.31:0/2769753023 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac0c0b8bf0 0x7fabf800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:24.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.761+0000 7fac03fff640 1 -- 172.21.15.31:0/2769753023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabf80039e0 msgr2=0x7fabf8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:24.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.761+0000 7fac03fff640 1 --2- 172.21.15.31:0/2769753023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabf80039e0 0x7fabf8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:24.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.761+0000 7fac03fff640 1 -- 172.21.15.31:0/2769753023 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabf8003520 con 0x7fabf8004800 2024-04-15T00:21:24.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.761+0000 7fac03fff640 1 --2- 172.21.15.31:0/2769753023 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabf8004800 0x7fabf8004c80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fabf400c210 tx=0x7fabf8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a985d8247e8d3b server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:24.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.762+0000 7fac0a59c640 1 -- 172.21.15.31:0/2769753023 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf4007d30 con 0x7fabf8004800 2024-04-15T00:21:24.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.762+0000 7fac0a59c640 1 -- 172.21.15.31:0/2769753023 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabf4030070 con 0x7fabf8004800 2024-04-15T00:21:24.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.762+0000 7fac0a59c640 1 -- 172.21.15.31:0/2769753023 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf402cd60 con 0x7fabf8004800 2024-04-15T00:21:24.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.762+0000 7fac11236640 1 -- 172.21.15.31:0/2769753023 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabf8004800 msgr2=0x7fabf8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:24.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.762+0000 7fac11236640 1 --2- 172.21.15.31:0/2769753023 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabf8004800 0x7fabf8004c80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fabf400c210 tx=0x7fabf8005830 comp rx=0 tx=0).stop 2024-04-15T00:21:24.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.762+0000 7fac0b59e640 1 -- 172.21.15.31:0/2769753023 reap_dead start 2024-04-15T00:21:24.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.762+0000 7fac11236640 1 -- 172.21.15.31:0/2769753023 shutdown_connections 2024-04-15T00:21:24.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.762+0000 7fac11236640 1 -- 172.21.15.31:0/2769753023 >> 172.21.15.31:0/2769753023 conn(0x7fac0c09ed70 msgr2=0x7fac0c09f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:24.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.762+0000 7fac11236640 1 -- 172.21.15.31:0/2769753023 shutdown_connections 2024-04-15T00:21:24.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.762+0000 7fac11236640 1 -- 172.21.15.31:0/2769753023 wait complete. 2024-04-15T00:21:24.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.763+0000 7fac11236640 1 Processor -- start 2024-04-15T00:21:24.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.763+0000 7fac11236640 1 -- start start 2024-04-15T00:21:24.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.764+0000 7fac11236640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fabf8004800 0x7fac0c149af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:24.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.764+0000 7fac11236640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac0c1dd8d0 0x7fac0c142430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:24.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.764+0000 7fac11236640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac0c1ddd50 0x7fac0c142970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:24.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.764+0000 7fac11236640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fac0c150ff0 con 0x7fac0c1ddd50 2024-04-15T00:21:24.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.764+0000 7fac11236640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fac0c0b9310 con 0x7fac0c1dd8d0 2024-04-15T00:21:24.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.764+0000 7fac11236640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fac0c151170 con 0x7fabf8004800 2024-04-15T00:21:24.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.764+0000 7fac0b59e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac0c1ddd50 0x7fac0c142970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:24.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.764+0000 7fac0b59e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac0c1ddd50 0x7fac0c142970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51628/0 (socket says 172.21.15.31:51628) 2024-04-15T00:21:24.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.764+0000 7fac0b59e640 1 -- 172.21.15.31:0/3821259654 learned_addr learned my addr 172.21.15.31:0/3821259654 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:24.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.764+0000 7fac03fff640 1 --2- 172.21.15.31:0/3821259654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac0c1dd8d0 0x7fac0c142430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:24.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.764+0000 7fac0ad9d640 1 --2- 172.21.15.31:0/3821259654 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fabf8004800 0x7fac0c149af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:24.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.764+0000 7fac0b59e640 1 -- 172.21.15.31:0/3821259654 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fabf8004800 msgr2=0x7fac0c149af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:24.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.764+0000 7fac0b59e640 1 --2- 172.21.15.31:0/3821259654 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fabf8004800 0x7fac0c149af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:24.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.764+0000 7fac0b59e640 1 -- 172.21.15.31:0/3821259654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac0c1dd8d0 msgr2=0x7fac0c142430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:24.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.764+0000 7fac0b59e640 1 --2- 172.21.15.31:0/3821259654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac0c1dd8d0 0x7fac0c142430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:24.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.764+0000 7fac0b59e640 1 -- 172.21.15.31:0/3821259654 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac0c144ea0 con 0x7fac0c1ddd50 2024-04-15T00:21:24.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.765+0000 7fac0b59e640 1 --2- 172.21.15.31:0/3821259654 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac0c1ddd50 0x7fac0c142970 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fac040045e0 tx=0x7fac04007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:24.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.765+0000 7fac037fe640 1 -- 172.21.15.31:0/3821259654 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac040046d0 con 0x7fac0c1ddd50 2024-04-15T00:21:24.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.765+0000 7fac037fe640 1 -- 172.21.15.31:0/3821259654 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac0401a070 con 0x7fac0c1ddd50 2024-04-15T00:21:24.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.765+0000 7fac11236640 1 -- 172.21.15.31:0/3821259654 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac0c144bc0 con 0x7fac0c1ddd50 2024-04-15T00:21:24.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.765+0000 7fac037fe640 1 -- 172.21.15.31:0/3821259654 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac04015640 con 0x7fac0c1ddd50 2024-04-15T00:21:24.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.765+0000 7fac11236640 1 -- 172.21.15.31:0/3821259654 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac0c0a0e10 con 0x7fac0c1ddd50 2024-04-15T00:21:24.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.766+0000 7fac11236640 1 -- 172.21.15.31:0/3821259654 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac0c04f620 con 0x7fac0c1ddd50 2024-04-15T00:21:24.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.766+0000 7fac037fe640 1 -- 172.21.15.31:0/3821259654 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fac040157e0 con 0x7fac0c1ddd50 2024-04-15T00:21:24.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.767+0000 7fac037fe640 1 --2- 172.21.15.31:0/3821259654 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fabec06b990 0x7fabec06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:24.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.767+0000 7fac037fe640 1 -- 172.21.15.31:0/3821259654 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fac0408aff0 con 0x7fac0c1ddd50 2024-04-15T00:21:24.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.767+0000 7fac0ad9d640 1 --2- 172.21.15.31:0/3821259654 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fabec06b990 0x7fabec06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:24.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.767+0000 7fac0ad9d640 1 --2- 172.21.15.31:0/3821259654 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fabec06b990 0x7fabec06de50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0017e0 tx=0x7fabfc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:24.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.771+0000 7fac037fe640 1 -- 172.21.15.31:0/3821259654 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fac040592c0 con 0x7fac0c1ddd50 2024-04-15T00:21:24.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.990+0000 7fac11236640 1 -- 172.21.15.31:0/3821259654 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac0c147dd0 con 0x7fac0c1ddd50 2024-04-15T00:21:24.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.991+0000 7fac037fe640 1 -- 172.21.15.31:0/3821259654 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3520 (secure 0 0 0) 0x7fac0405d360 con 0x7fac0c1ddd50 2024-04-15T00:21:24.998 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:21:24.998 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/921487249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":921487249},{"type":"v1","addr":"172.21.15.50:6833","nonce":921487249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T00:21:07.925196+0000","modified":"2024-04-15T00:21:23.993707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/93464605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":93464605},{"type":"v1","addr":"172.21.15.31:6835","nonce":93464605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-04-15T00:21:24.999 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-04-15T00:21:25.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.993+0000 7fac11236640 1 -- 172.21.15.31:0/3821259654 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fabec06b990 msgr2=0x7fabec06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:25.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.993+0000 7fac11236640 1 --2- 172.21.15.31:0/3821259654 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fabec06b990 0x7fabec06de50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0017e0 tx=0x7fabfc009040 comp rx=0 tx=0).stop 2024-04-15T00:21:25.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.993+0000 7fac11236640 1 -- 172.21.15.31:0/3821259654 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac0c1ddd50 msgr2=0x7fac0c142970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:25.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.993+0000 7fac11236640 1 --2- 172.21.15.31:0/3821259654 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac0c1ddd50 0x7fac0c142970 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fac040045e0 tx=0x7fac04007700 comp rx=0 tx=0).stop 2024-04-15T00:21:25.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.993+0000 7fac11236640 1 -- 172.21.15.31:0/3821259654 shutdown_connections 2024-04-15T00:21:25.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.993+0000 7fac11236640 1 --2- 172.21.15.31:0/3821259654 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac0c1ddd50 0x7fac0c142970 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.993+0000 7fac11236640 1 --2- 172.21.15.31:0/3821259654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac0c1dd8d0 0x7fac0c142430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.993+0000 7fac11236640 1 --2- 172.21.15.31:0/3821259654 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fabec06b990 0x7fabec06de50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.993+0000 7fac11236640 1 --2- 172.21.15.31:0/3821259654 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fabf8004800 0x7fac0c149af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.993+0000 7fac11236640 1 -- 172.21.15.31:0/3821259654 >> 172.21.15.31:0/3821259654 conn(0x7fac0c09ed70 msgr2=0x7fac0c0bcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:25.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.993+0000 7fac11236640 1 -- 172.21.15.31:0/3821259654 shutdown_connections 2024-04-15T00:21:25.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:24.993+0000 7fac11236640 1 -- 172.21.15.31:0/3821259654 wait complete. 2024-04-15T00:21:25.011 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:21:25.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.106+0000 7f2aa0fcc640 1 Processor -- start 2024-04-15T00:21:25.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.106+0000 7f2aa0fcc640 1 -- start start 2024-04-15T00:21:25.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.106+0000 7f2aa0fcc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2a9c067180 0x7f2a9c0b0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:25.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.106+0000 7f2aa0fcc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2a9c0b4c20 0x7f2a9c0af930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:25.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.107+0000 7f2aa0fcc640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2a9c06b200 0x7f2a9c06b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:25.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.107+0000 7f2aa0fcc640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f2a9c0b50b0 con 0x7f2a9c0b4c20 2024-04-15T00:21:25.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.107+0000 7f2aa0fcc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f2a9c0af1d0 con 0x7f2a9c067180 2024-04-15T00:21:25.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.107+0000 7f2aa0fcc640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f2a9c067560 con 0x7f2a9c06b200 2024-04-15T00:21:25.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.107+0000 7f2a99d9b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2a9c0b4c20 0x7f2a9c0af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:25.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.107+0000 7f2a99d9b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2a9c0b4c20 0x7f2a9c0af930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51636/0 (socket says 172.21.15.31:51636) 2024-04-15T00:21:25.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.107+0000 7f2a99d9b640 1 -- 172.21.15.31:0/3702935750 learned_addr learned my addr 172.21.15.31:0/3702935750 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:25.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.107+0000 7f2a9a59c640 1 --2- 172.21.15.31:0/3702935750 >> v2:172.21.15.50:3300/0 conn(0x7f2a9c067180 0x7f2a9c0b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:25.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.107+0000 7f2a9ad9d640 1 --2- 172.21.15.31:0/3702935750 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2a9c06b200 0x7f2a9c06b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:25.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.107+0000 7f2a99d9b640 1 -- 172.21.15.31:0/3702935750 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2a9c06b200 msgr2=0x7f2a9c06b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:25.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.107+0000 7f2a99d9b640 1 --2- 172.21.15.31:0/3702935750 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2a9c06b200 0x7f2a9c06b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.107+0000 7f2a99d9b640 1 -- 172.21.15.31:0/3702935750 >> v2:172.21.15.50:3300/0 conn(0x7f2a9c067180 msgr2=0x7f2a9c0b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:25.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.107+0000 7f2a99d9b640 1 --2- 172.21.15.31:0/3702935750 >> v2:172.21.15.50:3300/0 conn(0x7f2a9c067180 0x7f2a9c0b0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.107+0000 7f2a99d9b640 1 -- 172.21.15.31:0/3702935750 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a9c09f250 con 0x7f2a9c0b4c20 2024-04-15T00:21:25.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.107+0000 7f2a9a59c640 1 --2- 172.21.15.31:0/3702935750 >> v2:172.21.15.50:3300/0 conn(0x7f2a9c067180 0x7f2a9c0b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:25.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.108+0000 7f2a99d9b640 1 --2- 172.21.15.31:0/3702935750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a9c0b4c20 0x7f2a9c0af930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c067ff0 tx=0x7f2a9002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb461c14e2a6a08a server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:25.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.108+0000 7f2a9959a640 1 -- 172.21.15.31:0/3702935750 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9002e070 con 0x7f2a9c0b4c20 2024-04-15T00:21:25.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.108+0000 7f2a9959a640 1 -- 172.21.15.31:0/3702935750 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a90037070 con 0x7f2a9c0b4c20 2024-04-15T00:21:25.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.108+0000 7f2a9959a640 1 -- 172.21.15.31:0/3702935750 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a90031a00 con 0x7f2a9c0b4c20 2024-04-15T00:21:25.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.108+0000 7f2aa0fcc640 1 -- 172.21.15.31:0/3702935750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a9c0b4c20 msgr2=0x7f2a9c0af930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:25.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.108+0000 7f2aa0fcc640 1 --2- 172.21.15.31:0/3702935750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a9c0b4c20 0x7f2a9c0af930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c067ff0 tx=0x7f2a9002b880 comp rx=0 tx=0).stop 2024-04-15T00:21:25.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.108+0000 7f2aa0fcc640 1 -- 172.21.15.31:0/3702935750 shutdown_connections 2024-04-15T00:21:25.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.108+0000 7f2aa0fcc640 1 --2- 172.21.15.31:0/3702935750 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2a9c06b200 0x7f2a9c06b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.108+0000 7f2aa0fcc640 1 --2- 172.21.15.31:0/3702935750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a9c0b4c20 0x7f2a9c0af930 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.108+0000 7f2aa0fcc640 1 --2- 172.21.15.31:0/3702935750 >> v2:172.21.15.50:3300/0 conn(0x7f2a9c067180 0x7f2a9c0b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.108+0000 7f2aa0fcc640 1 -- 172.21.15.31:0/3702935750 >> 172.21.15.31:0/3702935750 conn(0x7f2a9c0b6640 msgr2=0x7f2a9c0b6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:25.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.109+0000 7f2aa0fcc640 1 -- 172.21.15.31:0/3702935750 shutdown_connections 2024-04-15T00:21:25.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.109+0000 7f2aa0fcc640 1 -- 172.21.15.31:0/3702935750 wait complete. 2024-04-15T00:21:25.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.110+0000 7f2aa0fcc640 1 Processor -- start 2024-04-15T00:21:25.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.110+0000 7f2aa0fcc640 1 -- start start 2024-04-15T00:21:25.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.110+0000 7f2aa0fcc640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2a9c067180 0x7f2a9c0b3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:25.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.110+0000 7f2aa0fcc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a9c06b200 0x7f2a9c144480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:25.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.110+0000 7f2aa0fcc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a9c0b4c20 0x7f2a9c13dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:25.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.110+0000 7f2aa0fcc640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9c0b5be0 con 0x7f2a9c06b200 2024-04-15T00:21:25.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.110+0000 7f2aa0fcc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9c0b5a60 con 0x7f2a9c0b4c20 2024-04-15T00:21:25.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.110+0000 7f2aa0fcc640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f2a9c06bbd0 con 0x7f2a9c067180 2024-04-15T00:21:25.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.110+0000 7f2a99d9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a9c06b200 0x7f2a9c144480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:25.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.110+0000 7f2a99d9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a9c06b200 0x7f2a9c144480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51638/0 (socket says 172.21.15.31:51638) 2024-04-15T00:21:25.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.110+0000 7f2a99d9b640 1 -- 172.21.15.31:0/2913215888 learned_addr learned my addr 172.21.15.31:0/2913215888 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:25.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.111+0000 7f2a9ad9d640 1 --2- 172.21.15.31:0/2913215888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a9c0b4c20 0x7f2a9c13dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:25.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.111+0000 7f2a9a59c640 1 --2- 172.21.15.31:0/2913215888 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2a9c067180 0x7f2a9c0b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:25.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.111+0000 7f2a99d9b640 1 -- 172.21.15.31:0/2913215888 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2a9c067180 msgr2=0x7f2a9c0b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:25.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.111+0000 7f2a99d9b640 1 --2- 172.21.15.31:0/2913215888 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2a9c067180 0x7f2a9c0b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.111+0000 7f2a99d9b640 1 -- 172.21.15.31:0/2913215888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a9c0b4c20 msgr2=0x7f2a9c13dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:25.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.111+0000 7f2a99d9b640 1 --2- 172.21.15.31:0/2913215888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a9c0b4c20 0x7f2a9c13dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.111+0000 7f2a99d9b640 1 -- 172.21.15.31:0/2913215888 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a9c140770 con 0x7f2a9c06b200 2024-04-15T00:21:25.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.111+0000 7f2a9ad9d640 1 --2- 172.21.15.31:0/2913215888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a9c0b4c20 0x7f2a9c13dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:25.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.111+0000 7f2a9a59c640 1 --2- 172.21.15.31:0/2913215888 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2a9c067180 0x7f2a9c0b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:25.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.111+0000 7f2a99d9b640 1 --2- 172.21.15.31:0/2913215888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a9c06b200 0x7f2a9c144480 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2a90000c00 tx=0x7f2a900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:25.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.111+0000 7f2a8affd640 1 -- 172.21.15.31:0/2913215888 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a90032670 con 0x7f2a9c06b200 2024-04-15T00:21:25.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.111+0000 7f2a8affd640 1 -- 172.21.15.31:0/2913215888 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a90032850 con 0x7f2a9c06b200 2024-04-15T00:21:25.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.111+0000 7f2aa0fcc640 1 -- 172.21.15.31:0/2913215888 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a9c13eb90 con 0x7f2a9c06b200 2024-04-15T00:21:25.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.111+0000 7f2a8affd640 1 -- 172.21.15.31:0/2913215888 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a90032c40 con 0x7f2a9c06b200 2024-04-15T00:21:25.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.111+0000 7f2aa0fcc640 1 -- 172.21.15.31:0/2913215888 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a9c140490 con 0x7f2a9c06b200 2024-04-15T00:21:25.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.112+0000 7f2aa0fcc640 1 -- 172.21.15.31:0/2913215888 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a9c09f7c0 con 0x7f2a9c06b200 2024-04-15T00:21:25.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.112+0000 7f2a8affd640 1 -- 172.21.15.31:0/2913215888 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f2a9004c060 con 0x7f2a9c06b200 2024-04-15T00:21:25.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.113+0000 7f2a8affd640 1 --2- 172.21.15.31:0/2913215888 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f2a7c06b990 0x7f2a7c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:25.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.113+0000 7f2a9a59c640 1 --2- 172.21.15.31:0/2913215888 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f2a7c06b990 0x7f2a7c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:25.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.113+0000 7f2a8affd640 1 -- 172.21.15.31:0/2913215888 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2a900ac540 con 0x7f2a9c06b200 2024-04-15T00:21:25.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.113+0000 7f2a9a59c640 1 --2- 172.21.15.31:0/2913215888 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f2a7c06b990 0x7f2a7c06de50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c144d60 tx=0x7f2a8c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:25.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.117+0000 7f2a8affd640 1 -- 172.21.15.31:0/2913215888 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2a90040070 con 0x7f2a9c06b200 2024-04-15T00:21:25.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.299+0000 7f2aa0fcc640 1 -- 172.21.15.31:0/2913215888 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2a9c04f620 con 0x7f2a9c06b200 2024-04-15T00:21:25.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.300+0000 7f2a8affd640 1 -- 172.21.15.31:0/2913215888 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7f2a9007aea0 con 0x7f2a9c06b200 2024-04-15T00:21:25.308 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:21:25.308 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"fsid":"b57c03ab-2810-4ea5-b233-6164468328c0","created":"2024-04-15T00:20:44.073217+0000","modified":"2024-04-15T00:21:12.971956+0000","last_up_change":"2024-04-15T00:20:55.515596+0000","last_in_change":"2024-04-15T00:20:46.364541+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:20:56.423161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:21:06.436169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:21:06.888505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:21:10.610300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b085a2f4-5565-4ccc-a98e-e56180791550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6817","nonce":2355720818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6819","nonce":2355720818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6823","nonce":2355720818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6821","nonce":2355720818}]},"public_addr":"172.21.15.31:6817/2355720818","cluster_addr":"172.21.15.31:6819/2355720818","heartbeat_back_addr":"172.21.15.31:6823/2355720818","heartbeat_front_addr":"172.21.15.31:6821/2355720818","state":["exists","up"]},{"osd":1,"uuid":"0f751557-3f18-464f-8b78-614d19549f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6809","nonce":2705297130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6811","nonce":2705297130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6815","nonce":2705297130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6813","nonce":2705297130}]},"public_addr":"172.21.15.31:6809/2705297130","cluster_addr":"172.21.15.31:6811/2705297130","heartbeat_back_addr":"172.21.15.31:6815/2705297130","heartbeat_front_addr":"172.21.15.31:6813/2705297130","state":["exists","up"]},{"osd":2,"uuid":"17371b09-2bd7-4ef7-926f-e7706319f064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6801","nonce":225061474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6803","nonce":225061474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6807","nonce":225061474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6805","nonce":225061474}]},"public_addr":"172.21.15.31:6801/225061474","cluster_addr":"172.21.15.31:6803/225061474","heartbeat_back_addr":"172.21.15.31:6807/225061474","heartbeat_front_addr":"172.21.15.31:6805/225061474","state":["exists","up"]},{"osd":3,"uuid":"315b6949-f009-4291-9581-aa4912642dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6825","nonce":3722449780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6827","nonce":3722449780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6831","nonce":3722449780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6829","nonce":3722449780}]},"public_addr":"172.21.15.31:6825/3722449780","cluster_addr":"172.21.15.31:6827/3722449780","heartbeat_back_addr":"172.21.15.31:6831/3722449780","heartbeat_front_addr":"172.21.15.31:6829/3722449780","state":["exists","up"]},{"osd":4,"uuid":"e3659369-cc78-4aa8-bd10-a199d4a1569d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6801","nonce":1279970071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6803","nonce":1279970071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6807","nonce":1279970071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6805","nonce":1279970071}]},"public_addr":"172.21.15.50:6801/1279970071","cluster_addr":"172.21.15.50:6803/1279970071","heartbeat_back_addr":"172.21.15.50:6807/1279970071","heartbeat_front_addr":"172.21.15.50:6805/1279970071","state":["exists","up"]},{"osd":5,"uuid":"35c3a4c0-0b45-45d2-85b9-301c347602f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6809","nonce":1589417182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6811","nonce":1589417182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6815","nonce":1589417182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6813","nonce":1589417182}]},"public_addr":"172.21.15.50:6809/1589417182","cluster_addr":"172.21.15.50:6811/1589417182","heartbeat_back_addr":"172.21.15.50:6815/1589417182","heartbeat_front_addr":"172.21.15.50:6813/1589417182","state":["exists","up"]},{"osd":6,"uuid":"20df7a76-245f-4946-9624-6ca9e949227b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6817","nonce":682288274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6819","nonce":682288274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6823","nonce":682288274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6821","nonce":682288274}]},"public_addr":"172.21.15.50:6817/682288274","cluster_addr":"172.21.15.50:6819/682288274","heartbeat_back_addr":"172.21.15.50:6823/682288274","heartbeat_front_addr":"172.21.15.50:6821/682288274","state":["exists","up"]},{"osd":7,"uuid":"95a504b7-e13a-49e6-8484-9dff4d5fc048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6825","nonce":4129060906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6827","nonce":4129060906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6831","nonce":4129060906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6829","nonce":4129060906}]},"public_addr":"172.21.15.50:6825/4129060906","cluster_addr":"172.21.15.50:6827/4129060906","heartbeat_back_addr":"172.21.15.50:6831/4129060906","heartbeat_front_addr":"172.21.15.50:6829/4129060906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.501980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.529961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.540913+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.521396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.448364+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.514136+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.527229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.508950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:21:25.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.302+0000 7f2aa0fcc640 1 -- 172.21.15.31:0/2913215888 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f2a7c06b990 msgr2=0x7f2a7c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:25.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.302+0000 7f2aa0fcc640 1 --2- 172.21.15.31:0/2913215888 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f2a7c06b990 0x7f2a7c06de50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c144d60 tx=0x7f2a8c008040 comp rx=0 tx=0).stop 2024-04-15T00:21:25.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.302+0000 7f2aa0fcc640 1 -- 172.21.15.31:0/2913215888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a9c06b200 msgr2=0x7f2a9c144480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:25.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.302+0000 7f2aa0fcc640 1 --2- 172.21.15.31:0/2913215888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a9c06b200 0x7f2a9c144480 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2a90000c00 tx=0x7f2a900046c0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.302+0000 7f2aa0fcc640 1 -- 172.21.15.31:0/2913215888 shutdown_connections 2024-04-15T00:21:25.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.302+0000 7f2aa0fcc640 1 --2- 172.21.15.31:0/2913215888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a9c0b4c20 0x7f2a9c13dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.302+0000 7f2aa0fcc640 1 --2- 172.21.15.31:0/2913215888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a9c06b200 0x7f2a9c144480 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.302+0000 7f2aa0fcc640 1 --2- 172.21.15.31:0/2913215888 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f2a7c06b990 0x7f2a7c06de50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.302+0000 7f2aa0fcc640 1 --2- 172.21.15.31:0/2913215888 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2a9c067180 0x7f2a9c0b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.302+0000 7f2aa0fcc640 1 -- 172.21.15.31:0/2913215888 >> 172.21.15.31:0/2913215888 conn(0x7f2a9c0b6640 msgr2=0x7f2a9c06d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:25.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.303+0000 7f2aa0fcc640 1 -- 172.21.15.31:0/2913215888 shutdown_connections 2024-04-15T00:21:25.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.303+0000 7f2aa0fcc640 1 -- 172.21.15.31:0/2913215888 wait complete. 2024-04-15T00:21:25.321 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-15T00:21:25.321 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T00:21:25.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.415+0000 7f0d740a2640 1 Processor -- start 2024-04-15T00:21:25.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.415+0000 7f0d740a2640 1 -- start start 2024-04-15T00:21:25.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.415+0000 7f0d740a2640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0d6c0b8be0 0x7f0d6c072570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:25.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.415+0000 7f0d740a2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0d6c14b4c0 0x7f0d6c1449c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:25.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.415+0000 7f0d740a2640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d6c072c90 con 0x7f0d6c0b80d0 2024-04-15T00:21:25.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.416+0000 7f0d740a2640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f0d6c09c0e0 con 0x7f0d6c0b8be0 2024-04-15T00:21:25.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.416+0000 7f0d740a2640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f0d6c0b84b0 con 0x7f0d6c14b4c0 2024-04-15T00:21:25.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.416+0000 7f0d7163d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0d6c0b8be0 0x7f0d6c072570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:25.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.416+0000 7f0d7163d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0d6c0b8be0 0x7f0d6c072570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51640/0 (socket says 172.21.15.31:51640) 2024-04-15T00:21:25.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.416+0000 7f0d7163d640 1 -- 172.21.15.31:0/2701207248 learned_addr learned my addr 172.21.15.31:0/2701207248 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:25.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.416+0000 7f0d7263f640 1 --2- 172.21.15.31:0/2701207248 >> v2:172.21.15.50:3300/0 conn(0x7f0d6c14b4c0 0x7f0d6c1449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:25.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.416+0000 7f0d7163d640 1 -- 172.21.15.31:0/2701207248 >> v2:172.21.15.50:3300/0 conn(0x7f0d6c14b4c0 msgr2=0x7f0d6c1449c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:25.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.416+0000 7f0d7163d640 1 --2- 172.21.15.31:0/2701207248 >> v2:172.21.15.50:3300/0 conn(0x7f0d6c14b4c0 0x7f0d6c1449c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.416+0000 7f0d7163d640 1 -- 172.21.15.31:0/2701207248 >> v1:172.21.15.50:6789/0 conn(0x7f0d6c0b80d0 legacy=0x7f0d6c14adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:25.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.416+0000 7f0d7163d640 1 -- 172.21.15.31:0/2701207248 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d6c09c380 con 0x7f0d6c0b8be0 2024-04-15T00:21:25.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.417+0000 7f0d7163d640 1 --2- 172.21.15.31:0/2701207248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d6c0b8be0 0x7f0d6c072570 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c0b7320 tx=0x7f0d5c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21ddf672df467aa2 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:25.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.417+0000 7f0d70e3c640 1 -- 172.21.15.31:0/2701207248 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c02e070 con 0x7f0d6c0b8be0 2024-04-15T00:21:25.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.417+0000 7f0d70e3c640 1 -- 172.21.15.31:0/2701207248 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d5c037070 con 0x7f0d6c0b8be0 2024-04-15T00:21:25.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.417+0000 7f0d70e3c640 1 -- 172.21.15.31:0/2701207248 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c031a00 con 0x7f0d6c0b8be0 2024-04-15T00:21:25.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.417+0000 7f0d740a2640 1 -- 172.21.15.31:0/2701207248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d6c0b8be0 msgr2=0x7f0d6c072570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:25.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.417+0000 7f0d740a2640 1 --2- 172.21.15.31:0/2701207248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d6c0b8be0 0x7f0d6c072570 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c0b7320 tx=0x7f0d5c02b880 comp rx=0 tx=0).stop 2024-04-15T00:21:25.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.417+0000 7f0d740a2640 1 -- 172.21.15.31:0/2701207248 shutdown_connections 2024-04-15T00:21:25.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.417+0000 7f0d740a2640 1 --2- 172.21.15.31:0/2701207248 >> v2:172.21.15.50:3300/0 conn(0x7f0d6c14b4c0 0x7f0d6c1449c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.417+0000 7f0d740a2640 1 --2- 172.21.15.31:0/2701207248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d6c0b8be0 0x7f0d6c072570 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.417+0000 7f0d740a2640 1 -- 172.21.15.31:0/2701207248 >> 172.21.15.31:0/2701207248 conn(0x7f0d6c0bd020 msgr2=0x7f0d6c0bd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:25.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.418+0000 7f0d740a2640 1 -- 172.21.15.31:0/2701207248 shutdown_connections 2024-04-15T00:21:25.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.418+0000 7f0d740a2640 1 -- 172.21.15.31:0/2701207248 wait complete. 2024-04-15T00:21:25.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.419+0000 7f0d740a2640 1 Processor -- start 2024-04-15T00:21:25.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.419+0000 7f0d740a2640 1 -- start start 2024-04-15T00:21:25.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.419+0000 7f0d740a2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d6c0b80d0 0x7f0d6c146c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:25.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.419+0000 7f0d740a2640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d6c0b8be0 0x7f0d6c146270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:25.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.419+0000 7f0d740a2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d6c14b4c0 0x7f0d6c1dd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:25.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.419+0000 7f0d740a2640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6c145080 con 0x7f0d6c0b80d0 2024-04-15T00:21:25.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.419+0000 7f0d740a2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6c144f00 con 0x7f0d6c14b4c0 2024-04-15T00:21:25.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.419+0000 7f0d740a2640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f0d6c145200 con 0x7f0d6c0b8be0 2024-04-15T00:21:25.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.419+0000 7f0d71e3e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d6c0b80d0 0x7f0d6c146c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:25.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.419+0000 7f0d71e3e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d6c0b80d0 0x7f0d6c146c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51642/0 (socket says 172.21.15.31:51642) 2024-04-15T00:21:25.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.419+0000 7f0d71e3e640 1 -- 172.21.15.31:0/3546272398 learned_addr learned my addr 172.21.15.31:0/3546272398 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:25.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.420+0000 7f0d7263f640 1 --2- 172.21.15.31:0/3546272398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d6c14b4c0 0x7f0d6c1dd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:25.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.420+0000 7f0d7163d640 1 --2- 172.21.15.31:0/3546272398 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d6c0b8be0 0x7f0d6c146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:25.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.420+0000 7f0d71e3e640 1 -- 172.21.15.31:0/3546272398 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d6c0b8be0 msgr2=0x7f0d6c146270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:25.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.420+0000 7f0d71e3e640 1 --2- 172.21.15.31:0/3546272398 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d6c0b8be0 0x7f0d6c146270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.420+0000 7f0d71e3e640 1 -- 172.21.15.31:0/3546272398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d6c14b4c0 msgr2=0x7f0d6c1dd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:25.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.420+0000 7f0d71e3e640 1 --2- 172.21.15.31:0/3546272398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d6c14b4c0 0x7f0d6c1dd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.420+0000 7f0d71e3e640 1 -- 172.21.15.31:0/3546272398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d6c1dd900 con 0x7f0d6c0b80d0 2024-04-15T00:21:25.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.420+0000 7f0d7163d640 1 --2- 172.21.15.31:0/3546272398 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d6c0b8be0 0x7f0d6c146270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:21:25.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.420+0000 7f0d71e3e640 1 --2- 172.21.15.31:0/3546272398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d6c0b80d0 0x7f0d6c146c70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800c3f0 tx=0x7f0d6800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:25.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.420+0000 7f0d627fc640 1 -- 172.21.15.31:0/3546272398 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d680052d0 con 0x7f0d6c0b80d0 2024-04-15T00:21:25.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.420+0000 7f0d627fc640 1 -- 172.21.15.31:0/3546272398 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d68005490 con 0x7f0d6c0b80d0 2024-04-15T00:21:25.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.420+0000 7f0d740a2640 1 -- 172.21.15.31:0/3546272398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d6c0b27e0 con 0x7f0d6c0b80d0 2024-04-15T00:21:25.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.420+0000 7f0d627fc640 1 -- 172.21.15.31:0/3546272398 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d68007260 con 0x7f0d6c0b80d0 2024-04-15T00:21:25.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.420+0000 7f0d740a2640 1 -- 172.21.15.31:0/3546272398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d6c147d40 con 0x7f0d6c0b80d0 2024-04-15T00:21:25.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.421+0000 7f0d740a2640 1 -- 172.21.15.31:0/3546272398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d6c09f730 con 0x7f0d6c0b80d0 2024-04-15T00:21:25.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.421+0000 7f0d627fc640 1 -- 172.21.15.31:0/3546272398 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f0d68007400 con 0x7f0d6c0b80d0 2024-04-15T00:21:25.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.422+0000 7f0d627fc640 1 --2- 172.21.15.31:0/3546272398 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f0d5006b990 0x7f0d5006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:25.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.422+0000 7f0d627fc640 1 -- 172.21.15.31:0/3546272398 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0d68089f20 con 0x7f0d6c0b80d0 2024-04-15T00:21:25.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.422+0000 7f0d7163d640 1 --2- 172.21.15.31:0/3546272398 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f0d5006b990 0x7f0d5006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:25.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.422+0000 7f0d7163d640 1 --2- 172.21.15.31:0/3546272398 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f0d5006b990 0x7f0d5006de50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c036000 tx=0x7f0d5c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:25.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.426+0000 7f0d627fc640 1 -- 172.21.15.31:0/3546272398 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0d68058880 con 0x7f0d6c0b80d0 2024-04-15T00:21:25.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.603+0000 7f0d740a2640 1 -- 172.21.15.31:0/3546272398 --> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0d6c04f620 con 0x7f0d5006b990 2024-04-15T00:21:25.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.612+0000 7f0d627fc640 1 -- 172.21.15.31:0/3546272398 <== mgr.4107 v2:172.21.15.31:6832/915470279 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f0d6c04f620 con 0x7f0d5006b990 2024-04-15T00:21:25.623 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:21:25.625 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-15T00:21:25.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.616+0000 7f0d740a2640 1 -- 172.21.15.31:0/3546272398 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f0d5006b990 msgr2=0x7f0d5006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:25.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.616+0000 7f0d740a2640 1 --2- 172.21.15.31:0/3546272398 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f0d5006b990 0x7f0d5006de50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c036000 tx=0x7f0d5c008030 comp rx=0 tx=0).stop 2024-04-15T00:21:25.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.616+0000 7f0d740a2640 1 -- 172.21.15.31:0/3546272398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d6c0b80d0 msgr2=0x7f0d6c146c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:25.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.616+0000 7f0d740a2640 1 --2- 172.21.15.31:0/3546272398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d6c0b80d0 0x7f0d6c146c70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800c3f0 tx=0x7f0d6800c8b0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.616+0000 7f0d740a2640 1 -- 172.21.15.31:0/3546272398 shutdown_connections 2024-04-15T00:21:25.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.616+0000 7f0d740a2640 1 --2- 172.21.15.31:0/3546272398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d6c14b4c0 0x7f0d6c1dd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.616+0000 7f0d740a2640 1 --2- 172.21.15.31:0/3546272398 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f0d5006b990 0x7f0d5006de50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.616+0000 7f0d740a2640 1 --2- 172.21.15.31:0/3546272398 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0d6c0b8be0 0x7f0d6c146270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.616+0000 7f0d740a2640 1 --2- 172.21.15.31:0/3546272398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d6c0b80d0 0x7f0d6c146c70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.616+0000 7f0d740a2640 1 -- 172.21.15.31:0/3546272398 >> 172.21.15.31:0/3546272398 conn(0x7f0d6c0bd020 msgr2=0x7f0d6c09e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:25.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.616+0000 7f0d740a2640 1 -- 172.21.15.31:0/3546272398 shutdown_connections 2024-04-15T00:21:25.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.616+0000 7f0d740a2640 1 -- 172.21.15.31:0/3546272398 wait complete. 2024-04-15T00:21:25.634 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-04-15T00:21:24.394742+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231924,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742796,"statfs":{"total":773094113280,"available":772856623104,"internally_reserved":0,"allocated":3350528,"data_stored":2022430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.794585"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619325+0000","last_change":"2024-04-15T00:21:07.577313+0000","last_active":"2024-04-15T00:21:15.619325+0000","last_peered":"2024-04-15T00:21:15.619325+0000","last_clean":"2024-04-15T00:21:15.619325+0000","last_became_active":"2024-04-15T00:21:07.576921+0000","last_became_peered":"2024-04-15T00:21:07.576921+0000","last_unstale":"2024-04-15T00:21:15.619325+0000","last_undegraded":"2024-04-15T00:21:15.619325+0000","last_fullsized":"2024-04-15T00:21:15.619325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:41:31.846500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603048+0000","last_change":"2024-04-15T00:21:08.579912+0000","last_active":"2024-04-15T00:21:13.603048+0000","last_peered":"2024-04-15T00:21:13.603048+0000","last_clean":"2024-04-15T00:21:13.603048+0000","last_became_active":"2024-04-15T00:21:08.579545+0000","last_became_peered":"2024-04-15T00:21:08.579545+0000","last_unstale":"2024-04-15T00:21:13.603048+0000","last_undegraded":"2024-04-15T00:21:13.603048+0000","last_fullsized":"2024-04-15T00:21:13.603048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602258+0000","last_change":"2024-04-15T00:21:12.634366+0000","last_active":"2024-04-15T00:21:13.602258+0000","last_peered":"2024-04-15T00:21:13.602258+0000","last_clean":"2024-04-15T00:21:13.602258+0000","last_became_active":"2024-04-15T00:21:12.633323+0000","last_became_peered":"2024-04-15T00:21:12.633323+0000","last_unstale":"2024-04-15T00:21:13.602258+0000","last_undegraded":"2024-04-15T00:21:13.602258+0000","last_fullsized":"2024-04-15T00:21:13.602258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:26:21.575108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603161+0000","last_change":"2024-04-15T00:21:07.569057+0000","last_active":"2024-04-15T00:21:13.603161+0000","last_peered":"2024-04-15T00:21:13.603161+0000","last_clean":"2024-04-15T00:21:13.603161+0000","last_became_active":"2024-04-15T00:21:07.568724+0000","last_became_peered":"2024-04-15T00:21:07.568724+0000","last_unstale":"2024-04-15T00:21:13.603161+0000","last_undegraded":"2024-04-15T00:21:13.603161+0000","last_fullsized":"2024-04-15T00:21:13.603161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:21:35.113136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.621077+0000","last_change":"2024-04-15T00:21:08.598196+0000","last_active":"2024-04-15T00:21:15.621077+0000","last_peered":"2024-04-15T00:21:15.621077+0000","last_clean":"2024-04-15T00:21:15.621077+0000","last_became_active":"2024-04-15T00:21:08.597625+0000","last_became_peered":"2024-04-15T00:21:08.597625+0000","last_unstale":"2024-04-15T00:21:15.621077+0000","last_undegraded":"2024-04-15T00:21:15.621077+0000","last_fullsized":"2024-04-15T00:21:15.621077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602202+0000","last_change":"2024-04-15T00:21:12.624625+0000","last_active":"2024-04-15T00:21:13.602202+0000","last_peered":"2024-04-15T00:21:13.602202+0000","last_clean":"2024-04-15T00:21:13.602202+0000","last_became_active":"2024-04-15T00:21:12.624222+0000","last_became_peered":"2024-04-15T00:21:12.624222+0000","last_unstale":"2024-04-15T00:21:13.602202+0000","last_undegraded":"2024-04-15T00:21:13.602202+0000","last_fullsized":"2024-04-15T00:21:13.602202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:28.534842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.536054+0000","last_change":"2024-04-15T00:21:07.576936+0000","last_active":"2024-04-15T00:21:15.536054+0000","last_peered":"2024-04-15T00:21:15.536054+0000","last_clean":"2024-04-15T00:21:15.536054+0000","last_became_active":"2024-04-15T00:21:07.576674+0000","last_became_peered":"2024-04-15T00:21:07.576674+0000","last_unstale":"2024-04-15T00:21:15.536054+0000","last_undegraded":"2024-04-15T00:21:15.536054+0000","last_fullsized":"2024-04-15T00:21:15.536054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603516+0000","last_change":"2024-04-15T00:21:08.587098+0000","last_active":"2024-04-15T00:21:13.603516+0000","last_peered":"2024-04-15T00:21:13.603516+0000","last_clean":"2024-04-15T00:21:13.603516+0000","last_became_active":"2024-04-15T00:21:08.586825+0000","last_became_peered":"2024-04-15T00:21:08.586825+0000","last_unstale":"2024-04-15T00:21:13.603516+0000","last_undegraded":"2024-04-15T00:21:13.603516+0000","last_fullsized":"2024-04-15T00:21:13.603516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:30.470116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.604467+0000","last_change":"2024-04-15T00:21:12.619903+0000","last_active":"2024-04-15T00:21:13.604467+0000","last_peered":"2024-04-15T00:21:13.604467+0000","last_clean":"2024-04-15T00:21:13.604467+0000","last_became_active":"2024-04-15T00:21:12.619259+0000","last_became_peered":"2024-04-15T00:21:12.619259+0000","last_unstale":"2024-04-15T00:21:13.604467+0000","last_undegraded":"2024-04-15T00:21:13.604467+0000","last_fullsized":"2024-04-15T00:21:13.604467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:31.463828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535551+0000","last_change":"2024-04-15T00:21:07.579089+0000","last_active":"2024-04-15T00:21:15.535551+0000","last_peered":"2024-04-15T00:21:15.535551+0000","last_clean":"2024-04-15T00:21:15.535551+0000","last_became_active":"2024-04-15T00:21:07.578733+0000","last_became_peered":"2024-04-15T00:21:07.578733+0000","last_unstale":"2024-04-15T00:21:15.535551+0000","last_undegraded":"2024-04-15T00:21:15.535551+0000","last_fullsized":"2024-04-15T00:21:15.535551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:44:30.015803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603746+0000","last_change":"2024-04-15T00:21:08.588235+0000","last_active":"2024-04-15T00:21:13.603746+0000","last_peered":"2024-04-15T00:21:13.603746+0000","last_clean":"2024-04-15T00:21:13.603746+0000","last_became_active":"2024-04-15T00:21:08.587951+0000","last_became_peered":"2024-04-15T00:21:08.587951+0000","last_unstale":"2024-04-15T00:21:13.603746+0000","last_undegraded":"2024-04-15T00:21:13.603746+0000","last_fullsized":"2024-04-15T00:21:13.603746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:08.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603367+0000","last_change":"2024-04-15T00:21:12.613395+0000","last_active":"2024-04-15T00:21:13.603367+0000","last_peered":"2024-04-15T00:21:13.603367+0000","last_clean":"2024-04-15T00:21:13.603367+0000","last_became_active":"2024-04-15T00:21:12.612976+0000","last_became_peered":"2024-04-15T00:21:12.612976+0000","last_unstale":"2024-04-15T00:21:13.603367+0000","last_undegraded":"2024-04-15T00:21:13.603367+0000","last_fullsized":"2024-04-15T00:21:13.603367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:05.044024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620111+0000","last_change":"2024-04-15T00:21:08.585248+0000","last_active":"2024-04-15T00:21:15.620111+0000","last_peered":"2024-04-15T00:21:15.620111+0000","last_clean":"2024-04-15T00:21:15.620111+0000","last_became_active":"2024-04-15T00:21:08.584882+0000","last_became_peered":"2024-04-15T00:21:08.584882+0000","last_unstale":"2024-04-15T00:21:15.620111+0000","last_undegraded":"2024-04-15T00:21:15.620111+0000","last_fullsized":"2024-04-15T00:21:15.620111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:27:41.268464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535912+0000","last_change":"2024-04-15T00:21:07.580541+0000","last_active":"2024-04-15T00:21:15.535912+0000","last_peered":"2024-04-15T00:21:15.535912+0000","last_clean":"2024-04-15T00:21:15.535912+0000","last_became_active":"2024-04-15T00:21:07.580229+0000","last_became_peered":"2024-04-15T00:21:07.580229+0000","last_unstale":"2024-04-15T00:21:15.535912+0000","last_undegraded":"2024-04-15T00:21:15.535912+0000","last_fullsized":"2024-04-15T00:21:15.535912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:34:26.325595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602904+0000","last_change":"2024-04-15T00:21:12.624175+0000","last_active":"2024-04-15T00:21:13.602904+0000","last_peered":"2024-04-15T00:21:13.602904+0000","last_clean":"2024-04-15T00:21:13.602904+0000","last_became_active":"2024-04-15T00:21:12.623783+0000","last_became_peered":"2024-04-15T00:21:12.623783+0000","last_unstale":"2024-04-15T00:21:13.602904+0000","last_undegraded":"2024-04-15T00:21:13.602904+0000","last_fullsized":"2024-04-15T00:21:13.602904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:22:04.031788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602602+0000","last_change":"2024-04-15T00:21:08.594955+0000","last_active":"2024-04-15T00:21:13.602602+0000","last_peered":"2024-04-15T00:21:13.602602+0000","last_clean":"2024-04-15T00:21:13.602602+0000","last_became_active":"2024-04-15T00:21:08.594535+0000","last_became_peered":"2024-04-15T00:21:08.594535+0000","last_unstale":"2024-04-15T00:21:13.602602+0000","last_undegraded":"2024-04-15T00:21:13.602602+0000","last_fullsized":"2024-04-15T00:21:13.602602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:40.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619669+0000","last_change":"2024-04-15T00:21:07.570862+0000","last_active":"2024-04-15T00:21:15.619669+0000","last_peered":"2024-04-15T00:21:15.619669+0000","last_clean":"2024-04-15T00:21:15.619669+0000","last_became_active":"2024-04-15T00:21:07.570555+0000","last_became_peered":"2024-04-15T00:21:07.570555+0000","last_unstale":"2024-04-15T00:21:15.619669+0000","last_undegraded":"2024-04-15T00:21:15.619669+0000","last_fullsized":"2024-04-15T00:21:15.619669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:54.810223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602579+0000","last_change":"2024-04-15T00:21:12.624936+0000","last_active":"2024-04-15T00:21:13.602579+0000","last_peered":"2024-04-15T00:21:13.602579+0000","last_clean":"2024-04-15T00:21:13.602579+0000","last_became_active":"2024-04-15T00:21:12.623808+0000","last_became_peered":"2024-04-15T00:21:12.623808+0000","last_unstale":"2024-04-15T00:21:13.602579+0000","last_undegraded":"2024-04-15T00:21:13.602579+0000","last_fullsized":"2024-04-15T00:21:13.602579+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:12.264127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602413+0000","last_change":"2024-04-15T00:21:08.574901+0000","last_active":"2024-04-15T00:21:13.602413+0000","last_peered":"2024-04-15T00:21:13.602413+0000","last_clean":"2024-04-15T00:21:13.602413+0000","last_became_active":"2024-04-15T00:21:08.574536+0000","last_became_peered":"2024-04-15T00:21:08.574536+0000","last_unstale":"2024-04-15T00:21:13.602413+0000","last_undegraded":"2024-04-15T00:21:13.602413+0000","last_fullsized":"2024-04-15T00:21:13.602413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:08.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619923+0000","last_change":"2024-04-15T00:21:07.577048+0000","last_active":"2024-04-15T00:21:15.619923+0000","last_peered":"2024-04-15T00:21:15.619923+0000","last_clean":"2024-04-15T00:21:15.619923+0000","last_became_active":"2024-04-15T00:21:07.576739+0000","last_became_peered":"2024-04-15T00:21:07.576739+0000","last_unstale":"2024-04-15T00:21:15.619923+0000","last_undegraded":"2024-04-15T00:21:15.619923+0000","last_fullsized":"2024-04-15T00:21:15.619923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:14.441186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620337+0000","last_change":"2024-04-15T00:21:12.632213+0000","last_active":"2024-04-15T00:21:15.620337+0000","last_peered":"2024-04-15T00:21:15.620337+0000","last_clean":"2024-04-15T00:21:15.620337+0000","last_became_active":"2024-04-15T00:21:12.631900+0000","last_became_peered":"2024-04-15T00:21:12.631900+0000","last_unstale":"2024-04-15T00:21:15.620337+0000","last_undegraded":"2024-04-15T00:21:15.620337+0000","last_fullsized":"2024-04-15T00:21:15.620337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:52:31.142377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602577+0000","last_change":"2024-04-15T00:21:08.590270+0000","last_active":"2024-04-15T00:21:13.602577+0000","last_peered":"2024-04-15T00:21:13.602577+0000","last_clean":"2024-04-15T00:21:13.602577+0000","last_became_active":"2024-04-15T00:21:08.589960+0000","last_became_peered":"2024-04-15T00:21:08.589960+0000","last_unstale":"2024-04-15T00:21:13.602577+0000","last_undegraded":"2024-04-15T00:21:13.602577+0000","last_fullsized":"2024-04-15T00:21:13.602577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:52.880065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535251+0000","last_change":"2024-04-15T00:21:07.577518+0000","last_active":"2024-04-15T00:21:15.535251+0000","last_peered":"2024-04-15T00:21:15.535251+0000","last_clean":"2024-04-15T00:21:15.535251+0000","last_became_active":"2024-04-15T00:21:07.576961+0000","last_became_peered":"2024-04-15T00:21:07.576961+0000","last_unstale":"2024-04-15T00:21:15.535251+0000","last_undegraded":"2024-04-15T00:21:15.535251+0000","last_fullsized":"2024-04-15T00:21:15.535251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:14.441186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602862+0000","last_change":"2024-04-15T00:21:12.624501+0000","last_active":"2024-04-15T00:21:13.602862+0000","last_peered":"2024-04-15T00:21:13.602862+0000","last_clean":"2024-04-15T00:21:13.602862+0000","last_became_active":"2024-04-15T00:21:12.624011+0000","last_became_peered":"2024-04-15T00:21:12.624011+0000","last_unstale":"2024-04-15T00:21:13.602862+0000","last_undegraded":"2024-04-15T00:21:13.602862+0000","last_fullsized":"2024-04-15T00:21:13.602862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:10:28.514357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620962+0000","last_change":"2024-04-15T00:21:08.601349+0000","last_active":"2024-04-15T00:21:15.620962+0000","last_peered":"2024-04-15T00:21:15.620962+0000","last_clean":"2024-04-15T00:21:15.620962+0000","last_became_active":"2024-04-15T00:21:08.601048+0000","last_became_peered":"2024-04-15T00:21:08.601048+0000","last_unstale":"2024-04-15T00:21:15.620962+0000","last_undegraded":"2024-04-15T00:21:15.620962+0000","last_fullsized":"2024-04-15T00:21:15.620962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:27:41.268464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619530+0000","last_change":"2024-04-15T00:21:07.577793+0000","last_active":"2024-04-15T00:21:15.619530+0000","last_peered":"2024-04-15T00:21:15.619530+0000","last_clean":"2024-04-15T00:21:15.619530+0000","last_became_active":"2024-04-15T00:21:07.577472+0000","last_became_peered":"2024-04-15T00:21:07.577472+0000","last_unstale":"2024-04-15T00:21:15.619530+0000","last_undegraded":"2024-04-15T00:21:15.619530+0000","last_fullsized":"2024-04-15T00:21:15.619530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:54.810223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602347+0000","last_change":"2024-04-15T00:21:12.634814+0000","last_active":"2024-04-15T00:21:13.602347+0000","last_peered":"2024-04-15T00:21:13.602347+0000","last_clean":"2024-04-15T00:21:13.602347+0000","last_became_active":"2024-04-15T00:21:12.633228+0000","last_became_peered":"2024-04-15T00:21:12.633228+0000","last_unstale":"2024-04-15T00:21:13.602347+0000","last_undegraded":"2024-04-15T00:21:13.602347+0000","last_fullsized":"2024-04-15T00:21:13.602347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:13.312501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602987+0000","last_change":"2024-04-15T00:21:08.596235+0000","last_active":"2024-04-15T00:21:13.602987+0000","last_peered":"2024-04-15T00:21:13.602987+0000","last_clean":"2024-04-15T00:21:13.602987+0000","last_became_active":"2024-04-15T00:21:08.595901+0000","last_became_peered":"2024-04-15T00:21:08.595901+0000","last_unstale":"2024-04-15T00:21:13.602987+0000","last_undegraded":"2024-04-15T00:21:13.602987+0000","last_fullsized":"2024-04-15T00:21:13.602987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:21:59.995077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620914+0000","last_change":"2024-04-15T00:21:07.573285+0000","last_active":"2024-04-15T00:21:15.620914+0000","last_peered":"2024-04-15T00:21:15.620914+0000","last_clean":"2024-04-15T00:21:15.620914+0000","last_became_active":"2024-04-15T00:21:07.572973+0000","last_became_peered":"2024-04-15T00:21:07.572973+0000","last_unstale":"2024-04-15T00:21:15.620914+0000","last_undegraded":"2024-04-15T00:21:15.620914+0000","last_fullsized":"2024-04-15T00:21:15.620914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602159+0000","last_change":"2024-04-15T00:21:12.633602+0000","last_active":"2024-04-15T00:21:13.602159+0000","last_peered":"2024-04-15T00:21:13.602159+0000","last_clean":"2024-04-15T00:21:13.602159+0000","last_became_active":"2024-04-15T00:21:12.633178+0000","last_became_peered":"2024-04-15T00:21:12.633178+0000","last_unstale":"2024-04-15T00:21:13.602159+0000","last_undegraded":"2024-04-15T00:21:13.602159+0000","last_fullsized":"2024-04-15T00:21:13.602159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:01:48.959493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.621191+0000","last_change":"2024-04-15T00:21:08.580727+0000","last_active":"2024-04-15T00:21:15.621191+0000","last_peered":"2024-04-15T00:21:15.621191+0000","last_clean":"2024-04-15T00:21:15.621191+0000","last_became_active":"2024-04-15T00:21:08.580418+0000","last_became_peered":"2024-04-15T00:21:08.580418+0000","last_unstale":"2024-04-15T00:21:15.621191+0000","last_undegraded":"2024-04-15T00:21:15.621191+0000","last_fullsized":"2024-04-15T00:21:15.621191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.536148+0000","last_change":"2024-04-15T00:21:07.575864+0000","last_active":"2024-04-15T00:21:15.536148+0000","last_peered":"2024-04-15T00:21:15.536148+0000","last_clean":"2024-04-15T00:21:15.536148+0000","last_became_active":"2024-04-15T00:21:07.575562+0000","last_became_peered":"2024-04-15T00:21:07.575562+0000","last_unstale":"2024-04-15T00:21:15.536148+0000","last_undegraded":"2024-04-15T00:21:15.536148+0000","last_fullsized":"2024-04-15T00:21:15.536148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:35:39.009511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620429+0000","last_change":"2024-04-15T00:21:12.633674+0000","last_active":"2024-04-15T00:21:15.620429+0000","last_peered":"2024-04-15T00:21:15.620429+0000","last_clean":"2024-04-15T00:21:15.620429+0000","last_became_active":"2024-04-15T00:21:12.633277+0000","last_became_peered":"2024-04-15T00:21:12.633277+0000","last_unstale":"2024-04-15T00:21:15.620429+0000","last_undegraded":"2024-04-15T00:21:15.620429+0000","last_fullsized":"2024-04-15T00:21:15.620429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:49.295552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603880+0000","last_change":"2024-04-15T00:21:08.578321+0000","last_active":"2024-04-15T00:21:13.603880+0000","last_peered":"2024-04-15T00:21:13.603880+0000","last_clean":"2024-04-15T00:21:13.603880+0000","last_became_active":"2024-04-15T00:21:08.578017+0000","last_became_peered":"2024-04-15T00:21:08.578017+0000","last_unstale":"2024-04-15T00:21:13.603880+0000","last_undegraded":"2024-04-15T00:21:13.603880+0000","last_fullsized":"2024-04-15T00:21:13.603880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:40.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.621338+0000","last_change":"2024-04-15T00:21:07.575183+0000","last_active":"2024-04-15T00:21:15.621338+0000","last_peered":"2024-04-15T00:21:15.621338+0000","last_clean":"2024-04-15T00:21:15.621338+0000","last_became_active":"2024-04-15T00:21:07.574822+0000","last_became_peered":"2024-04-15T00:21:07.574822+0000","last_unstale":"2024-04-15T00:21:15.621338+0000","last_undegraded":"2024-04-15T00:21:15.621338+0000","last_fullsized":"2024-04-15T00:21:15.621338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:26:22.612110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619998+0000","last_change":"2024-04-15T00:21:12.620150+0000","last_active":"2024-04-15T00:21:15.619998+0000","last_peered":"2024-04-15T00:21:15.619998+0000","last_clean":"2024-04-15T00:21:15.619998+0000","last_became_active":"2024-04-15T00:21:12.619694+0000","last_became_peered":"2024-04-15T00:21:12.619694+0000","last_unstale":"2024-04-15T00:21:15.619998+0000","last_undegraded":"2024-04-15T00:21:15.619998+0000","last_fullsized":"2024-04-15T00:21:15.619998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:34.506827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.604336+0000","last_change":"2024-04-15T00:21:08.596959+0000","last_active":"2024-04-15T00:21:13.604336+0000","last_peered":"2024-04-15T00:21:13.604336+0000","last_clean":"2024-04-15T00:21:13.604336+0000","last_became_active":"2024-04-15T00:21:08.596678+0000","last_became_peered":"2024-04-15T00:21:08.596678+0000","last_unstale":"2024-04-15T00:21:13.604336+0000","last_undegraded":"2024-04-15T00:21:13.604336+0000","last_fullsized":"2024-04-15T00:21:13.604336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:35:40.014598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603779+0000","last_change":"2024-04-15T00:21:07.574514+0000","last_active":"2024-04-15T00:21:13.603779+0000","last_peered":"2024-04-15T00:21:13.603779+0000","last_clean":"2024-04-15T00:21:13.603779+0000","last_became_active":"2024-04-15T00:21:07.574228+0000","last_became_peered":"2024-04-15T00:21:07.574228+0000","last_unstale":"2024-04-15T00:21:13.603779+0000","last_undegraded":"2024-04-15T00:21:13.603779+0000","last_fullsized":"2024-04-15T00:21:13.603779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.621262+0000","last_change":"2024-04-15T00:21:12.619733+0000","last_active":"2024-04-15T00:21:15.621262+0000","last_peered":"2024-04-15T00:21:15.621262+0000","last_clean":"2024-04-15T00:21:15.621262+0000","last_became_active":"2024-04-15T00:21:12.619307+0000","last_became_peered":"2024-04-15T00:21:12.619307+0000","last_unstale":"2024-04-15T00:21:15.621262+0000","last_undegraded":"2024-04-15T00:21:15.621262+0000","last_fullsized":"2024-04-15T00:21:15.621262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:48:00.696018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.621663+0000","last_change":"2024-04-15T00:21:08.589246+0000","last_active":"2024-04-15T00:21:15.621663+0000","last_peered":"2024-04-15T00:21:15.621663+0000","last_clean":"2024-04-15T00:21:15.621663+0000","last_became_active":"2024-04-15T00:21:08.588920+0000","last_became_peered":"2024-04-15T00:21:08.588920+0000","last_unstale":"2024-04-15T00:21:15.621663+0000","last_undegraded":"2024-04-15T00:21:15.621663+0000","last_fullsized":"2024-04-15T00:21:15.621663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619227+0000","last_change":"2024-04-15T00:21:07.566537+0000","last_active":"2024-04-15T00:21:15.619227+0000","last_peered":"2024-04-15T00:21:15.619227+0000","last_clean":"2024-04-15T00:21:15.619227+0000","last_became_active":"2024-04-15T00:21:07.566240+0000","last_became_peered":"2024-04-15T00:21:07.566240+0000","last_unstale":"2024-04-15T00:21:15.619227+0000","last_undegraded":"2024-04-15T00:21:15.619227+0000","last_fullsized":"2024-04-15T00:21:15.619227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:16:52.647503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.621073+0000","last_change":"2024-04-15T00:21:12.623452+0000","last_active":"2024-04-15T00:21:15.621073+0000","last_peered":"2024-04-15T00:21:15.621073+0000","last_clean":"2024-04-15T00:21:15.621073+0000","last_became_active":"2024-04-15T00:21:12.623066+0000","last_became_peered":"2024-04-15T00:21:12.623066+0000","last_unstale":"2024-04-15T00:21:15.621073+0000","last_undegraded":"2024-04-15T00:21:15.621073+0000","last_fullsized":"2024-04-15T00:21:15.621073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:11:16.107864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619704+0000","last_change":"2024-04-15T00:21:08.586376+0000","last_active":"2024-04-15T00:21:15.619704+0000","last_peered":"2024-04-15T00:21:15.619704+0000","last_clean":"2024-04-15T00:21:15.619704+0000","last_became_active":"2024-04-15T00:21:08.586054+0000","last_became_peered":"2024-04-15T00:21:08.586054+0000","last_unstale":"2024-04-15T00:21:15.619704+0000","last_undegraded":"2024-04-15T00:21:15.619704+0000","last_fullsized":"2024-04-15T00:21:15.619704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:02:56.329428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535288+0000","last_change":"2024-04-15T00:21:07.577289+0000","last_active":"2024-04-15T00:21:15.535288+0000","last_peered":"2024-04-15T00:21:15.535288+0000","last_clean":"2024-04-15T00:21:15.535288+0000","last_became_active":"2024-04-15T00:21:07.576602+0000","last_became_peered":"2024-04-15T00:21:07.576602+0000","last_unstale":"2024-04-15T00:21:15.535288+0000","last_undegraded":"2024-04-15T00:21:15.535288+0000","last_fullsized":"2024-04-15T00:21:15.535288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:26:22.612110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620938+0000","last_change":"2024-04-15T00:21:12.634248+0000","last_active":"2024-04-15T00:21:15.620938+0000","last_peered":"2024-04-15T00:21:15.620938+0000","last_clean":"2024-04-15T00:21:15.620938+0000","last_became_active":"2024-04-15T00:21:12.633239+0000","last_became_peered":"2024-04-15T00:21:12.633239+0000","last_unstale":"2024-04-15T00:21:15.620938+0000","last_undegraded":"2024-04-15T00:21:15.620938+0000","last_fullsized":"2024-04-15T00:21:15.620938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:52:31.142377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602451+0000","last_change":"2024-04-15T00:21:08.591060+0000","last_active":"2024-04-15T00:21:13.602451+0000","last_peered":"2024-04-15T00:21:13.602451+0000","last_clean":"2024-04-15T00:21:13.602451+0000","last_became_active":"2024-04-15T00:21:08.590781+0000","last_became_peered":"2024-04-15T00:21:08.590781+0000","last_unstale":"2024-04-15T00:21:13.602451+0000","last_undegraded":"2024-04-15T00:21:13.602451+0000","last_fullsized":"2024-04-15T00:21:13.602451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603293+0000","last_change":"2024-04-15T00:21:07.573617+0000","last_active":"2024-04-15T00:21:13.603293+0000","last_peered":"2024-04-15T00:21:13.603293+0000","last_clean":"2024-04-15T00:21:13.603293+0000","last_became_active":"2024-04-15T00:21:07.573308+0000","last_became_peered":"2024-04-15T00:21:07.573308+0000","last_unstale":"2024-04-15T00:21:13.603293+0000","last_undegraded":"2024-04-15T00:21:13.603293+0000","last_fullsized":"2024-04-15T00:21:13.603293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:36:11.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535374+0000","last_change":"2024-04-15T00:20:57.937516+0000","last_active":"2024-04-15T00:21:15.535374+0000","last_peered":"2024-04-15T00:21:15.535374+0000","last_clean":"2024-04-15T00:21:15.535374+0000","last_became_active":"2024-04-15T00:20:57.936329+0000","last_became_peered":"2024-04-15T00:20:57.936329+0000","last_unstale":"2024-04-15T00:21:15.535374+0000","last_undegraded":"2024-04-15T00:21:15.535374+0000","last_fullsized":"2024-04-15T00:21:15.535374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:20:56.517419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:20:56.517419+0000","last_clean_scrub_stamp":"2024-04-15T00:20:56.517419+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:07:23.949459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620409+0000","last_change":"2024-04-15T00:21:12.633530+0000","last_active":"2024-04-15T00:21:15.620409+0000","last_peered":"2024-04-15T00:21:15.620409+0000","last_clean":"2024-04-15T00:21:15.620409+0000","last_became_active":"2024-04-15T00:21:12.633124+0000","last_became_peered":"2024-04-15T00:21:12.633124+0000","last_unstale":"2024-04-15T00:21:15.620409+0000","last_undegraded":"2024-04-15T00:21:15.620409+0000","last_fullsized":"2024-04-15T00:21:15.620409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:49.295552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535728+0000","last_change":"2024-04-15T00:21:08.583443+0000","last_active":"2024-04-15T00:21:15.535728+0000","last_peered":"2024-04-15T00:21:15.535728+0000","last_clean":"2024-04-15T00:21:15.535728+0000","last_became_active":"2024-04-15T00:21:08.583143+0000","last_became_peered":"2024-04-15T00:21:08.583143+0000","last_unstale":"2024-04-15T00:21:15.535728+0000","last_undegraded":"2024-04-15T00:21:15.535728+0000","last_fullsized":"2024-04-15T00:21:15.535728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:01.007313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619590+0000","last_change":"2024-04-15T00:21:07.579386+0000","last_active":"2024-04-15T00:21:15.619590+0000","last_peered":"2024-04-15T00:21:15.619590+0000","last_clean":"2024-04-15T00:21:15.619590+0000","last_became_active":"2024-04-15T00:21:07.579024+0000","last_became_peered":"2024-04-15T00:21:07.579024+0000","last_unstale":"2024-04-15T00:21:15.619590+0000","last_undegraded":"2024-04-15T00:21:15.619590+0000","last_fullsized":"2024-04-15T00:21:15.619590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:36:11.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620189+0000","last_change":"2024-04-15T00:21:12.635286+0000","last_active":"2024-04-15T00:21:15.620189+0000","last_peered":"2024-04-15T00:21:15.620189+0000","last_clean":"2024-04-15T00:21:15.620189+0000","last_became_active":"2024-04-15T00:21:12.634689+0000","last_became_peered":"2024-04-15T00:21:12.634689+0000","last_unstale":"2024-04-15T00:21:15.620189+0000","last_undegraded":"2024-04-15T00:21:15.620189+0000","last_fullsized":"2024-04-15T00:21:15.620189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:05.044024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603811+0000","last_change":"2024-04-15T00:21:08.579790+0000","last_active":"2024-04-15T00:21:13.603811+0000","last_peered":"2024-04-15T00:21:13.603811+0000","last_clean":"2024-04-15T00:21:13.603811+0000","last_became_active":"2024-04-15T00:21:08.576604+0000","last_became_peered":"2024-04-15T00:21:08.576604+0000","last_unstale":"2024-04-15T00:21:13.603811+0000","last_undegraded":"2024-04-15T00:21:13.603811+0000","last_fullsized":"2024-04-15T00:21:13.603811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:52:10.558592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619527+0000","last_change":"2024-04-15T00:21:07.571553+0000","last_active":"2024-04-15T00:21:15.619527+0000","last_peered":"2024-04-15T00:21:15.619527+0000","last_clean":"2024-04-15T00:21:15.619527+0000","last_became_active":"2024-04-15T00:21:07.571238+0000","last_became_peered":"2024-04-15T00:21:07.571238+0000","last_unstale":"2024-04-15T00:21:15.619527+0000","last_undegraded":"2024-04-15T00:21:15.619527+0000","last_fullsized":"2024-04-15T00:21:15.619527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:35:39.009511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620592+0000","last_change":"2024-04-15T00:21:12.619646+0000","last_active":"2024-04-15T00:21:15.620592+0000","last_peered":"2024-04-15T00:21:15.620592+0000","last_clean":"2024-04-15T00:21:15.620592+0000","last_became_active":"2024-04-15T00:21:12.619263+0000","last_became_peered":"2024-04-15T00:21:12.619263+0000","last_unstale":"2024-04-15T00:21:15.620592+0000","last_undegraded":"2024-04-15T00:21:15.620592+0000","last_fullsized":"2024-04-15T00:21:15.620592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:31.463828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.536088+0000","last_change":"2024-04-15T00:21:08.599410+0000","last_active":"2024-04-15T00:21:15.536088+0000","last_peered":"2024-04-15T00:21:15.536088+0000","last_clean":"2024-04-15T00:21:15.536088+0000","last_became_active":"2024-04-15T00:21:08.599132+0000","last_became_peered":"2024-04-15T00:21:08.599132+0000","last_unstale":"2024-04-15T00:21:15.536088+0000","last_undegraded":"2024-04-15T00:21:15.536088+0000","last_fullsized":"2024-04-15T00:21:15.536088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:47:56.659307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619601+0000","last_change":"2024-04-15T00:21:07.567917+0000","last_active":"2024-04-15T00:21:15.619601+0000","last_peered":"2024-04-15T00:21:15.619601+0000","last_clean":"2024-04-15T00:21:15.619601+0000","last_became_active":"2024-04-15T00:21:07.567673+0000","last_became_peered":"2024-04-15T00:21:07.567673+0000","last_unstale":"2024-04-15T00:21:15.619601+0000","last_undegraded":"2024-04-15T00:21:15.619601+0000","last_fullsized":"2024-04-15T00:21:15.619601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:54.810223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602134+0000","last_change":"2024-04-15T00:21:12.632937+0000","last_active":"2024-04-15T00:21:13.602134+0000","last_peered":"2024-04-15T00:21:13.602134+0000","last_clean":"2024-04-15T00:21:13.602134+0000","last_became_active":"2024-04-15T00:21:12.632508+0000","last_became_peered":"2024-04-15T00:21:12.632508+0000","last_unstale":"2024-04-15T00:21:13.602134+0000","last_undegraded":"2024-04-15T00:21:13.602134+0000","last_fullsized":"2024-04-15T00:21:13.602134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:07:36.246879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535820+0000","last_change":"2024-04-15T00:21:08.600430+0000","last_active":"2024-04-15T00:21:15.535820+0000","last_peered":"2024-04-15T00:21:15.535820+0000","last_clean":"2024-04-15T00:21:15.535820+0000","last_became_active":"2024-04-15T00:21:08.600142+0000","last_became_peered":"2024-04-15T00:21:08.600142+0000","last_unstale":"2024-04-15T00:21:15.535820+0000","last_undegraded":"2024-04-15T00:21:15.535820+0000","last_fullsized":"2024-04-15T00:21:15.535820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:30.470116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602933+0000","last_change":"2024-04-15T00:21:07.576781+0000","last_active":"2024-04-15T00:21:13.602933+0000","last_peered":"2024-04-15T00:21:13.602933+0000","last_clean":"2024-04-15T00:21:13.602933+0000","last_became_active":"2024-04-15T00:21:07.576491+0000","last_became_peered":"2024-04-15T00:21:07.576491+0000","last_unstale":"2024-04-15T00:21:13.602933+0000","last_undegraded":"2024-04-15T00:21:13.602933+0000","last_fullsized":"2024-04-15T00:21:13.602933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:41:31.846500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602828+0000","last_change":"2024-04-15T00:21:12.620247+0000","last_active":"2024-04-15T00:21:13.602828+0000","last_peered":"2024-04-15T00:21:13.602828+0000","last_clean":"2024-04-15T00:21:13.602828+0000","last_became_active":"2024-04-15T00:21:12.619257+0000","last_became_peered":"2024-04-15T00:21:12.619257+0000","last_unstale":"2024-04-15T00:21:13.602828+0000","last_undegraded":"2024-04-15T00:21:13.602828+0000","last_fullsized":"2024-04-15T00:21:13.602828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:44.287619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535641+0000","last_change":"2024-04-15T00:21:08.590732+0000","last_active":"2024-04-15T00:21:15.535641+0000","last_peered":"2024-04-15T00:21:15.535641+0000","last_clean":"2024-04-15T00:21:15.535641+0000","last_became_active":"2024-04-15T00:21:08.590450+0000","last_became_peered":"2024-04-15T00:21:08.590450+0000","last_unstale":"2024-04-15T00:21:15.535641+0000","last_undegraded":"2024-04-15T00:21:15.535641+0000","last_fullsized":"2024-04-15T00:21:15.535641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:10:24.477646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619783+0000","last_change":"2024-04-15T00:21:07.566984+0000","last_active":"2024-04-15T00:21:15.619783+0000","last_peered":"2024-04-15T00:21:15.619783+0000","last_clean":"2024-04-15T00:21:15.619783+0000","last_became_active":"2024-04-15T00:21:07.566681+0000","last_became_peered":"2024-04-15T00:21:07.566681+0000","last_unstale":"2024-04-15T00:21:15.619783+0000","last_undegraded":"2024-04-15T00:21:15.619783+0000","last_fullsized":"2024-04-15T00:21:15.619783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:21:35.113136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620857+0000","last_change":"2024-04-15T00:21:12.615981+0000","last_active":"2024-04-15T00:21:15.620857+0000","last_peered":"2024-04-15T00:21:15.620857+0000","last_clean":"2024-04-15T00:21:15.620857+0000","last_became_active":"2024-04-15T00:21:12.615577+0000","last_became_peered":"2024-04-15T00:21:12.615577+0000","last_unstale":"2024-04-15T00:21:15.620857+0000","last_undegraded":"2024-04-15T00:21:15.620857+0000","last_fullsized":"2024-04-15T00:21:15.620857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:52:14.595303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619951+0000","last_change":"2024-04-15T00:21:08.588266+0000","last_active":"2024-04-15T00:21:15.619951+0000","last_peered":"2024-04-15T00:21:15.619951+0000","last_clean":"2024-04-15T00:21:15.619951+0000","last_became_active":"2024-04-15T00:21:08.587962+0000","last_became_peered":"2024-04-15T00:21:08.587962+0000","last_unstale":"2024-04-15T00:21:15.619951+0000","last_undegraded":"2024-04-15T00:21:15.619951+0000","last_fullsized":"2024-04-15T00:21:15.619951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619445+0000","last_change":"2024-04-15T00:21:07.573664+0000","last_active":"2024-04-15T00:21:15.619445+0000","last_peered":"2024-04-15T00:21:15.619445+0000","last_clean":"2024-04-15T00:21:15.619445+0000","last_became_active":"2024-04-15T00:21:07.573325+0000","last_became_peered":"2024-04-15T00:21:07.573325+0000","last_unstale":"2024-04-15T00:21:15.619445+0000","last_undegraded":"2024-04-15T00:21:15.619445+0000","last_fullsized":"2024-04-15T00:21:15.619445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:16:52.647503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602823+0000","last_change":"2024-04-15T00:21:12.634889+0000","last_active":"2024-04-15T00:21:13.602823+0000","last_peered":"2024-04-15T00:21:13.602823+0000","last_clean":"2024-04-15T00:21:13.602823+0000","last_became_active":"2024-04-15T00:21:12.634527+0000","last_became_peered":"2024-04-15T00:21:12.634527+0000","last_unstale":"2024-04-15T00:21:13.602823+0000","last_undegraded":"2024-04-15T00:21:13.602823+0000","last_fullsized":"2024-04-15T00:21:13.602823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:29.469506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535769+0000","last_change":"2024-04-15T00:21:08.593412+0000","last_active":"2024-04-15T00:21:15.535769+0000","last_peered":"2024-04-15T00:21:15.535769+0000","last_clean":"2024-04-15T00:21:15.535769+0000","last_became_active":"2024-04-15T00:21:08.593112+0000","last_became_peered":"2024-04-15T00:21:08.593112+0000","last_unstale":"2024-04-15T00:21:15.535769+0000","last_undegraded":"2024-04-15T00:21:15.535769+0000","last_fullsized":"2024-04-15T00:21:15.535769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:45.258841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603654+0000","last_change":"2024-04-15T00:21:07.576800+0000","last_active":"2024-04-15T00:21:13.603654+0000","last_peered":"2024-04-15T00:21:13.603654+0000","last_clean":"2024-04-15T00:21:13.603654+0000","last_became_active":"2024-04-15T00:21:07.576501+0000","last_became_peered":"2024-04-15T00:21:07.576501+0000","last_unstale":"2024-04-15T00:21:13.603654+0000","last_undegraded":"2024-04-15T00:21:13.603654+0000","last_fullsized":"2024-04-15T00:21:13.603654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:54.810223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603284+0000","last_change":"2024-04-15T00:21:12.634065+0000","last_active":"2024-04-15T00:21:13.603284+0000","last_peered":"2024-04-15T00:21:13.603284+0000","last_clean":"2024-04-15T00:21:13.603284+0000","last_became_active":"2024-04-15T00:21:12.633242+0000","last_became_peered":"2024-04-15T00:21:12.633242+0000","last_unstale":"2024-04-15T00:21:13.603284+0000","last_undegraded":"2024-04-15T00:21:13.603284+0000","last_fullsized":"2024-04-15T00:21:13.603284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:38:32.207334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619978+0000","last_change":"2024-04-15T00:21:08.598979+0000","last_active":"2024-04-15T00:21:15.619978+0000","last_peered":"2024-04-15T00:21:15.619978+0000","last_clean":"2024-04-15T00:21:15.619978+0000","last_became_active":"2024-04-15T00:21:08.598700+0000","last_became_peered":"2024-04-15T00:21:08.598700+0000","last_unstale":"2024-04-15T00:21:15.619978+0000","last_undegraded":"2024-04-15T00:21:15.619978+0000","last_fullsized":"2024-04-15T00:21:15.619978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:10.980339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619067+0000","last_change":"2024-04-15T00:21:07.573340+0000","last_active":"2024-04-15T00:21:15.619067+0000","last_peered":"2024-04-15T00:21:15.619067+0000","last_clean":"2024-04-15T00:21:15.619067+0000","last_became_active":"2024-04-15T00:21:07.572749+0000","last_became_peered":"2024-04-15T00:21:07.572749+0000","last_unstale":"2024-04-15T00:21:15.619067+0000","last_undegraded":"2024-04-15T00:21:15.619067+0000","last_fullsized":"2024-04-15T00:21:15.619067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:05:06.225337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603983+0000","last_change":"2024-04-15T00:21:12.632412+0000","last_active":"2024-04-15T00:21:13.603983+0000","last_peered":"2024-04-15T00:21:13.603983+0000","last_clean":"2024-04-15T00:21:13.603983+0000","last_became_active":"2024-04-15T00:21:12.631982+0000","last_became_peered":"2024-04-15T00:21:12.631982+0000","last_unstale":"2024-04-15T00:21:13.603983+0000","last_undegraded":"2024-04-15T00:21:13.603983+0000","last_fullsized":"2024-04-15T00:21:13.603983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:11:44.674232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535698+0000","last_change":"2024-04-15T00:21:08.582822+0000","last_active":"2024-04-15T00:21:15.535698+0000","last_peered":"2024-04-15T00:21:15.535698+0000","last_clean":"2024-04-15T00:21:15.535698+0000","last_became_active":"2024-04-15T00:21:08.582531+0000","last_became_peered":"2024-04-15T00:21:08.582531+0000","last_unstale":"2024-04-15T00:21:15.535698+0000","last_undegraded":"2024-04-15T00:21:15.535698+0000","last_fullsized":"2024-04-15T00:21:15.535698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:21:59.995077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:17.377719+0000","last_change":"2024-04-15T00:21:07.576694+0000","last_active":"2024-04-15T00:21:17.377719+0000","last_peered":"2024-04-15T00:21:17.377719+0000","last_clean":"2024-04-15T00:21:17.377719+0000","last_became_active":"2024-04-15T00:21:07.576380+0000","last_became_peered":"2024-04-15T00:21:07.576380+0000","last_unstale":"2024-04-15T00:21:17.377719+0000","last_undegraded":"2024-04-15T00:21:17.377719+0000","last_fullsized":"2024-04-15T00:21:17.377719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:36:11.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620233+0000","last_change":"2024-04-15T00:21:12.620928+0000","last_active":"2024-04-15T00:21:15.620233+0000","last_peered":"2024-04-15T00:21:15.620233+0000","last_clean":"2024-04-15T00:21:15.620233+0000","last_became_active":"2024-04-15T00:21:12.620536+0000","last_became_peered":"2024-04-15T00:21:12.620536+0000","last_unstale":"2024-04-15T00:21:15.620233+0000","last_undegraded":"2024-04-15T00:21:15.620233+0000","last_fullsized":"2024-04-15T00:21:15.620233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:52:14.595303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603960+0000","last_change":"2024-04-15T00:21:08.588132+0000","last_active":"2024-04-15T00:21:13.603960+0000","last_peered":"2024-04-15T00:21:13.603960+0000","last_clean":"2024-04-15T00:21:13.603960+0000","last_became_active":"2024-04-15T00:21:08.587383+0000","last_became_peered":"2024-04-15T00:21:08.587383+0000","last_unstale":"2024-04-15T00:21:13.603960+0000","last_undegraded":"2024-04-15T00:21:13.603960+0000","last_fullsized":"2024-04-15T00:21:13.603960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:15.446273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619661+0000","last_change":"2024-04-15T00:21:07.574695+0000","last_active":"2024-04-15T00:21:15.619661+0000","last_peered":"2024-04-15T00:21:15.619661+0000","last_clean":"2024-04-15T00:21:15.619661+0000","last_became_active":"2024-04-15T00:21:07.574389+0000","last_became_peered":"2024-04-15T00:21:07.574389+0000","last_unstale":"2024-04-15T00:21:15.619661+0000","last_undegraded":"2024-04-15T00:21:15.619661+0000","last_fullsized":"2024-04-15T00:21:15.619661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:34:26.325595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.604076+0000","last_change":"2024-04-15T00:21:12.620255+0000","last_active":"2024-04-15T00:21:13.604076+0000","last_peered":"2024-04-15T00:21:13.604076+0000","last_clean":"2024-04-15T00:21:13.604076+0000","last_became_active":"2024-04-15T00:21:12.619218+0000","last_became_peered":"2024-04-15T00:21:12.619218+0000","last_unstale":"2024-04-15T00:21:13.604076+0000","last_undegraded":"2024-04-15T00:21:13.604076+0000","last_fullsized":"2024-04-15T00:21:13.604076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:49.295552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.621210+0000","last_change":"2024-04-15T00:21:08.597898+0000","last_active":"2024-04-15T00:21:15.621210+0000","last_peered":"2024-04-15T00:21:15.621210+0000","last_clean":"2024-04-15T00:21:15.621210+0000","last_became_active":"2024-04-15T00:21:08.597262+0000","last_became_peered":"2024-04-15T00:21:08.597262+0000","last_unstale":"2024-04-15T00:21:15.621210+0000","last_undegraded":"2024-04-15T00:21:15.621210+0000","last_fullsized":"2024-04-15T00:21:15.621210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603559+0000","last_change":"2024-04-15T00:21:07.574003+0000","last_active":"2024-04-15T00:21:13.603559+0000","last_peered":"2024-04-15T00:21:13.603559+0000","last_clean":"2024-04-15T00:21:13.603559+0000","last_became_active":"2024-04-15T00:21:07.573469+0000","last_became_peered":"2024-04-15T00:21:07.573469+0000","last_unstale":"2024-04-15T00:21:13.603559+0000","last_undegraded":"2024-04-15T00:21:13.603559+0000","last_fullsized":"2024-04-15T00:21:13.603559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:16:52.647503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602626+0000","last_change":"2024-04-15T00:21:12.624850+0000","last_active":"2024-04-15T00:21:13.602626+0000","last_peered":"2024-04-15T00:21:13.602626+0000","last_clean":"2024-04-15T00:21:13.602626+0000","last_became_active":"2024-04-15T00:21:12.624484+0000","last_became_peered":"2024-04-15T00:21:12.624484+0000","last_unstale":"2024-04-15T00:21:13.602626+0000","last_undegraded":"2024-04-15T00:21:13.602626+0000","last_fullsized":"2024-04-15T00:21:13.602626+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:15:08.738300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603345+0000","last_change":"2024-04-15T00:21:08.591705+0000","last_active":"2024-04-15T00:21:13.603345+0000","last_peered":"2024-04-15T00:21:13.603345+0000","last_clean":"2024-04-15T00:21:13.603345+0000","last_became_active":"2024-04-15T00:21:08.591407+0000","last_became_peered":"2024-04-15T00:21:08.591407+0000","last_unstale":"2024-04-15T00:21:13.603345+0000","last_undegraded":"2024-04-15T00:21:13.603345+0000","last_fullsized":"2024-04-15T00:21:13.603345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619610+0000","last_change":"2024-04-15T00:21:07.574971+0000","last_active":"2024-04-15T00:21:15.619610+0000","last_peered":"2024-04-15T00:21:15.619610+0000","last_clean":"2024-04-15T00:21:15.619610+0000","last_became_active":"2024-04-15T00:21:07.574656+0000","last_became_peered":"2024-04-15T00:21:07.574656+0000","last_unstale":"2024-04-15T00:21:15.619610+0000","last_undegraded":"2024-04-15T00:21:15.619610+0000","last_fullsized":"2024-04-15T00:21:15.619610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:21:35.113136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602552+0000","last_change":"2024-04-15T00:21:12.633646+0000","last_active":"2024-04-15T00:21:13.602552+0000","last_peered":"2024-04-15T00:21:13.602552+0000","last_clean":"2024-04-15T00:21:13.602552+0000","last_became_active":"2024-04-15T00:21:12.633262+0000","last_became_peered":"2024-04-15T00:21:12.633262+0000","last_unstale":"2024-04-15T00:21:13.602552+0000","last_undegraded":"2024-04-15T00:21:13.602552+0000","last_fullsized":"2024-04-15T00:21:13.602552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:26:17.136974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620791+0000","last_change":"2024-04-15T00:21:12.634552+0000","last_active":"2024-04-15T00:21:15.620791+0000","last_peered":"2024-04-15T00:21:15.620791+0000","last_clean":"2024-04-15T00:21:15.620791+0000","last_became_active":"2024-04-15T00:21:12.633824+0000","last_became_peered":"2024-04-15T00:21:12.633824+0000","last_unstale":"2024-04-15T00:21:15.620791+0000","last_undegraded":"2024-04-15T00:21:15.620791+0000","last_fullsized":"2024-04-15T00:21:15.620791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:34.506827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620127+0000","last_change":"2024-04-15T00:21:08.577988+0000","last_active":"2024-04-15T00:21:15.620127+0000","last_peered":"2024-04-15T00:21:15.620127+0000","last_clean":"2024-04-15T00:21:15.620127+0000","last_became_active":"2024-04-15T00:21:08.577692+0000","last_became_peered":"2024-04-15T00:21:08.577692+0000","last_unstale":"2024-04-15T00:21:15.620127+0000","last_undegraded":"2024-04-15T00:21:15.620127+0000","last_fullsized":"2024-04-15T00:21:15.620127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602539+0000","last_change":"2024-04-15T00:21:07.563155+0000","last_active":"2024-04-15T00:21:13.602539+0000","last_peered":"2024-04-15T00:21:13.602539+0000","last_clean":"2024-04-15T00:21:13.602539+0000","last_became_active":"2024-04-15T00:21:07.562747+0000","last_became_peered":"2024-04-15T00:21:07.562747+0000","last_unstale":"2024-04-15T00:21:13.602539+0000","last_undegraded":"2024-04-15T00:21:13.602539+0000","last_fullsized":"2024-04-15T00:21:13.602539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:21:35.113136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620544+0000","last_change":"2024-04-15T00:21:12.624627+0000","last_active":"2024-04-15T00:21:15.620544+0000","last_peered":"2024-04-15T00:21:15.620544+0000","last_clean":"2024-04-15T00:21:15.620544+0000","last_became_active":"2024-04-15T00:21:12.624245+0000","last_became_peered":"2024-04-15T00:21:12.624245+0000","last_unstale":"2024-04-15T00:21:15.620544+0000","last_undegraded":"2024-04-15T00:21:15.620544+0000","last_fullsized":"2024-04-15T00:21:15.620544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:31.463828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602302+0000","last_change":"2024-04-15T00:21:08.590595+0000","last_active":"2024-04-15T00:21:13.602302+0000","last_peered":"2024-04-15T00:21:13.602302+0000","last_clean":"2024-04-15T00:21:13.602302+0000","last_became_active":"2024-04-15T00:21:08.590333+0000","last_became_peered":"2024-04-15T00:21:08.590333+0000","last_unstale":"2024-04-15T00:21:13.602302+0000","last_undegraded":"2024-04-15T00:21:13.602302+0000","last_fullsized":"2024-04-15T00:21:13.602302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602611+0000","last_change":"2024-04-15T00:21:07.576399+0000","last_active":"2024-04-15T00:21:13.602611+0000","last_peered":"2024-04-15T00:21:13.602611+0000","last_clean":"2024-04-15T00:21:13.602611+0000","last_became_active":"2024-04-15T00:21:07.576008+0000","last_became_peered":"2024-04-15T00:21:07.576008+0000","last_unstale":"2024-04-15T00:21:13.602611+0000","last_undegraded":"2024-04-15T00:21:13.602611+0000","last_fullsized":"2024-04-15T00:21:13.602611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:16:52.647503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619476+0000","last_change":"2024-04-15T00:21:07.572597+0000","last_active":"2024-04-15T00:21:15.619476+0000","last_peered":"2024-04-15T00:21:15.619476+0000","last_clean":"2024-04-15T00:21:15.619476+0000","last_became_active":"2024-04-15T00:21:07.572273+0000","last_became_peered":"2024-04-15T00:21:07.572273+0000","last_unstale":"2024-04-15T00:21:15.619476+0000","last_undegraded":"2024-04-15T00:21:15.619476+0000","last_fullsized":"2024-04-15T00:21:15.619476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620643+0000","last_change":"2024-04-15T00:21:08.587210+0000","last_active":"2024-04-15T00:21:15.620643+0000","last_peered":"2024-04-15T00:21:15.620643+0000","last_clean":"2024-04-15T00:21:15.620643+0000","last_became_active":"2024-04-15T00:21:08.586910+0000","last_became_peered":"2024-04-15T00:21:08.586910+0000","last_unstale":"2024-04-15T00:21:15.620643+0000","last_undegraded":"2024-04-15T00:21:15.620643+0000","last_fullsized":"2024-04-15T00:21:15.620643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619912+0000","last_change":"2024-04-15T00:21:12.622128+0000","last_active":"2024-04-15T00:21:15.619912+0000","last_peered":"2024-04-15T00:21:15.619912+0000","last_clean":"2024-04-15T00:21:15.619912+0000","last_became_active":"2024-04-15T00:21:12.621682+0000","last_became_peered":"2024-04-15T00:21:12.621682+0000","last_unstale":"2024-04-15T00:21:15.619912+0000","last_undegraded":"2024-04-15T00:21:15.619912+0000","last_fullsized":"2024-04-15T00:21:15.619912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:03:00.366139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602718+0000","last_change":"2024-04-15T00:21:07.577069+0000","last_active":"2024-04-15T00:21:13.602718+0000","last_peered":"2024-04-15T00:21:13.602718+0000","last_clean":"2024-04-15T00:21:13.602718+0000","last_became_active":"2024-04-15T00:21:07.576791+0000","last_became_peered":"2024-04-15T00:21:07.576791+0000","last_unstale":"2024-04-15T00:21:13.602718+0000","last_undegraded":"2024-04-15T00:21:13.602718+0000","last_fullsized":"2024-04-15T00:21:13.602718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:36:11.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603254+0000","last_change":"2024-04-15T00:21:08.584214+0000","last_active":"2024-04-15T00:21:13.603254+0000","last_peered":"2024-04-15T00:21:13.603254+0000","last_clean":"2024-04-15T00:21:13.603254+0000","last_became_active":"2024-04-15T00:21:08.583909+0000","last_became_peered":"2024-04-15T00:21:08.583909+0000","last_unstale":"2024-04-15T00:21:13.603254+0000","last_undegraded":"2024-04-15T00:21:13.603254+0000","last_fullsized":"2024-04-15T00:21:13.603254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:55.815311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602896+0000","last_change":"2024-04-15T00:21:12.624156+0000","last_active":"2024-04-15T00:21:13.602896+0000","last_peered":"2024-04-15T00:21:13.602896+0000","last_clean":"2024-04-15T00:21:13.602896+0000","last_became_active":"2024-04-15T00:21:12.623756+0000","last_became_peered":"2024-04-15T00:21:12.623756+0000","last_unstale":"2024-04-15T00:21:13.602896+0000","last_undegraded":"2024-04-15T00:21:13.602896+0000","last_fullsized":"2024-04-15T00:21:13.602896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:31:33.202296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619829+0000","last_change":"2024-04-15T00:21:08.588647+0000","last_active":"2024-04-15T00:21:15.619829+0000","last_peered":"2024-04-15T00:21:15.619829+0000","last_clean":"2024-04-15T00:21:15.619829+0000","last_became_active":"2024-04-15T00:21:08.587719+0000","last_became_peered":"2024-04-15T00:21:08.587719+0000","last_unstale":"2024-04-15T00:21:15.619829+0000","last_undegraded":"2024-04-15T00:21:15.619829+0000","last_fullsized":"2024-04-15T00:21:15.619829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:39.454082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619475+0000","last_change":"2024-04-15T00:21:08.596094+0000","last_active":"2024-04-15T00:21:15.619475+0000","last_peered":"2024-04-15T00:21:15.619475+0000","last_clean":"2024-04-15T00:21:15.619475+0000","last_became_active":"2024-04-15T00:21:08.595790+0000","last_became_peered":"2024-04-15T00:21:08.595790+0000","last_unstale":"2024-04-15T00:21:15.619475+0000","last_undegraded":"2024-04-15T00:21:15.619475+0000","last_fullsized":"2024-04-15T00:21:15.619475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:15.446273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603593+0000","last_change":"2024-04-15T00:21:08.583148+0000","last_active":"2024-04-15T00:21:13.603593+0000","last_peered":"2024-04-15T00:21:13.603593+0000","last_clean":"2024-04-15T00:21:13.603593+0000","last_became_active":"2024-04-15T00:21:08.582801+0000","last_became_peered":"2024-04-15T00:21:08.582801+0000","last_unstale":"2024-04-15T00:21:13.603593+0000","last_undegraded":"2024-04-15T00:21:13.603593+0000","last_fullsized":"2024-04-15T00:21:13.603593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:01.007313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620505+0000","last_change":"2024-04-15T00:21:08.596406+0000","last_active":"2024-04-15T00:21:15.620505+0000","last_peered":"2024-04-15T00:21:15.620505+0000","last_clean":"2024-04-15T00:21:15.620505+0000","last_became_active":"2024-04-15T00:21:08.596144+0000","last_became_peered":"2024-04-15T00:21:08.596144+0000","last_unstale":"2024-04-15T00:21:15.620505+0000","last_undegraded":"2024-04-15T00:21:15.620505+0000","last_fullsized":"2024-04-15T00:21:15.620505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603411+0000","last_change":"2024-04-15T00:21:08.591959+0000","last_active":"2024-04-15T00:21:13.603411+0000","last_peered":"2024-04-15T00:21:13.603411+0000","last_clean":"2024-04-15T00:21:13.603411+0000","last_became_active":"2024-04-15T00:21:08.591479+0000","last_became_peered":"2024-04-15T00:21:08.591479+0000","last_unstale":"2024-04-15T00:21:13.603411+0000","last_undegraded":"2024-04-15T00:21:13.603411+0000","last_fullsized":"2024-04-15T00:21:13.603411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619869+0000","last_change":"2024-04-15T00:21:08.577658+0000","last_active":"2024-04-15T00:21:15.619869+0000","last_peered":"2024-04-15T00:21:15.619869+0000","last_clean":"2024-04-15T00:21:15.619869+0000","last_became_active":"2024-04-15T00:21:08.577358+0000","last_became_peered":"2024-04-15T00:21:08.577358+0000","last_unstale":"2024-04-15T00:21:15.619869+0000","last_undegraded":"2024-04-15T00:21:15.619869+0000","last_fullsized":"2024-04-15T00:21:15.619869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620568+0000","last_change":"2024-04-15T00:21:08.593462+0000","last_active":"2024-04-15T00:21:15.620568+0000","last_peered":"2024-04-15T00:21:15.620568+0000","last_clean":"2024-04-15T00:21:15.620568+0000","last_became_active":"2024-04-15T00:21:08.593174+0000","last_became_peered":"2024-04-15T00:21:08.593174+0000","last_unstale":"2024-04-15T00:21:15.620568+0000","last_undegraded":"2024-04-15T00:21:15.620568+0000","last_fullsized":"2024-04-15T00:21:15.620568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602883+0000","last_change":"2024-04-15T00:21:08.582109+0000","last_active":"2024-04-15T00:21:13.602883+0000","last_peered":"2024-04-15T00:21:13.602883+0000","last_clean":"2024-04-15T00:21:13.602883+0000","last_became_active":"2024-04-15T00:21:08.581828+0000","last_became_peered":"2024-04-15T00:21:08.581828+0000","last_unstale":"2024-04-15T00:21:13.602883+0000","last_undegraded":"2024-04-15T00:21:13.602883+0000","last_fullsized":"2024-04-15T00:21:13.602883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:01.007313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602485+0000","last_change":"2024-04-15T00:21:08.582329+0000","last_active":"2024-04-15T00:21:13.602485+0000","last_peered":"2024-04-15T00:21:13.602485+0000","last_clean":"2024-04-15T00:21:13.602485+0000","last_became_active":"2024-04-15T00:21:08.582011+0000","last_became_peered":"2024-04-15T00:21:08.582011+0000","last_unstale":"2024-04-15T00:21:13.602485+0000","last_undegraded":"2024-04-15T00:21:13.602485+0000","last_fullsized":"2024-04-15T00:21:13.602485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602496+0000","last_change":"2024-04-15T00:21:08.581215+0000","last_active":"2024-04-15T00:21:13.602496+0000","last_peered":"2024-04-15T00:21:13.602496+0000","last_clean":"2024-04-15T00:21:13.602496+0000","last_became_active":"2024-04-15T00:21:08.579860+0000","last_became_peered":"2024-04-15T00:21:08.579860+0000","last_unstale":"2024-04-15T00:21:13.602496+0000","last_undegraded":"2024-04-15T00:21:13.602496+0000","last_fullsized":"2024-04-15T00:21:13.602496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603446+0000","last_change":"2024-04-15T00:21:08.592785+0000","last_active":"2024-04-15T00:21:13.603446+0000","last_peered":"2024-04-15T00:21:13.603446+0000","last_clean":"2024-04-15T00:21:13.603446+0000","last_became_active":"2024-04-15T00:21:08.592110+0000","last_became_peered":"2024-04-15T00:21:08.592110+0000","last_unstale":"2024-04-15T00:21:13.603446+0000","last_undegraded":"2024-04-15T00:21:13.603446+0000","last_fullsized":"2024-04-15T00:21:13.603446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:45.258841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620413+0000","last_change":"2024-04-15T00:21:08.599781+0000","last_active":"2024-04-15T00:21:15.620413+0000","last_peered":"2024-04-15T00:21:15.620413+0000","last_clean":"2024-04-15T00:21:15.620413+0000","last_became_active":"2024-04-15T00:21:08.599460+0000","last_became_peered":"2024-04-15T00:21:08.599460+0000","last_unstale":"2024-04-15T00:21:15.620413+0000","last_undegraded":"2024-04-15T00:21:15.620413+0000","last_fullsized":"2024-04-15T00:21:15.620413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:39.454082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620344+0000","last_change":"2024-04-15T00:21:08.588233+0000","last_active":"2024-04-15T00:21:15.620344+0000","last_peered":"2024-04-15T00:21:15.620344+0000","last_clean":"2024-04-15T00:21:15.620344+0000","last_became_active":"2024-04-15T00:21:08.586235+0000","last_became_peered":"2024-04-15T00:21:08.586235+0000","last_unstale":"2024-04-15T00:21:15.620344+0000","last_undegraded":"2024-04-15T00:21:15.620344+0000","last_fullsized":"2024-04-15T00:21:15.620344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.536068+0000","last_change":"2024-04-15T00:21:08.582000+0000","last_active":"2024-04-15T00:21:15.536068+0000","last_peered":"2024-04-15T00:21:15.536068+0000","last_clean":"2024-04-15T00:21:15.536068+0000","last_became_active":"2024-04-15T00:21:08.581714+0000","last_became_peered":"2024-04-15T00:21:08.581714+0000","last_unstale":"2024-04-15T00:21:15.536068+0000","last_undegraded":"2024-04-15T00:21:15.536068+0000","last_fullsized":"2024-04-15T00:21:15.536068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:27.427117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620436+0000","last_change":"2024-04-15T00:21:08.582994+0000","last_active":"2024-04-15T00:21:15.620436+0000","last_peered":"2024-04-15T00:21:15.620436+0000","last_clean":"2024-04-15T00:21:15.620436+0000","last_became_active":"2024-04-15T00:21:08.582594+0000","last_became_peered":"2024-04-15T00:21:08.582594+0000","last_unstale":"2024-04-15T00:21:15.620436+0000","last_undegraded":"2024-04-15T00:21:15.620436+0000","last_fullsized":"2024-04-15T00:21:15.620436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:26:23.617197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.604186+0000","last_change":"2024-04-15T00:21:08.591937+0000","last_active":"2024-04-15T00:21:13.604186+0000","last_peered":"2024-04-15T00:21:13.604186+0000","last_clean":"2024-04-15T00:21:13.604186+0000","last_became_active":"2024-04-15T00:21:08.591655+0000","last_became_peered":"2024-04-15T00:21:08.591655+0000","last_unstale":"2024-04-15T00:21:13.604186+0000","last_undegraded":"2024-04-15T00:21:13.604186+0000","last_fullsized":"2024-04-15T00:21:13.604186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:21:59.995077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602330+0000","last_change":"2024-04-15T00:21:08.590844+0000","last_active":"2024-04-15T00:21:13.602330+0000","last_peered":"2024-04-15T00:21:13.602330+0000","last_clean":"2024-04-15T00:21:13.602330+0000","last_became_active":"2024-04-15T00:21:08.588982+0000","last_became_peered":"2024-04-15T00:21:08.588982+0000","last_unstale":"2024-04-15T00:21:13.602330+0000","last_undegraded":"2024-04-15T00:21:13.602330+0000","last_fullsized":"2024-04-15T00:21:13.602330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620225+0000","last_change":"2024-04-15T00:21:08.581452+0000","last_active":"2024-04-15T00:21:15.620225+0000","last_peered":"2024-04-15T00:21:15.620225+0000","last_clean":"2024-04-15T00:21:15.620225+0000","last_became_active":"2024-04-15T00:21:08.580967+0000","last_became_peered":"2024-04-15T00:21:08.580967+0000","last_unstale":"2024-04-15T00:21:15.620225+0000","last_undegraded":"2024-04-15T00:21:15.620225+0000","last_fullsized":"2024-04-15T00:21:15.620225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619889+0000","last_change":"2024-04-15T00:21:08.587249+0000","last_active":"2024-04-15T00:21:15.619889+0000","last_peered":"2024-04-15T00:21:15.619889+0000","last_clean":"2024-04-15T00:21:15.619889+0000","last_became_active":"2024-04-15T00:21:08.586885+0000","last_became_peered":"2024-04-15T00:21:08.586885+0000","last_unstale":"2024-04-15T00:21:15.619889+0000","last_undegraded":"2024-04-15T00:21:15.619889+0000","last_fullsized":"2024-04-15T00:21:15.619889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:44:31.020890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602456+0000","last_change":"2024-04-15T00:21:08.579970+0000","last_active":"2024-04-15T00:21:13.602456+0000","last_peered":"2024-04-15T00:21:13.602456+0000","last_clean":"2024-04-15T00:21:13.602456+0000","last_became_active":"2024-04-15T00:21:08.579652+0000","last_became_peered":"2024-04-15T00:21:08.579652+0000","last_unstale":"2024-04-15T00:21:13.602456+0000","last_undegraded":"2024-04-15T00:21:13.602456+0000","last_fullsized":"2024-04-15T00:21:13.602456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:10:24.477646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602944+0000","last_change":"2024-04-15T00:21:08.588376+0000","last_active":"2024-04-15T00:21:13.602944+0000","last_peered":"2024-04-15T00:21:13.602944+0000","last_clean":"2024-04-15T00:21:13.602944+0000","last_became_active":"2024-04-15T00:21:08.587712+0000","last_became_peered":"2024-04-15T00:21:08.587712+0000","last_unstale":"2024-04-15T00:21:13.602944+0000","last_undegraded":"2024-04-15T00:21:13.602944+0000","last_fullsized":"2024-04-15T00:21:13.602944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:34:27.330682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620402+0000","last_change":"2024-04-15T00:21:08.597204+0000","last_active":"2024-04-15T00:21:15.620402+0000","last_peered":"2024-04-15T00:21:15.620402+0000","last_clean":"2024-04-15T00:21:15.620402+0000","last_became_active":"2024-04-15T00:21:08.596862+0000","last_became_peered":"2024-04-15T00:21:08.596862+0000","last_unstale":"2024-04-15T00:21:15.620402+0000","last_undegraded":"2024-04-15T00:21:15.620402+0000","last_fullsized":"2024-04-15T00:21:15.620402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620515+0000","last_change":"2024-04-15T00:21:08.598199+0000","last_active":"2024-04-15T00:21:15.620515+0000","last_peered":"2024-04-15T00:21:15.620515+0000","last_clean":"2024-04-15T00:21:15.620515+0000","last_became_active":"2024-04-15T00:21:08.597790+0000","last_became_peered":"2024-04-15T00:21:08.597790+0000","last_unstale":"2024-04-15T00:21:15.620515+0000","last_undegraded":"2024-04-15T00:21:15.620515+0000","last_fullsized":"2024-04-15T00:21:15.620515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.536057+0000","last_change":"2024-04-15T00:21:08.600496+0000","last_active":"2024-04-15T00:21:15.536057+0000","last_peered":"2024-04-15T00:21:15.536057+0000","last_clean":"2024-04-15T00:21:15.536057+0000","last_became_active":"2024-04-15T00:21:08.600121+0000","last_became_peered":"2024-04-15T00:21:08.600121+0000","last_unstale":"2024-04-15T00:21:15.536057+0000","last_undegraded":"2024-04-15T00:21:15.536057+0000","last_fullsized":"2024-04-15T00:21:15.536057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:11:12.071153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602194+0000","last_change":"2024-04-15T00:21:08.583866+0000","last_active":"2024-04-15T00:21:13.602194+0000","last_peered":"2024-04-15T00:21:13.602194+0000","last_clean":"2024-04-15T00:21:13.602194+0000","last_became_active":"2024-04-15T00:21:08.583563+0000","last_became_peered":"2024-04-15T00:21:08.583563+0000","last_unstale":"2024-04-15T00:21:13.602194+0000","last_undegraded":"2024-04-15T00:21:13.602194+0000","last_fullsized":"2024-04-15T00:21:13.602194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:27:41.268464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535532+0000","last_change":"2024-04-15T00:21:08.596983+0000","last_active":"2024-04-15T00:21:15.535532+0000","last_peered":"2024-04-15T00:21:15.535532+0000","last_clean":"2024-04-15T00:21:15.535532+0000","last_became_active":"2024-04-15T00:21:08.596640+0000","last_became_peered":"2024-04-15T00:21:08.596640+0000","last_unstale":"2024-04-15T00:21:15.535532+0000","last_undegraded":"2024-04-15T00:21:15.535532+0000","last_fullsized":"2024-04-15T00:21:15.535532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:40.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603293+0000","last_change":"2024-04-15T00:21:08.593027+0000","last_active":"2024-04-15T00:21:13.603293+0000","last_peered":"2024-04-15T00:21:13.603293+0000","last_clean":"2024-04-15T00:21:13.603293+0000","last_became_active":"2024-04-15T00:21:08.592476+0000","last_became_peered":"2024-04-15T00:21:08.592476+0000","last_unstale":"2024-04-15T00:21:13.603293+0000","last_undegraded":"2024-04-15T00:21:13.603293+0000","last_fullsized":"2024-04-15T00:21:13.603293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:10:24.477646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535675+0000","last_change":"2024-04-15T00:21:08.591419+0000","last_active":"2024-04-15T00:21:15.535675+0000","last_peered":"2024-04-15T00:21:15.535675+0000","last_clean":"2024-04-15T00:21:15.535675+0000","last_became_active":"2024-04-15T00:21:08.591101+0000","last_became_peered":"2024-04-15T00:21:08.591101+0000","last_unstale":"2024-04-15T00:21:15.535675+0000","last_undegraded":"2024-04-15T00:21:15.535675+0000","last_fullsized":"2024-04-15T00:21:15.535675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:52:10.558592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603323+0000","last_change":"2024-04-15T00:21:08.581621+0000","last_active":"2024-04-15T00:21:13.603323+0000","last_peered":"2024-04-15T00:21:13.603323+0000","last_clean":"2024-04-15T00:21:13.603323+0000","last_became_active":"2024-04-15T00:21:08.581316+0000","last_became_peered":"2024-04-15T00:21:08.581316+0000","last_unstale":"2024-04-15T00:21:13.603323+0000","last_undegraded":"2024-04-15T00:21:13.603323+0000","last_fullsized":"2024-04-15T00:21:13.603323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:27.427117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620634+0000","last_change":"2024-04-15T00:21:08.590252+0000","last_active":"2024-04-15T00:21:15.620634+0000","last_peered":"2024-04-15T00:21:15.620634+0000","last_clean":"2024-04-15T00:21:15.620634+0000","last_became_active":"2024-04-15T00:21:08.589919+0000","last_became_peered":"2024-04-15T00:21:08.589919+0000","last_unstale":"2024-04-15T00:21:15.620634+0000","last_undegraded":"2024-04-15T00:21:15.620634+0000","last_fullsized":"2024-04-15T00:21:15.620634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:46:53.537904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620862+0000","last_change":"2024-04-15T00:21:08.588530+0000","last_active":"2024-04-15T00:21:15.620862+0000","last_peered":"2024-04-15T00:21:15.620862+0000","last_clean":"2024-04-15T00:21:15.620862+0000","last_became_active":"2024-04-15T00:21:08.588208+0000","last_became_peered":"2024-04-15T00:21:08.588208+0000","last_unstale":"2024-04-15T00:21:15.620862+0000","last_undegraded":"2024-04-15T00:21:15.620862+0000","last_fullsized":"2024-04-15T00:21:15.620862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:08.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535948+0000","last_change":"2024-04-15T00:21:08.588469+0000","last_active":"2024-04-15T00:21:15.535948+0000","last_peered":"2024-04-15T00:21:15.535948+0000","last_clean":"2024-04-15T00:21:15.535948+0000","last_became_active":"2024-04-15T00:21:08.587646+0000","last_became_peered":"2024-04-15T00:21:08.587646+0000","last_unstale":"2024-04-15T00:21:15.535948+0000","last_undegraded":"2024-04-15T00:21:15.535948+0000","last_fullsized":"2024-04-15T00:21:15.535948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:52:27.105666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":107788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":104087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":695093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":695037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":107788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":104177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":274432,"data_stored":104213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":104247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T00:21:25.639 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T00:21:25.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.768+0000 7f4b84a08640 1 Processor -- start 2024-04-15T00:21:25.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.768+0000 7f4b84a08640 1 -- start start 2024-04-15T00:21:25.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.769+0000 7f4b84a08640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4b800b9bd0 0x7f4b800bb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:25.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.769+0000 7f4b84a08640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4b800b94f0 0x7f4b80147600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:25.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.769+0000 7f4b84a08640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b800b9fb0 con 0x7f4b8014b870 2024-04-15T00:21:25.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.769+0000 7f4b84a08640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f4b8014b3e0 con 0x7f4b800b94f0 2024-04-15T00:21:25.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.769+0000 7f4b84a08640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f4b80147b40 con 0x7f4b800b9bd0 2024-04-15T00:21:25.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.769+0000 7f4b7dd9b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4b800b94f0 0x7f4b80147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:25.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.769+0000 7f4b7dd9b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4b800b94f0 0x7f4b80147600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51650/0 (socket says 172.21.15.31:51650) 2024-04-15T00:21:25.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.769+0000 7f4b7dd9b640 1 -- 172.21.15.31:0/2343248075 learned_addr learned my addr 172.21.15.31:0/2343248075 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:25.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.769+0000 7f4b7e59c640 1 --2- 172.21.15.31:0/2343248075 >> v2:172.21.15.50:3300/0 conn(0x7f4b800b9bd0 0x7f4b800bb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:25.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.769+0000 7f4b7dd9b640 1 -- 172.21.15.31:0/2343248075 >> v2:172.21.15.50:3300/0 conn(0x7f4b800b9bd0 msgr2=0x7f4b800bb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:25.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.769+0000 7f4b7dd9b640 1 --2- 172.21.15.31:0/2343248075 >> v2:172.21.15.50:3300/0 conn(0x7f4b800b9bd0 0x7f4b800bb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.769+0000 7f4b7dd9b640 1 -- 172.21.15.31:0/2343248075 >> v1:172.21.15.31:6789/0 conn(0x7f4b8014b870 legacy=0x7f4b800b8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:25.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.769+0000 7f4b7dd9b640 1 -- 172.21.15.31:0/2343248075 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b8014ad90 con 0x7f4b800b94f0 2024-04-15T00:21:25.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.769+0000 7f4b7d59a640 1 -- 172.21.15.31:0/2343248075 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2363948633 0 0) 0x7f4b800b9fb0 con 0x7f4b8014b870 2024-04-15T00:21:25.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.770+0000 7f4b7dd9b640 1 --2- 172.21.15.31:0/2343248075 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b800b94f0 0x7f4b80147600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4b8009aee0 tx=0x7f4b6802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db3f7d3fdd7565e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:25.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.770+0000 7f4b7d59a640 1 -- 172.21.15.31:0/2343248075 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6802e070 con 0x7f4b800b94f0 2024-04-15T00:21:25.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.770+0000 7f4b7d59a640 1 -- 172.21.15.31:0/2343248075 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b68037070 con 0x7f4b800b94f0 2024-04-15T00:21:25.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.770+0000 7f4b7d59a640 1 -- 172.21.15.31:0/2343248075 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b68031a00 con 0x7f4b800b94f0 2024-04-15T00:21:25.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.771+0000 7f4b84a08640 1 -- 172.21.15.31:0/2343248075 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b800b94f0 msgr2=0x7f4b80147600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:25.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.771+0000 7f4b84a08640 1 --2- 172.21.15.31:0/2343248075 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b800b94f0 0x7f4b80147600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4b8009aee0 tx=0x7f4b6802b880 comp rx=0 tx=0).stop 2024-04-15T00:21:25.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.771+0000 7f4b84a08640 1 -- 172.21.15.31:0/2343248075 shutdown_connections 2024-04-15T00:21:25.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.771+0000 7f4b84a08640 1 --2- 172.21.15.31:0/2343248075 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b800b94f0 0x7f4b80147600 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.771+0000 7f4b84a08640 1 --2- 172.21.15.31:0/2343248075 >> v2:172.21.15.50:3300/0 conn(0x7f4b800b9bd0 0x7f4b800bb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.771+0000 7f4b84a08640 1 -- 172.21.15.31:0/2343248075 >> 172.21.15.31:0/2343248075 conn(0x7f4b8009ed70 msgr2=0x7f4b8009f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:25.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.771+0000 7f4b84a08640 1 -- 172.21.15.31:0/2343248075 shutdown_connections 2024-04-15T00:21:25.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.771+0000 7f4b84a08640 1 -- 172.21.15.31:0/2343248075 wait complete. 2024-04-15T00:21:25.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.773+0000 7f4b84a08640 1 Processor -- start 2024-04-15T00:21:25.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.773+0000 7f4b84a08640 1 -- start start 2024-04-15T00:21:25.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.774+0000 7f4b84a08640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b800b94f0 0x7f4b80143c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:25.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.774+0000 7f4b84a08640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b800b9bd0 0x7f4b801449a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:25.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.774+0000 7f4b84a08640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4b8014b870 0x7f4b80142de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:25.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.774+0000 7f4b84a08640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4b800b9170 con 0x7f4b800b9bd0 2024-04-15T00:21:25.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.774+0000 7f4b84a08640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4b800bcbe0 con 0x7f4b800b94f0 2024-04-15T00:21:25.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.774+0000 7f4b84a08640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f4b800b92f0 con 0x7f4b8014b870 2024-04-15T00:21:25.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.774+0000 7f4b7dd9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b800b9bd0 0x7f4b801449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:25.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.774+0000 7f4b7dd9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b800b9bd0 0x7f4b801449a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51654/0 (socket says 172.21.15.31:51654) 2024-04-15T00:21:25.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.774+0000 7f4b7dd9b640 1 -- 172.21.15.31:0/771347246 learned_addr learned my addr 172.21.15.31:0/771347246 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:25.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.774+0000 7f4b7e59c640 1 --2- 172.21.15.31:0/771347246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b800b94f0 0x7f4b80143c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:25.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.774+0000 7f4b7ed9d640 1 --2- 172.21.15.31:0/771347246 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4b8014b870 0x7f4b80142de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:25.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.774+0000 7f4b7dd9b640 1 -- 172.21.15.31:0/771347246 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4b8014b870 msgr2=0x7f4b80142de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:25.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.774+0000 7f4b7dd9b640 1 --2- 172.21.15.31:0/771347246 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4b8014b870 0x7f4b80142de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.774+0000 7f4b7dd9b640 1 -- 172.21.15.31:0/771347246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b800b94f0 msgr2=0x7f4b80143c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:25.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.774+0000 7f4b7dd9b640 1 --2- 172.21.15.31:0/771347246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b800b94f0 0x7f4b80143c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.774+0000 7f4b7dd9b640 1 -- 172.21.15.31:0/771347246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b80144ee0 con 0x7f4b800b9bd0 2024-04-15T00:21:25.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.774+0000 7f4b7dd9b640 1 --2- 172.21.15.31:0/771347246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b800b9bd0 0x7f4b801449a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4b6802b8c0 tx=0x7f4b680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:25.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.774+0000 7f4b76ffd640 1 -- 172.21.15.31:0/771347246 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b68032880 con 0x7f4b800b9bd0 2024-04-15T00:21:25.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.774+0000 7f4b76ffd640 1 -- 172.21.15.31:0/771347246 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b68032a40 con 0x7f4b800b9bd0 2024-04-15T00:21:25.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.774+0000 7f4b84a08640 1 -- 172.21.15.31:0/771347246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b8009c330 con 0x7f4b800b9bd0 2024-04-15T00:21:25.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.774+0000 7f4b76ffd640 1 -- 172.21.15.31:0/771347246 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b68032e30 con 0x7f4b800b9bd0 2024-04-15T00:21:25.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.774+0000 7f4b84a08640 1 -- 172.21.15.31:0/771347246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b8009fcf0 con 0x7f4b800b9bd0 2024-04-15T00:21:25.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.775+0000 7f4b84a08640 1 -- 172.21.15.31:0/771347246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b80142ad0 con 0x7f4b800b9bd0 2024-04-15T00:21:25.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.775+0000 7f4b76ffd640 1 -- 172.21.15.31:0/771347246 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f4b680453f0 con 0x7f4b800b9bd0 2024-04-15T00:21:25.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.775+0000 7f4b76ffd640 1 --2- 172.21.15.31:0/771347246 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f4b6006b990 0x7f4b6006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:25.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.776+0000 7f4b7e59c640 1 --2- 172.21.15.31:0/771347246 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f4b6006b990 0x7f4b6006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:25.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.776+0000 7f4b76ffd640 1 -- 172.21.15.31:0/771347246 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4b680acb60 con 0x7f4b800b9bd0 2024-04-15T00:21:25.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.776+0000 7f4b7e59c640 1 --2- 172.21.15.31:0/771347246 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f4b6006b990 0x7f4b6006de50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4b78006fd0 tx=0x7f4b78008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:25.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.781+0000 7f4b76ffd640 1 -- 172.21.15.31:0/771347246 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4b80144ee0 con 0x7f4b800b9bd0 2024-04-15T00:21:25.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.961+0000 7f4b84a08640 1 -- 172.21.15.31:0/771347246 --> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4b8009de80 con 0x7f4b6006b990 2024-04-15T00:21:25.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.969+0000 7f4b76ffd640 1 -- 172.21.15.31:0/771347246 <== mgr.4107 v2:172.21.15.31:6832/915470279 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f4b8009de80 con 0x7f4b6006b990 2024-04-15T00:21:25.979 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:21:25.981 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-15T00:21:25.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.972+0000 7f4b84a08640 1 -- 172.21.15.31:0/771347246 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f4b6006b990 msgr2=0x7f4b6006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:25.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.972+0000 7f4b84a08640 1 --2- 172.21.15.31:0/771347246 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f4b6006b990 0x7f4b6006de50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4b78006fd0 tx=0x7f4b78008040 comp rx=0 tx=0).stop 2024-04-15T00:21:25.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.972+0000 7f4b84a08640 1 -- 172.21.15.31:0/771347246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b800b9bd0 msgr2=0x7f4b801449a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:25.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.972+0000 7f4b84a08640 1 --2- 172.21.15.31:0/771347246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b800b9bd0 0x7f4b801449a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4b6802b8c0 tx=0x7f4b680046c0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.972+0000 7f4b84a08640 1 -- 172.21.15.31:0/771347246 shutdown_connections 2024-04-15T00:21:25.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.972+0000 7f4b84a08640 1 --2- 172.21.15.31:0/771347246 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f4b6006b990 0x7f4b6006de50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.972+0000 7f4b84a08640 1 --2- 172.21.15.31:0/771347246 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4b8014b870 0x7f4b80142de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.972+0000 7f4b84a08640 1 --2- 172.21.15.31:0/771347246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b800b9bd0 0x7f4b801449a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.972+0000 7f4b84a08640 1 --2- 172.21.15.31:0/771347246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b800b94f0 0x7f4b80143c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:25.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.972+0000 7f4b84a08640 1 -- 172.21.15.31:0/771347246 >> 172.21.15.31:0/771347246 conn(0x7f4b8009ed70 msgr2=0x7f4b80072d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:25.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.972+0000 7f4b84a08640 1 -- 172.21.15.31:0/771347246 shutdown_connections 2024-04-15T00:21:25.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:25.972+0000 7f4b84a08640 1 -- 172.21.15.31:0/771347246 wait complete. 2024-04-15T00:21:25.990 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-04-15T00:21:24.394742+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231924,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742796,"statfs":{"total":773094113280,"available":772856623104,"internally_reserved":0,"allocated":3350528,"data_stored":2022430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.794585"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619325+0000","last_change":"2024-04-15T00:21:07.577313+0000","last_active":"2024-04-15T00:21:15.619325+0000","last_peered":"2024-04-15T00:21:15.619325+0000","last_clean":"2024-04-15T00:21:15.619325+0000","last_became_active":"2024-04-15T00:21:07.576921+0000","last_became_peered":"2024-04-15T00:21:07.576921+0000","last_unstale":"2024-04-15T00:21:15.619325+0000","last_undegraded":"2024-04-15T00:21:15.619325+0000","last_fullsized":"2024-04-15T00:21:15.619325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:41:31.846500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603048+0000","last_change":"2024-04-15T00:21:08.579912+0000","last_active":"2024-04-15T00:21:13.603048+0000","last_peered":"2024-04-15T00:21:13.603048+0000","last_clean":"2024-04-15T00:21:13.603048+0000","last_became_active":"2024-04-15T00:21:08.579545+0000","last_became_peered":"2024-04-15T00:21:08.579545+0000","last_unstale":"2024-04-15T00:21:13.603048+0000","last_undegraded":"2024-04-15T00:21:13.603048+0000","last_fullsized":"2024-04-15T00:21:13.603048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602258+0000","last_change":"2024-04-15T00:21:12.634366+0000","last_active":"2024-04-15T00:21:13.602258+0000","last_peered":"2024-04-15T00:21:13.602258+0000","last_clean":"2024-04-15T00:21:13.602258+0000","last_became_active":"2024-04-15T00:21:12.633323+0000","last_became_peered":"2024-04-15T00:21:12.633323+0000","last_unstale":"2024-04-15T00:21:13.602258+0000","last_undegraded":"2024-04-15T00:21:13.602258+0000","last_fullsized":"2024-04-15T00:21:13.602258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:26:21.575108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603161+0000","last_change":"2024-04-15T00:21:07.569057+0000","last_active":"2024-04-15T00:21:13.603161+0000","last_peered":"2024-04-15T00:21:13.603161+0000","last_clean":"2024-04-15T00:21:13.603161+0000","last_became_active":"2024-04-15T00:21:07.568724+0000","last_became_peered":"2024-04-15T00:21:07.568724+0000","last_unstale":"2024-04-15T00:21:13.603161+0000","last_undegraded":"2024-04-15T00:21:13.603161+0000","last_fullsized":"2024-04-15T00:21:13.603161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:21:35.113136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.621077+0000","last_change":"2024-04-15T00:21:08.598196+0000","last_active":"2024-04-15T00:21:15.621077+0000","last_peered":"2024-04-15T00:21:15.621077+0000","last_clean":"2024-04-15T00:21:15.621077+0000","last_became_active":"2024-04-15T00:21:08.597625+0000","last_became_peered":"2024-04-15T00:21:08.597625+0000","last_unstale":"2024-04-15T00:21:15.621077+0000","last_undegraded":"2024-04-15T00:21:15.621077+0000","last_fullsized":"2024-04-15T00:21:15.621077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602202+0000","last_change":"2024-04-15T00:21:12.624625+0000","last_active":"2024-04-15T00:21:13.602202+0000","last_peered":"2024-04-15T00:21:13.602202+0000","last_clean":"2024-04-15T00:21:13.602202+0000","last_became_active":"2024-04-15T00:21:12.624222+0000","last_became_peered":"2024-04-15T00:21:12.624222+0000","last_unstale":"2024-04-15T00:21:13.602202+0000","last_undegraded":"2024-04-15T00:21:13.602202+0000","last_fullsized":"2024-04-15T00:21:13.602202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:28.534842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.536054+0000","last_change":"2024-04-15T00:21:07.576936+0000","last_active":"2024-04-15T00:21:15.536054+0000","last_peered":"2024-04-15T00:21:15.536054+0000","last_clean":"2024-04-15T00:21:15.536054+0000","last_became_active":"2024-04-15T00:21:07.576674+0000","last_became_peered":"2024-04-15T00:21:07.576674+0000","last_unstale":"2024-04-15T00:21:15.536054+0000","last_undegraded":"2024-04-15T00:21:15.536054+0000","last_fullsized":"2024-04-15T00:21:15.536054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603516+0000","last_change":"2024-04-15T00:21:08.587098+0000","last_active":"2024-04-15T00:21:13.603516+0000","last_peered":"2024-04-15T00:21:13.603516+0000","last_clean":"2024-04-15T00:21:13.603516+0000","last_became_active":"2024-04-15T00:21:08.586825+0000","last_became_peered":"2024-04-15T00:21:08.586825+0000","last_unstale":"2024-04-15T00:21:13.603516+0000","last_undegraded":"2024-04-15T00:21:13.603516+0000","last_fullsized":"2024-04-15T00:21:13.603516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:30.470116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.604467+0000","last_change":"2024-04-15T00:21:12.619903+0000","last_active":"2024-04-15T00:21:13.604467+0000","last_peered":"2024-04-15T00:21:13.604467+0000","last_clean":"2024-04-15T00:21:13.604467+0000","last_became_active":"2024-04-15T00:21:12.619259+0000","last_became_peered":"2024-04-15T00:21:12.619259+0000","last_unstale":"2024-04-15T00:21:13.604467+0000","last_undegraded":"2024-04-15T00:21:13.604467+0000","last_fullsized":"2024-04-15T00:21:13.604467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:31.463828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535551+0000","last_change":"2024-04-15T00:21:07.579089+0000","last_active":"2024-04-15T00:21:15.535551+0000","last_peered":"2024-04-15T00:21:15.535551+0000","last_clean":"2024-04-15T00:21:15.535551+0000","last_became_active":"2024-04-15T00:21:07.578733+0000","last_became_peered":"2024-04-15T00:21:07.578733+0000","last_unstale":"2024-04-15T00:21:15.535551+0000","last_undegraded":"2024-04-15T00:21:15.535551+0000","last_fullsized":"2024-04-15T00:21:15.535551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:44:30.015803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603746+0000","last_change":"2024-04-15T00:21:08.588235+0000","last_active":"2024-04-15T00:21:13.603746+0000","last_peered":"2024-04-15T00:21:13.603746+0000","last_clean":"2024-04-15T00:21:13.603746+0000","last_became_active":"2024-04-15T00:21:08.587951+0000","last_became_peered":"2024-04-15T00:21:08.587951+0000","last_unstale":"2024-04-15T00:21:13.603746+0000","last_undegraded":"2024-04-15T00:21:13.603746+0000","last_fullsized":"2024-04-15T00:21:13.603746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:08.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603367+0000","last_change":"2024-04-15T00:21:12.613395+0000","last_active":"2024-04-15T00:21:13.603367+0000","last_peered":"2024-04-15T00:21:13.603367+0000","last_clean":"2024-04-15T00:21:13.603367+0000","last_became_active":"2024-04-15T00:21:12.612976+0000","last_became_peered":"2024-04-15T00:21:12.612976+0000","last_unstale":"2024-04-15T00:21:13.603367+0000","last_undegraded":"2024-04-15T00:21:13.603367+0000","last_fullsized":"2024-04-15T00:21:13.603367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:05.044024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620111+0000","last_change":"2024-04-15T00:21:08.585248+0000","last_active":"2024-04-15T00:21:15.620111+0000","last_peered":"2024-04-15T00:21:15.620111+0000","last_clean":"2024-04-15T00:21:15.620111+0000","last_became_active":"2024-04-15T00:21:08.584882+0000","last_became_peered":"2024-04-15T00:21:08.584882+0000","last_unstale":"2024-04-15T00:21:15.620111+0000","last_undegraded":"2024-04-15T00:21:15.620111+0000","last_fullsized":"2024-04-15T00:21:15.620111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:27:41.268464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535912+0000","last_change":"2024-04-15T00:21:07.580541+0000","last_active":"2024-04-15T00:21:15.535912+0000","last_peered":"2024-04-15T00:21:15.535912+0000","last_clean":"2024-04-15T00:21:15.535912+0000","last_became_active":"2024-04-15T00:21:07.580229+0000","last_became_peered":"2024-04-15T00:21:07.580229+0000","last_unstale":"2024-04-15T00:21:15.535912+0000","last_undegraded":"2024-04-15T00:21:15.535912+0000","last_fullsized":"2024-04-15T00:21:15.535912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:34:26.325595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602904+0000","last_change":"2024-04-15T00:21:12.624175+0000","last_active":"2024-04-15T00:21:13.602904+0000","last_peered":"2024-04-15T00:21:13.602904+0000","last_clean":"2024-04-15T00:21:13.602904+0000","last_became_active":"2024-04-15T00:21:12.623783+0000","last_became_peered":"2024-04-15T00:21:12.623783+0000","last_unstale":"2024-04-15T00:21:13.602904+0000","last_undegraded":"2024-04-15T00:21:13.602904+0000","last_fullsized":"2024-04-15T00:21:13.602904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:22:04.031788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602602+0000","last_change":"2024-04-15T00:21:08.594955+0000","last_active":"2024-04-15T00:21:13.602602+0000","last_peered":"2024-04-15T00:21:13.602602+0000","last_clean":"2024-04-15T00:21:13.602602+0000","last_became_active":"2024-04-15T00:21:08.594535+0000","last_became_peered":"2024-04-15T00:21:08.594535+0000","last_unstale":"2024-04-15T00:21:13.602602+0000","last_undegraded":"2024-04-15T00:21:13.602602+0000","last_fullsized":"2024-04-15T00:21:13.602602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:40.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619669+0000","last_change":"2024-04-15T00:21:07.570862+0000","last_active":"2024-04-15T00:21:15.619669+0000","last_peered":"2024-04-15T00:21:15.619669+0000","last_clean":"2024-04-15T00:21:15.619669+0000","last_became_active":"2024-04-15T00:21:07.570555+0000","last_became_peered":"2024-04-15T00:21:07.570555+0000","last_unstale":"2024-04-15T00:21:15.619669+0000","last_undegraded":"2024-04-15T00:21:15.619669+0000","last_fullsized":"2024-04-15T00:21:15.619669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:54.810223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602579+0000","last_change":"2024-04-15T00:21:12.624936+0000","last_active":"2024-04-15T00:21:13.602579+0000","last_peered":"2024-04-15T00:21:13.602579+0000","last_clean":"2024-04-15T00:21:13.602579+0000","last_became_active":"2024-04-15T00:21:12.623808+0000","last_became_peered":"2024-04-15T00:21:12.623808+0000","last_unstale":"2024-04-15T00:21:13.602579+0000","last_undegraded":"2024-04-15T00:21:13.602579+0000","last_fullsized":"2024-04-15T00:21:13.602579+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:12.264127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602413+0000","last_change":"2024-04-15T00:21:08.574901+0000","last_active":"2024-04-15T00:21:13.602413+0000","last_peered":"2024-04-15T00:21:13.602413+0000","last_clean":"2024-04-15T00:21:13.602413+0000","last_became_active":"2024-04-15T00:21:08.574536+0000","last_became_peered":"2024-04-15T00:21:08.574536+0000","last_unstale":"2024-04-15T00:21:13.602413+0000","last_undegraded":"2024-04-15T00:21:13.602413+0000","last_fullsized":"2024-04-15T00:21:13.602413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:08.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619923+0000","last_change":"2024-04-15T00:21:07.577048+0000","last_active":"2024-04-15T00:21:15.619923+0000","last_peered":"2024-04-15T00:21:15.619923+0000","last_clean":"2024-04-15T00:21:15.619923+0000","last_became_active":"2024-04-15T00:21:07.576739+0000","last_became_peered":"2024-04-15T00:21:07.576739+0000","last_unstale":"2024-04-15T00:21:15.619923+0000","last_undegraded":"2024-04-15T00:21:15.619923+0000","last_fullsized":"2024-04-15T00:21:15.619923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:14.441186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620337+0000","last_change":"2024-04-15T00:21:12.632213+0000","last_active":"2024-04-15T00:21:15.620337+0000","last_peered":"2024-04-15T00:21:15.620337+0000","last_clean":"2024-04-15T00:21:15.620337+0000","last_became_active":"2024-04-15T00:21:12.631900+0000","last_became_peered":"2024-04-15T00:21:12.631900+0000","last_unstale":"2024-04-15T00:21:15.620337+0000","last_undegraded":"2024-04-15T00:21:15.620337+0000","last_fullsized":"2024-04-15T00:21:15.620337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:52:31.142377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602577+0000","last_change":"2024-04-15T00:21:08.590270+0000","last_active":"2024-04-15T00:21:13.602577+0000","last_peered":"2024-04-15T00:21:13.602577+0000","last_clean":"2024-04-15T00:21:13.602577+0000","last_became_active":"2024-04-15T00:21:08.589960+0000","last_became_peered":"2024-04-15T00:21:08.589960+0000","last_unstale":"2024-04-15T00:21:13.602577+0000","last_undegraded":"2024-04-15T00:21:13.602577+0000","last_fullsized":"2024-04-15T00:21:13.602577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:52.880065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535251+0000","last_change":"2024-04-15T00:21:07.577518+0000","last_active":"2024-04-15T00:21:15.535251+0000","last_peered":"2024-04-15T00:21:15.535251+0000","last_clean":"2024-04-15T00:21:15.535251+0000","last_became_active":"2024-04-15T00:21:07.576961+0000","last_became_peered":"2024-04-15T00:21:07.576961+0000","last_unstale":"2024-04-15T00:21:15.535251+0000","last_undegraded":"2024-04-15T00:21:15.535251+0000","last_fullsized":"2024-04-15T00:21:15.535251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:14.441186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602862+0000","last_change":"2024-04-15T00:21:12.624501+0000","last_active":"2024-04-15T00:21:13.602862+0000","last_peered":"2024-04-15T00:21:13.602862+0000","last_clean":"2024-04-15T00:21:13.602862+0000","last_became_active":"2024-04-15T00:21:12.624011+0000","last_became_peered":"2024-04-15T00:21:12.624011+0000","last_unstale":"2024-04-15T00:21:13.602862+0000","last_undegraded":"2024-04-15T00:21:13.602862+0000","last_fullsized":"2024-04-15T00:21:13.602862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:10:28.514357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620962+0000","last_change":"2024-04-15T00:21:08.601349+0000","last_active":"2024-04-15T00:21:15.620962+0000","last_peered":"2024-04-15T00:21:15.620962+0000","last_clean":"2024-04-15T00:21:15.620962+0000","last_became_active":"2024-04-15T00:21:08.601048+0000","last_became_peered":"2024-04-15T00:21:08.601048+0000","last_unstale":"2024-04-15T00:21:15.620962+0000","last_undegraded":"2024-04-15T00:21:15.620962+0000","last_fullsized":"2024-04-15T00:21:15.620962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:27:41.268464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619530+0000","last_change":"2024-04-15T00:21:07.577793+0000","last_active":"2024-04-15T00:21:15.619530+0000","last_peered":"2024-04-15T00:21:15.619530+0000","last_clean":"2024-04-15T00:21:15.619530+0000","last_became_active":"2024-04-15T00:21:07.577472+0000","last_became_peered":"2024-04-15T00:21:07.577472+0000","last_unstale":"2024-04-15T00:21:15.619530+0000","last_undegraded":"2024-04-15T00:21:15.619530+0000","last_fullsized":"2024-04-15T00:21:15.619530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:54.810223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602347+0000","last_change":"2024-04-15T00:21:12.634814+0000","last_active":"2024-04-15T00:21:13.602347+0000","last_peered":"2024-04-15T00:21:13.602347+0000","last_clean":"2024-04-15T00:21:13.602347+0000","last_became_active":"2024-04-15T00:21:12.633228+0000","last_became_peered":"2024-04-15T00:21:12.633228+0000","last_unstale":"2024-04-15T00:21:13.602347+0000","last_undegraded":"2024-04-15T00:21:13.602347+0000","last_fullsized":"2024-04-15T00:21:13.602347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:13.312501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602987+0000","last_change":"2024-04-15T00:21:08.596235+0000","last_active":"2024-04-15T00:21:13.602987+0000","last_peered":"2024-04-15T00:21:13.602987+0000","last_clean":"2024-04-15T00:21:13.602987+0000","last_became_active":"2024-04-15T00:21:08.595901+0000","last_became_peered":"2024-04-15T00:21:08.595901+0000","last_unstale":"2024-04-15T00:21:13.602987+0000","last_undegraded":"2024-04-15T00:21:13.602987+0000","last_fullsized":"2024-04-15T00:21:13.602987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:21:59.995077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620914+0000","last_change":"2024-04-15T00:21:07.573285+0000","last_active":"2024-04-15T00:21:15.620914+0000","last_peered":"2024-04-15T00:21:15.620914+0000","last_clean":"2024-04-15T00:21:15.620914+0000","last_became_active":"2024-04-15T00:21:07.572973+0000","last_became_peered":"2024-04-15T00:21:07.572973+0000","last_unstale":"2024-04-15T00:21:15.620914+0000","last_undegraded":"2024-04-15T00:21:15.620914+0000","last_fullsized":"2024-04-15T00:21:15.620914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602159+0000","last_change":"2024-04-15T00:21:12.633602+0000","last_active":"2024-04-15T00:21:13.602159+0000","last_peered":"2024-04-15T00:21:13.602159+0000","last_clean":"2024-04-15T00:21:13.602159+0000","last_became_active":"2024-04-15T00:21:12.633178+0000","last_became_peered":"2024-04-15T00:21:12.633178+0000","last_unstale":"2024-04-15T00:21:13.602159+0000","last_undegraded":"2024-04-15T00:21:13.602159+0000","last_fullsized":"2024-04-15T00:21:13.602159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:01:48.959493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.621191+0000","last_change":"2024-04-15T00:21:08.580727+0000","last_active":"2024-04-15T00:21:15.621191+0000","last_peered":"2024-04-15T00:21:15.621191+0000","last_clean":"2024-04-15T00:21:15.621191+0000","last_became_active":"2024-04-15T00:21:08.580418+0000","last_became_peered":"2024-04-15T00:21:08.580418+0000","last_unstale":"2024-04-15T00:21:15.621191+0000","last_undegraded":"2024-04-15T00:21:15.621191+0000","last_fullsized":"2024-04-15T00:21:15.621191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.536148+0000","last_change":"2024-04-15T00:21:07.575864+0000","last_active":"2024-04-15T00:21:15.536148+0000","last_peered":"2024-04-15T00:21:15.536148+0000","last_clean":"2024-04-15T00:21:15.536148+0000","last_became_active":"2024-04-15T00:21:07.575562+0000","last_became_peered":"2024-04-15T00:21:07.575562+0000","last_unstale":"2024-04-15T00:21:15.536148+0000","last_undegraded":"2024-04-15T00:21:15.536148+0000","last_fullsized":"2024-04-15T00:21:15.536148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:35:39.009511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620429+0000","last_change":"2024-04-15T00:21:12.633674+0000","last_active":"2024-04-15T00:21:15.620429+0000","last_peered":"2024-04-15T00:21:15.620429+0000","last_clean":"2024-04-15T00:21:15.620429+0000","last_became_active":"2024-04-15T00:21:12.633277+0000","last_became_peered":"2024-04-15T00:21:12.633277+0000","last_unstale":"2024-04-15T00:21:15.620429+0000","last_undegraded":"2024-04-15T00:21:15.620429+0000","last_fullsized":"2024-04-15T00:21:15.620429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:49.295552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603880+0000","last_change":"2024-04-15T00:21:08.578321+0000","last_active":"2024-04-15T00:21:13.603880+0000","last_peered":"2024-04-15T00:21:13.603880+0000","last_clean":"2024-04-15T00:21:13.603880+0000","last_became_active":"2024-04-15T00:21:08.578017+0000","last_became_peered":"2024-04-15T00:21:08.578017+0000","last_unstale":"2024-04-15T00:21:13.603880+0000","last_undegraded":"2024-04-15T00:21:13.603880+0000","last_fullsized":"2024-04-15T00:21:13.603880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:40.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.621338+0000","last_change":"2024-04-15T00:21:07.575183+0000","last_active":"2024-04-15T00:21:15.621338+0000","last_peered":"2024-04-15T00:21:15.621338+0000","last_clean":"2024-04-15T00:21:15.621338+0000","last_became_active":"2024-04-15T00:21:07.574822+0000","last_became_peered":"2024-04-15T00:21:07.574822+0000","last_unstale":"2024-04-15T00:21:15.621338+0000","last_undegraded":"2024-04-15T00:21:15.621338+0000","last_fullsized":"2024-04-15T00:21:15.621338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:26:22.612110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619998+0000","last_change":"2024-04-15T00:21:12.620150+0000","last_active":"2024-04-15T00:21:15.619998+0000","last_peered":"2024-04-15T00:21:15.619998+0000","last_clean":"2024-04-15T00:21:15.619998+0000","last_became_active":"2024-04-15T00:21:12.619694+0000","last_became_peered":"2024-04-15T00:21:12.619694+0000","last_unstale":"2024-04-15T00:21:15.619998+0000","last_undegraded":"2024-04-15T00:21:15.619998+0000","last_fullsized":"2024-04-15T00:21:15.619998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:34.506827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.604336+0000","last_change":"2024-04-15T00:21:08.596959+0000","last_active":"2024-04-15T00:21:13.604336+0000","last_peered":"2024-04-15T00:21:13.604336+0000","last_clean":"2024-04-15T00:21:13.604336+0000","last_became_active":"2024-04-15T00:21:08.596678+0000","last_became_peered":"2024-04-15T00:21:08.596678+0000","last_unstale":"2024-04-15T00:21:13.604336+0000","last_undegraded":"2024-04-15T00:21:13.604336+0000","last_fullsized":"2024-04-15T00:21:13.604336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:35:40.014598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603779+0000","last_change":"2024-04-15T00:21:07.574514+0000","last_active":"2024-04-15T00:21:13.603779+0000","last_peered":"2024-04-15T00:21:13.603779+0000","last_clean":"2024-04-15T00:21:13.603779+0000","last_became_active":"2024-04-15T00:21:07.574228+0000","last_became_peered":"2024-04-15T00:21:07.574228+0000","last_unstale":"2024-04-15T00:21:13.603779+0000","last_undegraded":"2024-04-15T00:21:13.603779+0000","last_fullsized":"2024-04-15T00:21:13.603779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.621262+0000","last_change":"2024-04-15T00:21:12.619733+0000","last_active":"2024-04-15T00:21:15.621262+0000","last_peered":"2024-04-15T00:21:15.621262+0000","last_clean":"2024-04-15T00:21:15.621262+0000","last_became_active":"2024-04-15T00:21:12.619307+0000","last_became_peered":"2024-04-15T00:21:12.619307+0000","last_unstale":"2024-04-15T00:21:15.621262+0000","last_undegraded":"2024-04-15T00:21:15.621262+0000","last_fullsized":"2024-04-15T00:21:15.621262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:48:00.696018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.621663+0000","last_change":"2024-04-15T00:21:08.589246+0000","last_active":"2024-04-15T00:21:15.621663+0000","last_peered":"2024-04-15T00:21:15.621663+0000","last_clean":"2024-04-15T00:21:15.621663+0000","last_became_active":"2024-04-15T00:21:08.588920+0000","last_became_peered":"2024-04-15T00:21:08.588920+0000","last_unstale":"2024-04-15T00:21:15.621663+0000","last_undegraded":"2024-04-15T00:21:15.621663+0000","last_fullsized":"2024-04-15T00:21:15.621663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619227+0000","last_change":"2024-04-15T00:21:07.566537+0000","last_active":"2024-04-15T00:21:15.619227+0000","last_peered":"2024-04-15T00:21:15.619227+0000","last_clean":"2024-04-15T00:21:15.619227+0000","last_became_active":"2024-04-15T00:21:07.566240+0000","last_became_peered":"2024-04-15T00:21:07.566240+0000","last_unstale":"2024-04-15T00:21:15.619227+0000","last_undegraded":"2024-04-15T00:21:15.619227+0000","last_fullsized":"2024-04-15T00:21:15.619227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:16:52.647503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.621073+0000","last_change":"2024-04-15T00:21:12.623452+0000","last_active":"2024-04-15T00:21:15.621073+0000","last_peered":"2024-04-15T00:21:15.621073+0000","last_clean":"2024-04-15T00:21:15.621073+0000","last_became_active":"2024-04-15T00:21:12.623066+0000","last_became_peered":"2024-04-15T00:21:12.623066+0000","last_unstale":"2024-04-15T00:21:15.621073+0000","last_undegraded":"2024-04-15T00:21:15.621073+0000","last_fullsized":"2024-04-15T00:21:15.621073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:11:16.107864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619704+0000","last_change":"2024-04-15T00:21:08.586376+0000","last_active":"2024-04-15T00:21:15.619704+0000","last_peered":"2024-04-15T00:21:15.619704+0000","last_clean":"2024-04-15T00:21:15.619704+0000","last_became_active":"2024-04-15T00:21:08.586054+0000","last_became_peered":"2024-04-15T00:21:08.586054+0000","last_unstale":"2024-04-15T00:21:15.619704+0000","last_undegraded":"2024-04-15T00:21:15.619704+0000","last_fullsized":"2024-04-15T00:21:15.619704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:02:56.329428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535288+0000","last_change":"2024-04-15T00:21:07.577289+0000","last_active":"2024-04-15T00:21:15.535288+0000","last_peered":"2024-04-15T00:21:15.535288+0000","last_clean":"2024-04-15T00:21:15.535288+0000","last_became_active":"2024-04-15T00:21:07.576602+0000","last_became_peered":"2024-04-15T00:21:07.576602+0000","last_unstale":"2024-04-15T00:21:15.535288+0000","last_undegraded":"2024-04-15T00:21:15.535288+0000","last_fullsized":"2024-04-15T00:21:15.535288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:26:22.612110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620938+0000","last_change":"2024-04-15T00:21:12.634248+0000","last_active":"2024-04-15T00:21:15.620938+0000","last_peered":"2024-04-15T00:21:15.620938+0000","last_clean":"2024-04-15T00:21:15.620938+0000","last_became_active":"2024-04-15T00:21:12.633239+0000","last_became_peered":"2024-04-15T00:21:12.633239+0000","last_unstale":"2024-04-15T00:21:15.620938+0000","last_undegraded":"2024-04-15T00:21:15.620938+0000","last_fullsized":"2024-04-15T00:21:15.620938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:52:31.142377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602451+0000","last_change":"2024-04-15T00:21:08.591060+0000","last_active":"2024-04-15T00:21:13.602451+0000","last_peered":"2024-04-15T00:21:13.602451+0000","last_clean":"2024-04-15T00:21:13.602451+0000","last_became_active":"2024-04-15T00:21:08.590781+0000","last_became_peered":"2024-04-15T00:21:08.590781+0000","last_unstale":"2024-04-15T00:21:13.602451+0000","last_undegraded":"2024-04-15T00:21:13.602451+0000","last_fullsized":"2024-04-15T00:21:13.602451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603293+0000","last_change":"2024-04-15T00:21:07.573617+0000","last_active":"2024-04-15T00:21:13.603293+0000","last_peered":"2024-04-15T00:21:13.603293+0000","last_clean":"2024-04-15T00:21:13.603293+0000","last_became_active":"2024-04-15T00:21:07.573308+0000","last_became_peered":"2024-04-15T00:21:07.573308+0000","last_unstale":"2024-04-15T00:21:13.603293+0000","last_undegraded":"2024-04-15T00:21:13.603293+0000","last_fullsized":"2024-04-15T00:21:13.603293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:36:11.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535374+0000","last_change":"2024-04-15T00:20:57.937516+0000","last_active":"2024-04-15T00:21:15.535374+0000","last_peered":"2024-04-15T00:21:15.535374+0000","last_clean":"2024-04-15T00:21:15.535374+0000","last_became_active":"2024-04-15T00:20:57.936329+0000","last_became_peered":"2024-04-15T00:20:57.936329+0000","last_unstale":"2024-04-15T00:21:15.535374+0000","last_undegraded":"2024-04-15T00:21:15.535374+0000","last_fullsized":"2024-04-15T00:21:15.535374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:20:56.517419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:20:56.517419+0000","last_clean_scrub_stamp":"2024-04-15T00:20:56.517419+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:07:23.949459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620409+0000","last_change":"2024-04-15T00:21:12.633530+0000","last_active":"2024-04-15T00:21:15.620409+0000","last_peered":"2024-04-15T00:21:15.620409+0000","last_clean":"2024-04-15T00:21:15.620409+0000","last_became_active":"2024-04-15T00:21:12.633124+0000","last_became_peered":"2024-04-15T00:21:12.633124+0000","last_unstale":"2024-04-15T00:21:15.620409+0000","last_undegraded":"2024-04-15T00:21:15.620409+0000","last_fullsized":"2024-04-15T00:21:15.620409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:49.295552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535728+0000","last_change":"2024-04-15T00:21:08.583443+0000","last_active":"2024-04-15T00:21:15.535728+0000","last_peered":"2024-04-15T00:21:15.535728+0000","last_clean":"2024-04-15T00:21:15.535728+0000","last_became_active":"2024-04-15T00:21:08.583143+0000","last_became_peered":"2024-04-15T00:21:08.583143+0000","last_unstale":"2024-04-15T00:21:15.535728+0000","last_undegraded":"2024-04-15T00:21:15.535728+0000","last_fullsized":"2024-04-15T00:21:15.535728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:01.007313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619590+0000","last_change":"2024-04-15T00:21:07.579386+0000","last_active":"2024-04-15T00:21:15.619590+0000","last_peered":"2024-04-15T00:21:15.619590+0000","last_clean":"2024-04-15T00:21:15.619590+0000","last_became_active":"2024-04-15T00:21:07.579024+0000","last_became_peered":"2024-04-15T00:21:07.579024+0000","last_unstale":"2024-04-15T00:21:15.619590+0000","last_undegraded":"2024-04-15T00:21:15.619590+0000","last_fullsized":"2024-04-15T00:21:15.619590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:36:11.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620189+0000","last_change":"2024-04-15T00:21:12.635286+0000","last_active":"2024-04-15T00:21:15.620189+0000","last_peered":"2024-04-15T00:21:15.620189+0000","last_clean":"2024-04-15T00:21:15.620189+0000","last_became_active":"2024-04-15T00:21:12.634689+0000","last_became_peered":"2024-04-15T00:21:12.634689+0000","last_unstale":"2024-04-15T00:21:15.620189+0000","last_undegraded":"2024-04-15T00:21:15.620189+0000","last_fullsized":"2024-04-15T00:21:15.620189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:05.044024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603811+0000","last_change":"2024-04-15T00:21:08.579790+0000","last_active":"2024-04-15T00:21:13.603811+0000","last_peered":"2024-04-15T00:21:13.603811+0000","last_clean":"2024-04-15T00:21:13.603811+0000","last_became_active":"2024-04-15T00:21:08.576604+0000","last_became_peered":"2024-04-15T00:21:08.576604+0000","last_unstale":"2024-04-15T00:21:13.603811+0000","last_undegraded":"2024-04-15T00:21:13.603811+0000","last_fullsized":"2024-04-15T00:21:13.603811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:52:10.558592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619527+0000","last_change":"2024-04-15T00:21:07.571553+0000","last_active":"2024-04-15T00:21:15.619527+0000","last_peered":"2024-04-15T00:21:15.619527+0000","last_clean":"2024-04-15T00:21:15.619527+0000","last_became_active":"2024-04-15T00:21:07.571238+0000","last_became_peered":"2024-04-15T00:21:07.571238+0000","last_unstale":"2024-04-15T00:21:15.619527+0000","last_undegraded":"2024-04-15T00:21:15.619527+0000","last_fullsized":"2024-04-15T00:21:15.619527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:35:39.009511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620592+0000","last_change":"2024-04-15T00:21:12.619646+0000","last_active":"2024-04-15T00:21:15.620592+0000","last_peered":"2024-04-15T00:21:15.620592+0000","last_clean":"2024-04-15T00:21:15.620592+0000","last_became_active":"2024-04-15T00:21:12.619263+0000","last_became_peered":"2024-04-15T00:21:12.619263+0000","last_unstale":"2024-04-15T00:21:15.620592+0000","last_undegraded":"2024-04-15T00:21:15.620592+0000","last_fullsized":"2024-04-15T00:21:15.620592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:31.463828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.536088+0000","last_change":"2024-04-15T00:21:08.599410+0000","last_active":"2024-04-15T00:21:15.536088+0000","last_peered":"2024-04-15T00:21:15.536088+0000","last_clean":"2024-04-15T00:21:15.536088+0000","last_became_active":"2024-04-15T00:21:08.599132+0000","last_became_peered":"2024-04-15T00:21:08.599132+0000","last_unstale":"2024-04-15T00:21:15.536088+0000","last_undegraded":"2024-04-15T00:21:15.536088+0000","last_fullsized":"2024-04-15T00:21:15.536088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:47:56.659307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619601+0000","last_change":"2024-04-15T00:21:07.567917+0000","last_active":"2024-04-15T00:21:15.619601+0000","last_peered":"2024-04-15T00:21:15.619601+0000","last_clean":"2024-04-15T00:21:15.619601+0000","last_became_active":"2024-04-15T00:21:07.567673+0000","last_became_peered":"2024-04-15T00:21:07.567673+0000","last_unstale":"2024-04-15T00:21:15.619601+0000","last_undegraded":"2024-04-15T00:21:15.619601+0000","last_fullsized":"2024-04-15T00:21:15.619601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:54.810223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602134+0000","last_change":"2024-04-15T00:21:12.632937+0000","last_active":"2024-04-15T00:21:13.602134+0000","last_peered":"2024-04-15T00:21:13.602134+0000","last_clean":"2024-04-15T00:21:13.602134+0000","last_became_active":"2024-04-15T00:21:12.632508+0000","last_became_peered":"2024-04-15T00:21:12.632508+0000","last_unstale":"2024-04-15T00:21:13.602134+0000","last_undegraded":"2024-04-15T00:21:13.602134+0000","last_fullsized":"2024-04-15T00:21:13.602134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:07:36.246879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535820+0000","last_change":"2024-04-15T00:21:08.600430+0000","last_active":"2024-04-15T00:21:15.535820+0000","last_peered":"2024-04-15T00:21:15.535820+0000","last_clean":"2024-04-15T00:21:15.535820+0000","last_became_active":"2024-04-15T00:21:08.600142+0000","last_became_peered":"2024-04-15T00:21:08.600142+0000","last_unstale":"2024-04-15T00:21:15.535820+0000","last_undegraded":"2024-04-15T00:21:15.535820+0000","last_fullsized":"2024-04-15T00:21:15.535820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:30.470116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602933+0000","last_change":"2024-04-15T00:21:07.576781+0000","last_active":"2024-04-15T00:21:13.602933+0000","last_peered":"2024-04-15T00:21:13.602933+0000","last_clean":"2024-04-15T00:21:13.602933+0000","last_became_active":"2024-04-15T00:21:07.576491+0000","last_became_peered":"2024-04-15T00:21:07.576491+0000","last_unstale":"2024-04-15T00:21:13.602933+0000","last_undegraded":"2024-04-15T00:21:13.602933+0000","last_fullsized":"2024-04-15T00:21:13.602933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:41:31.846500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602828+0000","last_change":"2024-04-15T00:21:12.620247+0000","last_active":"2024-04-15T00:21:13.602828+0000","last_peered":"2024-04-15T00:21:13.602828+0000","last_clean":"2024-04-15T00:21:13.602828+0000","last_became_active":"2024-04-15T00:21:12.619257+0000","last_became_peered":"2024-04-15T00:21:12.619257+0000","last_unstale":"2024-04-15T00:21:13.602828+0000","last_undegraded":"2024-04-15T00:21:13.602828+0000","last_fullsized":"2024-04-15T00:21:13.602828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:44.287619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535641+0000","last_change":"2024-04-15T00:21:08.590732+0000","last_active":"2024-04-15T00:21:15.535641+0000","last_peered":"2024-04-15T00:21:15.535641+0000","last_clean":"2024-04-15T00:21:15.535641+0000","last_became_active":"2024-04-15T00:21:08.590450+0000","last_became_peered":"2024-04-15T00:21:08.590450+0000","last_unstale":"2024-04-15T00:21:15.535641+0000","last_undegraded":"2024-04-15T00:21:15.535641+0000","last_fullsized":"2024-04-15T00:21:15.535641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:10:24.477646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619783+0000","last_change":"2024-04-15T00:21:07.566984+0000","last_active":"2024-04-15T00:21:15.619783+0000","last_peered":"2024-04-15T00:21:15.619783+0000","last_clean":"2024-04-15T00:21:15.619783+0000","last_became_active":"2024-04-15T00:21:07.566681+0000","last_became_peered":"2024-04-15T00:21:07.566681+0000","last_unstale":"2024-04-15T00:21:15.619783+0000","last_undegraded":"2024-04-15T00:21:15.619783+0000","last_fullsized":"2024-04-15T00:21:15.619783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:21:35.113136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620857+0000","last_change":"2024-04-15T00:21:12.615981+0000","last_active":"2024-04-15T00:21:15.620857+0000","last_peered":"2024-04-15T00:21:15.620857+0000","last_clean":"2024-04-15T00:21:15.620857+0000","last_became_active":"2024-04-15T00:21:12.615577+0000","last_became_peered":"2024-04-15T00:21:12.615577+0000","last_unstale":"2024-04-15T00:21:15.620857+0000","last_undegraded":"2024-04-15T00:21:15.620857+0000","last_fullsized":"2024-04-15T00:21:15.620857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:52:14.595303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619951+0000","last_change":"2024-04-15T00:21:08.588266+0000","last_active":"2024-04-15T00:21:15.619951+0000","last_peered":"2024-04-15T00:21:15.619951+0000","last_clean":"2024-04-15T00:21:15.619951+0000","last_became_active":"2024-04-15T00:21:08.587962+0000","last_became_peered":"2024-04-15T00:21:08.587962+0000","last_unstale":"2024-04-15T00:21:15.619951+0000","last_undegraded":"2024-04-15T00:21:15.619951+0000","last_fullsized":"2024-04-15T00:21:15.619951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619445+0000","last_change":"2024-04-15T00:21:07.573664+0000","last_active":"2024-04-15T00:21:15.619445+0000","last_peered":"2024-04-15T00:21:15.619445+0000","last_clean":"2024-04-15T00:21:15.619445+0000","last_became_active":"2024-04-15T00:21:07.573325+0000","last_became_peered":"2024-04-15T00:21:07.573325+0000","last_unstale":"2024-04-15T00:21:15.619445+0000","last_undegraded":"2024-04-15T00:21:15.619445+0000","last_fullsized":"2024-04-15T00:21:15.619445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:16:52.647503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602823+0000","last_change":"2024-04-15T00:21:12.634889+0000","last_active":"2024-04-15T00:21:13.602823+0000","last_peered":"2024-04-15T00:21:13.602823+0000","last_clean":"2024-04-15T00:21:13.602823+0000","last_became_active":"2024-04-15T00:21:12.634527+0000","last_became_peered":"2024-04-15T00:21:12.634527+0000","last_unstale":"2024-04-15T00:21:13.602823+0000","last_undegraded":"2024-04-15T00:21:13.602823+0000","last_fullsized":"2024-04-15T00:21:13.602823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:29.469506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535769+0000","last_change":"2024-04-15T00:21:08.593412+0000","last_active":"2024-04-15T00:21:15.535769+0000","last_peered":"2024-04-15T00:21:15.535769+0000","last_clean":"2024-04-15T00:21:15.535769+0000","last_became_active":"2024-04-15T00:21:08.593112+0000","last_became_peered":"2024-04-15T00:21:08.593112+0000","last_unstale":"2024-04-15T00:21:15.535769+0000","last_undegraded":"2024-04-15T00:21:15.535769+0000","last_fullsized":"2024-04-15T00:21:15.535769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:45.258841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603654+0000","last_change":"2024-04-15T00:21:07.576800+0000","last_active":"2024-04-15T00:21:13.603654+0000","last_peered":"2024-04-15T00:21:13.603654+0000","last_clean":"2024-04-15T00:21:13.603654+0000","last_became_active":"2024-04-15T00:21:07.576501+0000","last_became_peered":"2024-04-15T00:21:07.576501+0000","last_unstale":"2024-04-15T00:21:13.603654+0000","last_undegraded":"2024-04-15T00:21:13.603654+0000","last_fullsized":"2024-04-15T00:21:13.603654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:54.810223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603284+0000","last_change":"2024-04-15T00:21:12.634065+0000","last_active":"2024-04-15T00:21:13.603284+0000","last_peered":"2024-04-15T00:21:13.603284+0000","last_clean":"2024-04-15T00:21:13.603284+0000","last_became_active":"2024-04-15T00:21:12.633242+0000","last_became_peered":"2024-04-15T00:21:12.633242+0000","last_unstale":"2024-04-15T00:21:13.603284+0000","last_undegraded":"2024-04-15T00:21:13.603284+0000","last_fullsized":"2024-04-15T00:21:13.603284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:38:32.207334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619978+0000","last_change":"2024-04-15T00:21:08.598979+0000","last_active":"2024-04-15T00:21:15.619978+0000","last_peered":"2024-04-15T00:21:15.619978+0000","last_clean":"2024-04-15T00:21:15.619978+0000","last_became_active":"2024-04-15T00:21:08.598700+0000","last_became_peered":"2024-04-15T00:21:08.598700+0000","last_unstale":"2024-04-15T00:21:15.619978+0000","last_undegraded":"2024-04-15T00:21:15.619978+0000","last_fullsized":"2024-04-15T00:21:15.619978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:10.980339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619067+0000","last_change":"2024-04-15T00:21:07.573340+0000","last_active":"2024-04-15T00:21:15.619067+0000","last_peered":"2024-04-15T00:21:15.619067+0000","last_clean":"2024-04-15T00:21:15.619067+0000","last_became_active":"2024-04-15T00:21:07.572749+0000","last_became_peered":"2024-04-15T00:21:07.572749+0000","last_unstale":"2024-04-15T00:21:15.619067+0000","last_undegraded":"2024-04-15T00:21:15.619067+0000","last_fullsized":"2024-04-15T00:21:15.619067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:05:06.225337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603983+0000","last_change":"2024-04-15T00:21:12.632412+0000","last_active":"2024-04-15T00:21:13.603983+0000","last_peered":"2024-04-15T00:21:13.603983+0000","last_clean":"2024-04-15T00:21:13.603983+0000","last_became_active":"2024-04-15T00:21:12.631982+0000","last_became_peered":"2024-04-15T00:21:12.631982+0000","last_unstale":"2024-04-15T00:21:13.603983+0000","last_undegraded":"2024-04-15T00:21:13.603983+0000","last_fullsized":"2024-04-15T00:21:13.603983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:11:44.674232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535698+0000","last_change":"2024-04-15T00:21:08.582822+0000","last_active":"2024-04-15T00:21:15.535698+0000","last_peered":"2024-04-15T00:21:15.535698+0000","last_clean":"2024-04-15T00:21:15.535698+0000","last_became_active":"2024-04-15T00:21:08.582531+0000","last_became_peered":"2024-04-15T00:21:08.582531+0000","last_unstale":"2024-04-15T00:21:15.535698+0000","last_undegraded":"2024-04-15T00:21:15.535698+0000","last_fullsized":"2024-04-15T00:21:15.535698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:21:59.995077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:17.377719+0000","last_change":"2024-04-15T00:21:07.576694+0000","last_active":"2024-04-15T00:21:17.377719+0000","last_peered":"2024-04-15T00:21:17.377719+0000","last_clean":"2024-04-15T00:21:17.377719+0000","last_became_active":"2024-04-15T00:21:07.576380+0000","last_became_peered":"2024-04-15T00:21:07.576380+0000","last_unstale":"2024-04-15T00:21:17.377719+0000","last_undegraded":"2024-04-15T00:21:17.377719+0000","last_fullsized":"2024-04-15T00:21:17.377719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:36:11.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620233+0000","last_change":"2024-04-15T00:21:12.620928+0000","last_active":"2024-04-15T00:21:15.620233+0000","last_peered":"2024-04-15T00:21:15.620233+0000","last_clean":"2024-04-15T00:21:15.620233+0000","last_became_active":"2024-04-15T00:21:12.620536+0000","last_became_peered":"2024-04-15T00:21:12.620536+0000","last_unstale":"2024-04-15T00:21:15.620233+0000","last_undegraded":"2024-04-15T00:21:15.620233+0000","last_fullsized":"2024-04-15T00:21:15.620233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:52:14.595303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603960+0000","last_change":"2024-04-15T00:21:08.588132+0000","last_active":"2024-04-15T00:21:13.603960+0000","last_peered":"2024-04-15T00:21:13.603960+0000","last_clean":"2024-04-15T00:21:13.603960+0000","last_became_active":"2024-04-15T00:21:08.587383+0000","last_became_peered":"2024-04-15T00:21:08.587383+0000","last_unstale":"2024-04-15T00:21:13.603960+0000","last_undegraded":"2024-04-15T00:21:13.603960+0000","last_fullsized":"2024-04-15T00:21:13.603960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:15.446273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619661+0000","last_change":"2024-04-15T00:21:07.574695+0000","last_active":"2024-04-15T00:21:15.619661+0000","last_peered":"2024-04-15T00:21:15.619661+0000","last_clean":"2024-04-15T00:21:15.619661+0000","last_became_active":"2024-04-15T00:21:07.574389+0000","last_became_peered":"2024-04-15T00:21:07.574389+0000","last_unstale":"2024-04-15T00:21:15.619661+0000","last_undegraded":"2024-04-15T00:21:15.619661+0000","last_fullsized":"2024-04-15T00:21:15.619661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:34:26.325595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.604076+0000","last_change":"2024-04-15T00:21:12.620255+0000","last_active":"2024-04-15T00:21:13.604076+0000","last_peered":"2024-04-15T00:21:13.604076+0000","last_clean":"2024-04-15T00:21:13.604076+0000","last_became_active":"2024-04-15T00:21:12.619218+0000","last_became_peered":"2024-04-15T00:21:12.619218+0000","last_unstale":"2024-04-15T00:21:13.604076+0000","last_undegraded":"2024-04-15T00:21:13.604076+0000","last_fullsized":"2024-04-15T00:21:13.604076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:49.295552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.621210+0000","last_change":"2024-04-15T00:21:08.597898+0000","last_active":"2024-04-15T00:21:15.621210+0000","last_peered":"2024-04-15T00:21:15.621210+0000","last_clean":"2024-04-15T00:21:15.621210+0000","last_became_active":"2024-04-15T00:21:08.597262+0000","last_became_peered":"2024-04-15T00:21:08.597262+0000","last_unstale":"2024-04-15T00:21:15.621210+0000","last_undegraded":"2024-04-15T00:21:15.621210+0000","last_fullsized":"2024-04-15T00:21:15.621210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603559+0000","last_change":"2024-04-15T00:21:07.574003+0000","last_active":"2024-04-15T00:21:13.603559+0000","last_peered":"2024-04-15T00:21:13.603559+0000","last_clean":"2024-04-15T00:21:13.603559+0000","last_became_active":"2024-04-15T00:21:07.573469+0000","last_became_peered":"2024-04-15T00:21:07.573469+0000","last_unstale":"2024-04-15T00:21:13.603559+0000","last_undegraded":"2024-04-15T00:21:13.603559+0000","last_fullsized":"2024-04-15T00:21:13.603559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:16:52.647503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602626+0000","last_change":"2024-04-15T00:21:12.624850+0000","last_active":"2024-04-15T00:21:13.602626+0000","last_peered":"2024-04-15T00:21:13.602626+0000","last_clean":"2024-04-15T00:21:13.602626+0000","last_became_active":"2024-04-15T00:21:12.624484+0000","last_became_peered":"2024-04-15T00:21:12.624484+0000","last_unstale":"2024-04-15T00:21:13.602626+0000","last_undegraded":"2024-04-15T00:21:13.602626+0000","last_fullsized":"2024-04-15T00:21:13.602626+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:15:08.738300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603345+0000","last_change":"2024-04-15T00:21:08.591705+0000","last_active":"2024-04-15T00:21:13.603345+0000","last_peered":"2024-04-15T00:21:13.603345+0000","last_clean":"2024-04-15T00:21:13.603345+0000","last_became_active":"2024-04-15T00:21:08.591407+0000","last_became_peered":"2024-04-15T00:21:08.591407+0000","last_unstale":"2024-04-15T00:21:13.603345+0000","last_undegraded":"2024-04-15T00:21:13.603345+0000","last_fullsized":"2024-04-15T00:21:13.603345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619610+0000","last_change":"2024-04-15T00:21:07.574971+0000","last_active":"2024-04-15T00:21:15.619610+0000","last_peered":"2024-04-15T00:21:15.619610+0000","last_clean":"2024-04-15T00:21:15.619610+0000","last_became_active":"2024-04-15T00:21:07.574656+0000","last_became_peered":"2024-04-15T00:21:07.574656+0000","last_unstale":"2024-04-15T00:21:15.619610+0000","last_undegraded":"2024-04-15T00:21:15.619610+0000","last_fullsized":"2024-04-15T00:21:15.619610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:21:35.113136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602552+0000","last_change":"2024-04-15T00:21:12.633646+0000","last_active":"2024-04-15T00:21:13.602552+0000","last_peered":"2024-04-15T00:21:13.602552+0000","last_clean":"2024-04-15T00:21:13.602552+0000","last_became_active":"2024-04-15T00:21:12.633262+0000","last_became_peered":"2024-04-15T00:21:12.633262+0000","last_unstale":"2024-04-15T00:21:13.602552+0000","last_undegraded":"2024-04-15T00:21:13.602552+0000","last_fullsized":"2024-04-15T00:21:13.602552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:26:17.136974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620791+0000","last_change":"2024-04-15T00:21:12.634552+0000","last_active":"2024-04-15T00:21:15.620791+0000","last_peered":"2024-04-15T00:21:15.620791+0000","last_clean":"2024-04-15T00:21:15.620791+0000","last_became_active":"2024-04-15T00:21:12.633824+0000","last_became_peered":"2024-04-15T00:21:12.633824+0000","last_unstale":"2024-04-15T00:21:15.620791+0000","last_undegraded":"2024-04-15T00:21:15.620791+0000","last_fullsized":"2024-04-15T00:21:15.620791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:34.506827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620127+0000","last_change":"2024-04-15T00:21:08.577988+0000","last_active":"2024-04-15T00:21:15.620127+0000","last_peered":"2024-04-15T00:21:15.620127+0000","last_clean":"2024-04-15T00:21:15.620127+0000","last_became_active":"2024-04-15T00:21:08.577692+0000","last_became_peered":"2024-04-15T00:21:08.577692+0000","last_unstale":"2024-04-15T00:21:15.620127+0000","last_undegraded":"2024-04-15T00:21:15.620127+0000","last_fullsized":"2024-04-15T00:21:15.620127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602539+0000","last_change":"2024-04-15T00:21:07.563155+0000","last_active":"2024-04-15T00:21:13.602539+0000","last_peered":"2024-04-15T00:21:13.602539+0000","last_clean":"2024-04-15T00:21:13.602539+0000","last_became_active":"2024-04-15T00:21:07.562747+0000","last_became_peered":"2024-04-15T00:21:07.562747+0000","last_unstale":"2024-04-15T00:21:13.602539+0000","last_undegraded":"2024-04-15T00:21:13.602539+0000","last_fullsized":"2024-04-15T00:21:13.602539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:21:35.113136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620544+0000","last_change":"2024-04-15T00:21:12.624627+0000","last_active":"2024-04-15T00:21:15.620544+0000","last_peered":"2024-04-15T00:21:15.620544+0000","last_clean":"2024-04-15T00:21:15.620544+0000","last_became_active":"2024-04-15T00:21:12.624245+0000","last_became_peered":"2024-04-15T00:21:12.624245+0000","last_unstale":"2024-04-15T00:21:15.620544+0000","last_undegraded":"2024-04-15T00:21:15.620544+0000","last_fullsized":"2024-04-15T00:21:15.620544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:31.463828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602302+0000","last_change":"2024-04-15T00:21:08.590595+0000","last_active":"2024-04-15T00:21:13.602302+0000","last_peered":"2024-04-15T00:21:13.602302+0000","last_clean":"2024-04-15T00:21:13.602302+0000","last_became_active":"2024-04-15T00:21:08.590333+0000","last_became_peered":"2024-04-15T00:21:08.590333+0000","last_unstale":"2024-04-15T00:21:13.602302+0000","last_undegraded":"2024-04-15T00:21:13.602302+0000","last_fullsized":"2024-04-15T00:21:13.602302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602611+0000","last_change":"2024-04-15T00:21:07.576399+0000","last_active":"2024-04-15T00:21:13.602611+0000","last_peered":"2024-04-15T00:21:13.602611+0000","last_clean":"2024-04-15T00:21:13.602611+0000","last_became_active":"2024-04-15T00:21:07.576008+0000","last_became_peered":"2024-04-15T00:21:07.576008+0000","last_unstale":"2024-04-15T00:21:13.602611+0000","last_undegraded":"2024-04-15T00:21:13.602611+0000","last_fullsized":"2024-04-15T00:21:13.602611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:16:52.647503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619476+0000","last_change":"2024-04-15T00:21:07.572597+0000","last_active":"2024-04-15T00:21:15.619476+0000","last_peered":"2024-04-15T00:21:15.619476+0000","last_clean":"2024-04-15T00:21:15.619476+0000","last_became_active":"2024-04-15T00:21:07.572273+0000","last_became_peered":"2024-04-15T00:21:07.572273+0000","last_unstale":"2024-04-15T00:21:15.619476+0000","last_undegraded":"2024-04-15T00:21:15.619476+0000","last_fullsized":"2024-04-15T00:21:15.619476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620643+0000","last_change":"2024-04-15T00:21:08.587210+0000","last_active":"2024-04-15T00:21:15.620643+0000","last_peered":"2024-04-15T00:21:15.620643+0000","last_clean":"2024-04-15T00:21:15.620643+0000","last_became_active":"2024-04-15T00:21:08.586910+0000","last_became_peered":"2024-04-15T00:21:08.586910+0000","last_unstale":"2024-04-15T00:21:15.620643+0000","last_undegraded":"2024-04-15T00:21:15.620643+0000","last_fullsized":"2024-04-15T00:21:15.620643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619912+0000","last_change":"2024-04-15T00:21:12.622128+0000","last_active":"2024-04-15T00:21:15.619912+0000","last_peered":"2024-04-15T00:21:15.619912+0000","last_clean":"2024-04-15T00:21:15.619912+0000","last_became_active":"2024-04-15T00:21:12.621682+0000","last_became_peered":"2024-04-15T00:21:12.621682+0000","last_unstale":"2024-04-15T00:21:15.619912+0000","last_undegraded":"2024-04-15T00:21:15.619912+0000","last_fullsized":"2024-04-15T00:21:15.619912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:03:00.366139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602718+0000","last_change":"2024-04-15T00:21:07.577069+0000","last_active":"2024-04-15T00:21:13.602718+0000","last_peered":"2024-04-15T00:21:13.602718+0000","last_clean":"2024-04-15T00:21:13.602718+0000","last_became_active":"2024-04-15T00:21:07.576791+0000","last_became_peered":"2024-04-15T00:21:07.576791+0000","last_unstale":"2024-04-15T00:21:13.602718+0000","last_undegraded":"2024-04-15T00:21:13.602718+0000","last_fullsized":"2024-04-15T00:21:13.602718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:36:11.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603254+0000","last_change":"2024-04-15T00:21:08.584214+0000","last_active":"2024-04-15T00:21:13.603254+0000","last_peered":"2024-04-15T00:21:13.603254+0000","last_clean":"2024-04-15T00:21:13.603254+0000","last_became_active":"2024-04-15T00:21:08.583909+0000","last_became_peered":"2024-04-15T00:21:08.583909+0000","last_unstale":"2024-04-15T00:21:13.603254+0000","last_undegraded":"2024-04-15T00:21:13.603254+0000","last_fullsized":"2024-04-15T00:21:13.603254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:55.815311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602896+0000","last_change":"2024-04-15T00:21:12.624156+0000","last_active":"2024-04-15T00:21:13.602896+0000","last_peered":"2024-04-15T00:21:13.602896+0000","last_clean":"2024-04-15T00:21:13.602896+0000","last_became_active":"2024-04-15T00:21:12.623756+0000","last_became_peered":"2024-04-15T00:21:12.623756+0000","last_unstale":"2024-04-15T00:21:13.602896+0000","last_undegraded":"2024-04-15T00:21:13.602896+0000","last_fullsized":"2024-04-15T00:21:13.602896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:31:33.202296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619829+0000","last_change":"2024-04-15T00:21:08.588647+0000","last_active":"2024-04-15T00:21:15.619829+0000","last_peered":"2024-04-15T00:21:15.619829+0000","last_clean":"2024-04-15T00:21:15.619829+0000","last_became_active":"2024-04-15T00:21:08.587719+0000","last_became_peered":"2024-04-15T00:21:08.587719+0000","last_unstale":"2024-04-15T00:21:15.619829+0000","last_undegraded":"2024-04-15T00:21:15.619829+0000","last_fullsized":"2024-04-15T00:21:15.619829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:39.454082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619475+0000","last_change":"2024-04-15T00:21:08.596094+0000","last_active":"2024-04-15T00:21:15.619475+0000","last_peered":"2024-04-15T00:21:15.619475+0000","last_clean":"2024-04-15T00:21:15.619475+0000","last_became_active":"2024-04-15T00:21:08.595790+0000","last_became_peered":"2024-04-15T00:21:08.595790+0000","last_unstale":"2024-04-15T00:21:15.619475+0000","last_undegraded":"2024-04-15T00:21:15.619475+0000","last_fullsized":"2024-04-15T00:21:15.619475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:15.446273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603593+0000","last_change":"2024-04-15T00:21:08.583148+0000","last_active":"2024-04-15T00:21:13.603593+0000","last_peered":"2024-04-15T00:21:13.603593+0000","last_clean":"2024-04-15T00:21:13.603593+0000","last_became_active":"2024-04-15T00:21:08.582801+0000","last_became_peered":"2024-04-15T00:21:08.582801+0000","last_unstale":"2024-04-15T00:21:13.603593+0000","last_undegraded":"2024-04-15T00:21:13.603593+0000","last_fullsized":"2024-04-15T00:21:13.603593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:01.007313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620505+0000","last_change":"2024-04-15T00:21:08.596406+0000","last_active":"2024-04-15T00:21:15.620505+0000","last_peered":"2024-04-15T00:21:15.620505+0000","last_clean":"2024-04-15T00:21:15.620505+0000","last_became_active":"2024-04-15T00:21:08.596144+0000","last_became_peered":"2024-04-15T00:21:08.596144+0000","last_unstale":"2024-04-15T00:21:15.620505+0000","last_undegraded":"2024-04-15T00:21:15.620505+0000","last_fullsized":"2024-04-15T00:21:15.620505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603411+0000","last_change":"2024-04-15T00:21:08.591959+0000","last_active":"2024-04-15T00:21:13.603411+0000","last_peered":"2024-04-15T00:21:13.603411+0000","last_clean":"2024-04-15T00:21:13.603411+0000","last_became_active":"2024-04-15T00:21:08.591479+0000","last_became_peered":"2024-04-15T00:21:08.591479+0000","last_unstale":"2024-04-15T00:21:13.603411+0000","last_undegraded":"2024-04-15T00:21:13.603411+0000","last_fullsized":"2024-04-15T00:21:13.603411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619869+0000","last_change":"2024-04-15T00:21:08.577658+0000","last_active":"2024-04-15T00:21:15.619869+0000","last_peered":"2024-04-15T00:21:15.619869+0000","last_clean":"2024-04-15T00:21:15.619869+0000","last_became_active":"2024-04-15T00:21:08.577358+0000","last_became_peered":"2024-04-15T00:21:08.577358+0000","last_unstale":"2024-04-15T00:21:15.619869+0000","last_undegraded":"2024-04-15T00:21:15.619869+0000","last_fullsized":"2024-04-15T00:21:15.619869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620568+0000","last_change":"2024-04-15T00:21:08.593462+0000","last_active":"2024-04-15T00:21:15.620568+0000","last_peered":"2024-04-15T00:21:15.620568+0000","last_clean":"2024-04-15T00:21:15.620568+0000","last_became_active":"2024-04-15T00:21:08.593174+0000","last_became_peered":"2024-04-15T00:21:08.593174+0000","last_unstale":"2024-04-15T00:21:15.620568+0000","last_undegraded":"2024-04-15T00:21:15.620568+0000","last_fullsized":"2024-04-15T00:21:15.620568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602883+0000","last_change":"2024-04-15T00:21:08.582109+0000","last_active":"2024-04-15T00:21:13.602883+0000","last_peered":"2024-04-15T00:21:13.602883+0000","last_clean":"2024-04-15T00:21:13.602883+0000","last_became_active":"2024-04-15T00:21:08.581828+0000","last_became_peered":"2024-04-15T00:21:08.581828+0000","last_unstale":"2024-04-15T00:21:13.602883+0000","last_undegraded":"2024-04-15T00:21:13.602883+0000","last_fullsized":"2024-04-15T00:21:13.602883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:01.007313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602485+0000","last_change":"2024-04-15T00:21:08.582329+0000","last_active":"2024-04-15T00:21:13.602485+0000","last_peered":"2024-04-15T00:21:13.602485+0000","last_clean":"2024-04-15T00:21:13.602485+0000","last_became_active":"2024-04-15T00:21:08.582011+0000","last_became_peered":"2024-04-15T00:21:08.582011+0000","last_unstale":"2024-04-15T00:21:13.602485+0000","last_undegraded":"2024-04-15T00:21:13.602485+0000","last_fullsized":"2024-04-15T00:21:13.602485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602496+0000","last_change":"2024-04-15T00:21:08.581215+0000","last_active":"2024-04-15T00:21:13.602496+0000","last_peered":"2024-04-15T00:21:13.602496+0000","last_clean":"2024-04-15T00:21:13.602496+0000","last_became_active":"2024-04-15T00:21:08.579860+0000","last_became_peered":"2024-04-15T00:21:08.579860+0000","last_unstale":"2024-04-15T00:21:13.602496+0000","last_undegraded":"2024-04-15T00:21:13.602496+0000","last_fullsized":"2024-04-15T00:21:13.602496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603446+0000","last_change":"2024-04-15T00:21:08.592785+0000","last_active":"2024-04-15T00:21:13.603446+0000","last_peered":"2024-04-15T00:21:13.603446+0000","last_clean":"2024-04-15T00:21:13.603446+0000","last_became_active":"2024-04-15T00:21:08.592110+0000","last_became_peered":"2024-04-15T00:21:08.592110+0000","last_unstale":"2024-04-15T00:21:13.603446+0000","last_undegraded":"2024-04-15T00:21:13.603446+0000","last_fullsized":"2024-04-15T00:21:13.603446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:45.258841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620413+0000","last_change":"2024-04-15T00:21:08.599781+0000","last_active":"2024-04-15T00:21:15.620413+0000","last_peered":"2024-04-15T00:21:15.620413+0000","last_clean":"2024-04-15T00:21:15.620413+0000","last_became_active":"2024-04-15T00:21:08.599460+0000","last_became_peered":"2024-04-15T00:21:08.599460+0000","last_unstale":"2024-04-15T00:21:15.620413+0000","last_undegraded":"2024-04-15T00:21:15.620413+0000","last_fullsized":"2024-04-15T00:21:15.620413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:39.454082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620344+0000","last_change":"2024-04-15T00:21:08.588233+0000","last_active":"2024-04-15T00:21:15.620344+0000","last_peered":"2024-04-15T00:21:15.620344+0000","last_clean":"2024-04-15T00:21:15.620344+0000","last_became_active":"2024-04-15T00:21:08.586235+0000","last_became_peered":"2024-04-15T00:21:08.586235+0000","last_unstale":"2024-04-15T00:21:15.620344+0000","last_undegraded":"2024-04-15T00:21:15.620344+0000","last_fullsized":"2024-04-15T00:21:15.620344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.536068+0000","last_change":"2024-04-15T00:21:08.582000+0000","last_active":"2024-04-15T00:21:15.536068+0000","last_peered":"2024-04-15T00:21:15.536068+0000","last_clean":"2024-04-15T00:21:15.536068+0000","last_became_active":"2024-04-15T00:21:08.581714+0000","last_became_peered":"2024-04-15T00:21:08.581714+0000","last_unstale":"2024-04-15T00:21:15.536068+0000","last_undegraded":"2024-04-15T00:21:15.536068+0000","last_fullsized":"2024-04-15T00:21:15.536068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:27.427117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620436+0000","last_change":"2024-04-15T00:21:08.582994+0000","last_active":"2024-04-15T00:21:15.620436+0000","last_peered":"2024-04-15T00:21:15.620436+0000","last_clean":"2024-04-15T00:21:15.620436+0000","last_became_active":"2024-04-15T00:21:08.582594+0000","last_became_peered":"2024-04-15T00:21:08.582594+0000","last_unstale":"2024-04-15T00:21:15.620436+0000","last_undegraded":"2024-04-15T00:21:15.620436+0000","last_fullsized":"2024-04-15T00:21:15.620436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:26:23.617197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.604186+0000","last_change":"2024-04-15T00:21:08.591937+0000","last_active":"2024-04-15T00:21:13.604186+0000","last_peered":"2024-04-15T00:21:13.604186+0000","last_clean":"2024-04-15T00:21:13.604186+0000","last_became_active":"2024-04-15T00:21:08.591655+0000","last_became_peered":"2024-04-15T00:21:08.591655+0000","last_unstale":"2024-04-15T00:21:13.604186+0000","last_undegraded":"2024-04-15T00:21:13.604186+0000","last_fullsized":"2024-04-15T00:21:13.604186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:21:59.995077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602330+0000","last_change":"2024-04-15T00:21:08.590844+0000","last_active":"2024-04-15T00:21:13.602330+0000","last_peered":"2024-04-15T00:21:13.602330+0000","last_clean":"2024-04-15T00:21:13.602330+0000","last_became_active":"2024-04-15T00:21:08.588982+0000","last_became_peered":"2024-04-15T00:21:08.588982+0000","last_unstale":"2024-04-15T00:21:13.602330+0000","last_undegraded":"2024-04-15T00:21:13.602330+0000","last_fullsized":"2024-04-15T00:21:13.602330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620225+0000","last_change":"2024-04-15T00:21:08.581452+0000","last_active":"2024-04-15T00:21:15.620225+0000","last_peered":"2024-04-15T00:21:15.620225+0000","last_clean":"2024-04-15T00:21:15.620225+0000","last_became_active":"2024-04-15T00:21:08.580967+0000","last_became_peered":"2024-04-15T00:21:08.580967+0000","last_unstale":"2024-04-15T00:21:15.620225+0000","last_undegraded":"2024-04-15T00:21:15.620225+0000","last_fullsized":"2024-04-15T00:21:15.620225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619889+0000","last_change":"2024-04-15T00:21:08.587249+0000","last_active":"2024-04-15T00:21:15.619889+0000","last_peered":"2024-04-15T00:21:15.619889+0000","last_clean":"2024-04-15T00:21:15.619889+0000","last_became_active":"2024-04-15T00:21:08.586885+0000","last_became_peered":"2024-04-15T00:21:08.586885+0000","last_unstale":"2024-04-15T00:21:15.619889+0000","last_undegraded":"2024-04-15T00:21:15.619889+0000","last_fullsized":"2024-04-15T00:21:15.619889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:44:31.020890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602456+0000","last_change":"2024-04-15T00:21:08.579970+0000","last_active":"2024-04-15T00:21:13.602456+0000","last_peered":"2024-04-15T00:21:13.602456+0000","last_clean":"2024-04-15T00:21:13.602456+0000","last_became_active":"2024-04-15T00:21:08.579652+0000","last_became_peered":"2024-04-15T00:21:08.579652+0000","last_unstale":"2024-04-15T00:21:13.602456+0000","last_undegraded":"2024-04-15T00:21:13.602456+0000","last_fullsized":"2024-04-15T00:21:13.602456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:10:24.477646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602944+0000","last_change":"2024-04-15T00:21:08.588376+0000","last_active":"2024-04-15T00:21:13.602944+0000","last_peered":"2024-04-15T00:21:13.602944+0000","last_clean":"2024-04-15T00:21:13.602944+0000","last_became_active":"2024-04-15T00:21:08.587712+0000","last_became_peered":"2024-04-15T00:21:08.587712+0000","last_unstale":"2024-04-15T00:21:13.602944+0000","last_undegraded":"2024-04-15T00:21:13.602944+0000","last_fullsized":"2024-04-15T00:21:13.602944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:34:27.330682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620402+0000","last_change":"2024-04-15T00:21:08.597204+0000","last_active":"2024-04-15T00:21:15.620402+0000","last_peered":"2024-04-15T00:21:15.620402+0000","last_clean":"2024-04-15T00:21:15.620402+0000","last_became_active":"2024-04-15T00:21:08.596862+0000","last_became_peered":"2024-04-15T00:21:08.596862+0000","last_unstale":"2024-04-15T00:21:15.620402+0000","last_undegraded":"2024-04-15T00:21:15.620402+0000","last_fullsized":"2024-04-15T00:21:15.620402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620515+0000","last_change":"2024-04-15T00:21:08.598199+0000","last_active":"2024-04-15T00:21:15.620515+0000","last_peered":"2024-04-15T00:21:15.620515+0000","last_clean":"2024-04-15T00:21:15.620515+0000","last_became_active":"2024-04-15T00:21:08.597790+0000","last_became_peered":"2024-04-15T00:21:08.597790+0000","last_unstale":"2024-04-15T00:21:15.620515+0000","last_undegraded":"2024-04-15T00:21:15.620515+0000","last_fullsized":"2024-04-15T00:21:15.620515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.536057+0000","last_change":"2024-04-15T00:21:08.600496+0000","last_active":"2024-04-15T00:21:15.536057+0000","last_peered":"2024-04-15T00:21:15.536057+0000","last_clean":"2024-04-15T00:21:15.536057+0000","last_became_active":"2024-04-15T00:21:08.600121+0000","last_became_peered":"2024-04-15T00:21:08.600121+0000","last_unstale":"2024-04-15T00:21:15.536057+0000","last_undegraded":"2024-04-15T00:21:15.536057+0000","last_fullsized":"2024-04-15T00:21:15.536057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:11:12.071153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602194+0000","last_change":"2024-04-15T00:21:08.583866+0000","last_active":"2024-04-15T00:21:13.602194+0000","last_peered":"2024-04-15T00:21:13.602194+0000","last_clean":"2024-04-15T00:21:13.602194+0000","last_became_active":"2024-04-15T00:21:08.583563+0000","last_became_peered":"2024-04-15T00:21:08.583563+0000","last_unstale":"2024-04-15T00:21:13.602194+0000","last_undegraded":"2024-04-15T00:21:13.602194+0000","last_fullsized":"2024-04-15T00:21:13.602194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:27:41.268464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535532+0000","last_change":"2024-04-15T00:21:08.596983+0000","last_active":"2024-04-15T00:21:15.535532+0000","last_peered":"2024-04-15T00:21:15.535532+0000","last_clean":"2024-04-15T00:21:15.535532+0000","last_became_active":"2024-04-15T00:21:08.596640+0000","last_became_peered":"2024-04-15T00:21:08.596640+0000","last_unstale":"2024-04-15T00:21:15.535532+0000","last_undegraded":"2024-04-15T00:21:15.535532+0000","last_fullsized":"2024-04-15T00:21:15.535532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:40.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603293+0000","last_change":"2024-04-15T00:21:08.593027+0000","last_active":"2024-04-15T00:21:13.603293+0000","last_peered":"2024-04-15T00:21:13.603293+0000","last_clean":"2024-04-15T00:21:13.603293+0000","last_became_active":"2024-04-15T00:21:08.592476+0000","last_became_peered":"2024-04-15T00:21:08.592476+0000","last_unstale":"2024-04-15T00:21:13.603293+0000","last_undegraded":"2024-04-15T00:21:13.603293+0000","last_fullsized":"2024-04-15T00:21:13.603293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:10:24.477646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535675+0000","last_change":"2024-04-15T00:21:08.591419+0000","last_active":"2024-04-15T00:21:15.535675+0000","last_peered":"2024-04-15T00:21:15.535675+0000","last_clean":"2024-04-15T00:21:15.535675+0000","last_became_active":"2024-04-15T00:21:08.591101+0000","last_became_peered":"2024-04-15T00:21:08.591101+0000","last_unstale":"2024-04-15T00:21:15.535675+0000","last_undegraded":"2024-04-15T00:21:15.535675+0000","last_fullsized":"2024-04-15T00:21:15.535675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:52:10.558592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603323+0000","last_change":"2024-04-15T00:21:08.581621+0000","last_active":"2024-04-15T00:21:13.603323+0000","last_peered":"2024-04-15T00:21:13.603323+0000","last_clean":"2024-04-15T00:21:13.603323+0000","last_became_active":"2024-04-15T00:21:08.581316+0000","last_became_peered":"2024-04-15T00:21:08.581316+0000","last_unstale":"2024-04-15T00:21:13.603323+0000","last_undegraded":"2024-04-15T00:21:13.603323+0000","last_fullsized":"2024-04-15T00:21:13.603323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:27.427117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620634+0000","last_change":"2024-04-15T00:21:08.590252+0000","last_active":"2024-04-15T00:21:15.620634+0000","last_peered":"2024-04-15T00:21:15.620634+0000","last_clean":"2024-04-15T00:21:15.620634+0000","last_became_active":"2024-04-15T00:21:08.589919+0000","last_became_peered":"2024-04-15T00:21:08.589919+0000","last_unstale":"2024-04-15T00:21:15.620634+0000","last_undegraded":"2024-04-15T00:21:15.620634+0000","last_fullsized":"2024-04-15T00:21:15.620634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:46:53.537904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620862+0000","last_change":"2024-04-15T00:21:08.588530+0000","last_active":"2024-04-15T00:21:15.620862+0000","last_peered":"2024-04-15T00:21:15.620862+0000","last_clean":"2024-04-15T00:21:15.620862+0000","last_became_active":"2024-04-15T00:21:08.588208+0000","last_became_peered":"2024-04-15T00:21:08.588208+0000","last_unstale":"2024-04-15T00:21:15.620862+0000","last_undegraded":"2024-04-15T00:21:15.620862+0000","last_fullsized":"2024-04-15T00:21:15.620862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:08.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535948+0000","last_change":"2024-04-15T00:21:08.588469+0000","last_active":"2024-04-15T00:21:15.535948+0000","last_peered":"2024-04-15T00:21:15.535948+0000","last_clean":"2024-04-15T00:21:15.535948+0000","last_became_active":"2024-04-15T00:21:08.587646+0000","last_became_peered":"2024-04-15T00:21:08.587646+0000","last_unstale":"2024-04-15T00:21:15.535948+0000","last_undegraded":"2024-04-15T00:21:15.535948+0000","last_fullsized":"2024-04-15T00:21:15.535948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:52:27.105666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":107788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":104087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":695093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":695037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":107788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":104177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":274432,"data_stored":104213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":104247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T00:21:25.995 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-15T00:21:25.995 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-15T00:21:25.995 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-15T00:21:25.996 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-15T00:21:25.996 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-15T00:21:26.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.126+0000 7fe19f408640 1 Processor -- start 2024-04-15T00:21:26.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.126+0000 7fe19f408640 1 -- start start 2024-04-15T00:21:26.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.126+0000 7fe19f408640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe19814b8e0 0x7fe1980b9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:26.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.126+0000 7fe19f408640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1980bb2d0 con 0x7fe1980b8bf0 2024-04-15T00:21:26.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.126+0000 7fe19f408640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe19814ae00 con 0x7fe1980baef0 2024-04-15T00:21:26.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.126+0000 7fe19f408640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe19814b0e0 con 0x7fe19814b8e0 2024-04-15T00:21:26.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.126+0000 7fe19d9a5640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe1980b8bf0 0x7fe198151ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:39328/0 (socket says 172.21.15.31:39328) 2024-04-15T00:21:26.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.126+0000 7fe19d9a5640 1 -- 172.21.15.31:0/866342519 learned_addr learned my addr 172.21.15.31:0/866342519 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:26.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.126+0000 7fe19c9a3640 1 --2- 172.21.15.31:0/866342519 >> v2:172.21.15.50:3300/0 conn(0x7fe19814b8e0 0x7fe1980b9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:26.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.127+0000 7fe197fff640 1 -- 172.21.15.31:0/866342519 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4067795479 0 0) 0x7fe1980bb2d0 con 0x7fe1980b8bf0 2024-04-15T00:21:26.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.127+0000 7fe197fff640 1 -- 172.21.15.31:0/866342519 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe180003520 con 0x7fe1980b8bf0 2024-04-15T00:21:26.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.127+0000 7fe197fff640 1 -- 172.21.15.31:0/866342519 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1476586783 0 0) 0x7fe19814ae00 con 0x7fe1980baef0 2024-04-15T00:21:26.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.127+0000 7fe197fff640 1 -- 172.21.15.31:0/866342519 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1980bb2d0 con 0x7fe1980baef0 2024-04-15T00:21:26.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.127+0000 7fe19c9a3640 1 -- 172.21.15.31:0/866342519 >> v1:172.21.15.50:6789/0 conn(0x7fe1980baef0 legacy=0x7fe198147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:26.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.127+0000 7fe19c9a3640 1 -- 172.21.15.31:0/866342519 >> v1:172.21.15.31:6789/0 conn(0x7fe1980b8bf0 legacy=0x7fe198151ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:26.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.127+0000 7fe19c9a3640 1 -- 172.21.15.31:0/866342519 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1980bcbb0 con 0x7fe19814b8e0 2024-04-15T00:21:26.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.128+0000 7fe19c9a3640 1 --2- 172.21.15.31:0/866342519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe19814b8e0 0x7fe1980b9a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0097a0 tx=0x7fe18c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74de7ea52320cad1 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:26.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.128+0000 7fe197fff640 1 -- 172.21.15.31:0/866342519 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c035020 con 0x7fe19814b8e0 2024-04-15T00:21:26.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.128+0000 7fe197fff640 1 -- 172.21.15.31:0/866342519 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe18c031830 con 0x7fe19814b8e0 2024-04-15T00:21:26.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.128+0000 7fe197fff640 1 -- 172.21.15.31:0/866342519 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c031be0 con 0x7fe19814b8e0 2024-04-15T00:21:26.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.128+0000 7fe19f408640 1 -- 172.21.15.31:0/866342519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe19814b8e0 msgr2=0x7fe1980b9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:26.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.128+0000 7fe19f408640 1 --2- 172.21.15.31:0/866342519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe19814b8e0 0x7fe1980b9a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0097a0 tx=0x7fe18c02b8d0 comp rx=0 tx=0).stop 2024-04-15T00:21:26.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.128+0000 7fe19f408640 1 -- 172.21.15.31:0/866342519 shutdown_connections 2024-04-15T00:21:26.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.128+0000 7fe19f408640 1 --2- 172.21.15.31:0/866342519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe19814b8e0 0x7fe1980b9a10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:26.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.128+0000 7fe19f408640 1 -- 172.21.15.31:0/866342519 >> 172.21.15.31:0/866342519 conn(0x7fe19809ed70 msgr2=0x7fe19809f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:26.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.128+0000 7fe19f408640 1 -- 172.21.15.31:0/866342519 shutdown_connections 2024-04-15T00:21:26.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.128+0000 7fe19f408640 1 -- 172.21.15.31:0/866342519 wait complete. 2024-04-15T00:21:26.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.129+0000 7fe19f408640 1 Processor -- start 2024-04-15T00:21:26.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.129+0000 7fe19f408640 1 -- start start 2024-04-15T00:21:26.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.130+0000 7fe19f408640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe1980b8bf0 0x7fe1980a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:26.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.130+0000 7fe19f408640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1980baef0 0x7fe198141f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:26.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.130+0000 7fe19f408640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe19814b8e0 0x7fe1981424a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:26.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.130+0000 7fe19f408640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe1980b9180 con 0x7fe1980baef0 2024-04-15T00:21:26.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.130+0000 7fe19f408640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe1980b9000 con 0x7fe19814b8e0 2024-04-15T00:21:26.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.130+0000 7fe19f408640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fe1980b9300 con 0x7fe1980b8bf0 2024-04-15T00:21:26.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.130+0000 7fe19c9a3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1980baef0 0x7fe198141f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:26.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.130+0000 7fe19c9a3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1980baef0 0x7fe198141f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51658/0 (socket says 172.21.15.31:51658) 2024-04-15T00:21:26.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.130+0000 7fe19c9a3640 1 -- 172.21.15.31:0/1956388625 learned_addr learned my addr 172.21.15.31:0/1956388625 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:26.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.130+0000 7fe19d9a5640 1 --2- 172.21.15.31:0/1956388625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe19814b8e0 0x7fe1981424a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:26.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.130+0000 7fe19d1a4640 1 --2- 172.21.15.31:0/1956388625 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe1980b8bf0 0x7fe1980a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:26.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.130+0000 7fe19c9a3640 1 -- 172.21.15.31:0/1956388625 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe1980b8bf0 msgr2=0x7fe1980a1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:26.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.130+0000 7fe19c9a3640 1 --2- 172.21.15.31:0/1956388625 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe1980b8bf0 0x7fe1980a1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:26.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.130+0000 7fe19c9a3640 1 -- 172.21.15.31:0/1956388625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe19814b8e0 msgr2=0x7fe1981424a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:26.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.130+0000 7fe19c9a3640 1 --2- 172.21.15.31:0/1956388625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe19814b8e0 0x7fe1981424a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:26.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.130+0000 7fe19c9a3640 1 -- 172.21.15.31:0/1956388625 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1981d1980 con 0x7fe1980baef0 2024-04-15T00:21:26.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.130+0000 7fe19c9a3640 1 --2- 172.21.15.31:0/1956388625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1980baef0 0x7fe198141f60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe18c000c00 tx=0x7fe18c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:26.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.131+0000 7fe195ffb640 1 -- 172.21.15.31:0/1956388625 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c035040 con 0x7fe1980baef0 2024-04-15T00:21:26.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.131+0000 7fe195ffb640 1 -- 172.21.15.31:0/1956388625 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe18c03b920 con 0x7fe1980baef0 2024-04-15T00:21:26.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.131+0000 7fe195ffb640 1 -- 172.21.15.31:0/1956388625 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c03bd10 con 0x7fe1980baef0 2024-04-15T00:21:26.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.131+0000 7fe19f408640 1 -- 172.21.15.31:0/1956388625 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe198144760 con 0x7fe1980baef0 2024-04-15T00:21:26.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.131+0000 7fe19f408640 1 -- 172.21.15.31:0/1956388625 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1981d16a0 con 0x7fe1980baef0 2024-04-15T00:21:26.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.132+0000 7fe19f408640 1 -- 172.21.15.31:0/1956388625 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe19804f620 con 0x7fe1980baef0 2024-04-15T00:21:26.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.132+0000 7fe195ffb640 1 -- 172.21.15.31:0/1956388625 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fe18c038020 con 0x7fe1980baef0 2024-04-15T00:21:26.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.133+0000 7fe195ffb640 1 --2- 172.21.15.31:0/1956388625 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe18406b990 0x7fe18406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:26.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.133+0000 7fe195ffb640 1 -- 172.21.15.31:0/1956388625 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe18c0acab0 con 0x7fe1980baef0 2024-04-15T00:21:26.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.133+0000 7fe19d1a4640 1 --2- 172.21.15.31:0/1956388625 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe18406b990 0x7fe18406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:26.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.133+0000 7fe19d1a4640 1 --2- 172.21.15.31:0/1956388625 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe18406b990 0x7fe18406de50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe190007fd0 tx=0x7fe190009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:26.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.138+0000 7fe195ffb640 1 -- 172.21.15.31:0/1956388625 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe18c07adc0 con 0x7fe1980baef0 2024-04-15T00:21:26.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.370+0000 7fe19f408640 1 -- 172.21.15.31:0/1956388625 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fe1980a2450 con 0x7fe1980baef0 2024-04-15T00:21:26.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.373+0000 7fe195ffb640 1 -- 172.21.15.31:0/1956388625 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172373 (secure 0 0 0) 0x7fe18c07ee60 con 0x7fe1980baef0 2024-04-15T00:21:26.382 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:21:26.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.375+0000 7fe19f408640 1 -- 172.21.15.31:0/1956388625 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe18406b990 msgr2=0x7fe18406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:26.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.375+0000 7fe19f408640 1 --2- 172.21.15.31:0/1956388625 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe18406b990 0x7fe18406de50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe190007fd0 tx=0x7fe190009040 comp rx=0 tx=0).stop 2024-04-15T00:21:26.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.375+0000 7fe19f408640 1 -- 172.21.15.31:0/1956388625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1980baef0 msgr2=0x7fe198141f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:26.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.375+0000 7fe19f408640 1 --2- 172.21.15.31:0/1956388625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1980baef0 0x7fe198141f60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe18c000c00 tx=0x7fe18c0046c0 comp rx=0 tx=0).stop 2024-04-15T00:21:26.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.375+0000 7fe19f408640 1 -- 172.21.15.31:0/1956388625 shutdown_connections 2024-04-15T00:21:26.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.375+0000 7fe19f408640 1 --2- 172.21.15.31:0/1956388625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe19814b8e0 0x7fe1981424a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:26.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.375+0000 7fe19f408640 1 --2- 172.21.15.31:0/1956388625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1980baef0 0x7fe198141f60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:26.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.375+0000 7fe19f408640 1 --2- 172.21.15.31:0/1956388625 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe18406b990 0x7fe18406de50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:26.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.375+0000 7fe19f408640 1 --2- 172.21.15.31:0/1956388625 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe1980b8bf0 0x7fe1980a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:26.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.375+0000 7fe19f408640 1 -- 172.21.15.31:0/1956388625 >> 172.21.15.31:0/1956388625 conn(0x7fe19809ed70 msgr2=0x7fe198148830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:26.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.375+0000 7fe19f408640 1 -- 172.21.15.31:0/1956388625 shutdown_connections 2024-04-15T00:21:26.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.375+0000 7fe19f408640 1 -- 172.21.15.31:0/1956388625 wait complete. 2024-04-15T00:21:26.393 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":915470279},{"type":"v1","addr":"172.21.15.31:6833","nonce":915470279}]},"active_addr":"172.21.15.31:6833/915470279","active_change":"2024-04-15T00:20:48.381822+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4102,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":3447079077}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":3330576278}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":648122023}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":1242183301}]}]} 2024-04-15T00:21:26.396 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-15T00:21:26.396 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-15T00:21:26.396 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:21:26.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.492+0000 7f759e799640 1 Processor -- start 2024-04-15T00:21:26.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.492+0000 7f759e799640 1 -- start start 2024-04-15T00:21:26.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.492+0000 7f759e799640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75980b0590 0x7f75980b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:26.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.492+0000 7f759e799640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f759806c020 con 0x7f7598067180 2024-04-15T00:21:26.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.492+0000 7f759e799640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7598067560 con 0x7f75980af930 2024-04-15T00:21:26.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.492+0000 7f759e799640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f75980afdc0 con 0x7f75980b0590 2024-04-15T00:21:26.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.492+0000 7f7597fff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7598067180 0x7f759806b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:39342/0 (socket says 172.21.15.31:39342) 2024-04-15T00:21:26.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.493+0000 7f7597fff640 1 -- 172.21.15.31:0/1966356459 learned_addr learned my addr 172.21.15.31:0/1966356459 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:26.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.493+0000 7f75977fe640 1 --2- 172.21.15.31:0/1966356459 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75980b0590 0x7f75980b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:26.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.493+0000 7f7596ffd640 1 -- 172.21.15.31:0/1966356459 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1399224955 0 0) 0x7f759806c020 con 0x7f7598067180 2024-04-15T00:21:26.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.493+0000 7f7596ffd640 1 -- 172.21.15.31:0/1966356459 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7580003520 con 0x7f7598067180 2024-04-15T00:21:26.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.493+0000 7f7596ffd640 1 -- 172.21.15.31:0/1966356459 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3368656043 0 0) 0x7f7598067560 con 0x7f75980af930 2024-04-15T00:21:26.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.493+0000 7f7596ffd640 1 -- 172.21.15.31:0/1966356459 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f759806c020 con 0x7f75980af930 2024-04-15T00:21:26.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.493+0000 7f75977fe640 1 -- 172.21.15.31:0/1966356459 >> v1:172.21.15.50:6789/0 conn(0x7f75980af930 legacy=0x7f759806b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:26.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.493+0000 7f75977fe640 1 -- 172.21.15.31:0/1966356459 >> v1:172.21.15.31:6789/0 conn(0x7f7598067180 legacy=0x7f759806b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:26.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.493+0000 7f75977fe640 1 -- 172.21.15.31:0/1966356459 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f759809f250 con 0x7f75980b0590 2024-04-15T00:21:26.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.494+0000 7f75977fe640 1 --2- 172.21.15.31:0/1966356459 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75980b0590 0x7f75980b4c20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f758c0097d0 tx=0x7f758c02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=680ebf2e20198047 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:26.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.494+0000 7f7596ffd640 1 -- 172.21.15.31:0/1966356459 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c035020 con 0x7f75980b0590 2024-04-15T00:21:26.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.494+0000 7f7596ffd640 1 -- 172.21.15.31:0/1966356459 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f758c031800 con 0x7f75980b0590 2024-04-15T00:21:26.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.494+0000 7f7596ffd640 1 -- 172.21.15.31:0/1966356459 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c031bb0 con 0x7f75980b0590 2024-04-15T00:21:26.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.494+0000 7f759e799640 1 -- 172.21.15.31:0/1966356459 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75980b0590 msgr2=0x7f75980b4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:26.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.494+0000 7f759e799640 1 --2- 172.21.15.31:0/1966356459 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75980b0590 0x7f75980b4c20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f758c0097d0 tx=0x7f758c02b8a0 comp rx=0 tx=0).stop 2024-04-15T00:21:26.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.494+0000 7f759e799640 1 -- 172.21.15.31:0/1966356459 shutdown_connections 2024-04-15T00:21:26.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.494+0000 7f759e799640 1 --2- 172.21.15.31:0/1966356459 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75980b0590 0x7f75980b4c20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:26.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.494+0000 7f759e799640 1 -- 172.21.15.31:0/1966356459 >> 172.21.15.31:0/1966356459 conn(0x7f75980b6640 msgr2=0x7f75980b6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:26.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.494+0000 7f759e799640 1 -- 172.21.15.31:0/1966356459 shutdown_connections 2024-04-15T00:21:26.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.494+0000 7f759e799640 1 -- 172.21.15.31:0/1966356459 wait complete. 2024-04-15T00:21:26.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.495+0000 7f759e799640 1 Processor -- start 2024-04-15T00:21:26.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.496+0000 7f759e799640 1 -- start start 2024-04-15T00:21:26.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.496+0000 7f759e799640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7598067180 0x7f7598146bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:26.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.496+0000 7f759e799640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75980af930 0x7f75980b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:26.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.496+0000 7f759e799640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75980b0590 0x7f75980b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:26.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.496+0000 7f759e799640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f75980b5a60 con 0x7f7598067180 2024-04-15T00:21:26.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.496+0000 7f759e799640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f75980af1d0 con 0x7f75980b0590 2024-04-15T00:21:26.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.496+0000 7f759e799640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f75980b5be0 con 0x7f75980af930 2024-04-15T00:21:26.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.496+0000 7f7597fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7598067180 0x7f7598146bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:26.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.496+0000 7f7597fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7598067180 0x7f7598146bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51660/0 (socket says 172.21.15.31:51660) 2024-04-15T00:21:26.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.496+0000 7f7597fff640 1 -- 172.21.15.31:0/1997396999 learned_addr learned my addr 172.21.15.31:0/1997396999 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:26.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.497+0000 7f759cd36640 1 --2- 172.21.15.31:0/1997396999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75980b0590 0x7f75980b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:26.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.497+0000 7f75977fe640 1 --2- 172.21.15.31:0/1997396999 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75980af930 0x7f75980b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:26.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.497+0000 7f7597fff640 1 -- 172.21.15.31:0/1997396999 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75980af930 msgr2=0x7f75980b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:26.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.497+0000 7f7597fff640 1 --2- 172.21.15.31:0/1997396999 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75980af930 0x7f75980b3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:26.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.497+0000 7f7597fff640 1 -- 172.21.15.31:0/1997396999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75980b0590 msgr2=0x7f75980b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:26.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.497+0000 7f7597fff640 1 --2- 172.21.15.31:0/1997396999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75980b0590 0x7f75980b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:26.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.497+0000 7f7597fff640 1 -- 172.21.15.31:0/1997396999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75981cf800 con 0x7f7598067180 2024-04-15T00:21:26.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.497+0000 7f759cd36640 1 --2- 172.21.15.31:0/1997396999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75980b0590 0x7f75980b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:21:26.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.497+0000 7f75977fe640 1 --2- 172.21.15.31:0/1997396999 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75980af930 0x7f75980b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:21:26.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.497+0000 7f7597fff640 1 --2- 172.21.15.31:0/1997396999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7598067180 0x7f7598146bc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f758800c4d0 tx=0x7f758800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:26.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.497+0000 7f7594ff9640 1 -- 172.21.15.31:0/1997396999 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7588017070 con 0x7f7598067180 2024-04-15T00:21:26.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.497+0000 7f7594ff9640 1 -- 172.21.15.31:0/1997396999 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7588005ce0 con 0x7f7598067180 2024-04-15T00:21:26.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.497+0000 7f759e799640 1 -- 172.21.15.31:0/1997396999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75981cf520 con 0x7f7598067180 2024-04-15T00:21:26.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.497+0000 7f7594ff9640 1 -- 172.21.15.31:0/1997396999 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7588007270 con 0x7f7598067180 2024-04-15T00:21:26.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.497+0000 7f759e799640 1 -- 172.21.15.31:0/1997396999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75981ce1a0 con 0x7f7598067180 2024-04-15T00:21:26.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.498+0000 7f759e799640 1 -- 172.21.15.31:0/1997396999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75980b3040 con 0x7f7598067180 2024-04-15T00:21:26.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.498+0000 7f7594ff9640 1 -- 172.21.15.31:0/1997396999 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f758801a070 con 0x7f7598067180 2024-04-15T00:21:26.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.499+0000 7f7594ff9640 1 --2- 172.21.15.31:0/1997396999 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f758406b9c0 0x7f758406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:26.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.499+0000 7f75977fe640 1 --2- 172.21.15.31:0/1997396999 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f758406b9c0 0x7f758406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:26.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.499+0000 7f7594ff9640 1 -- 172.21.15.31:0/1997396999 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7588089d60 con 0x7f7598067180 2024-04-15T00:21:26.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.499+0000 7f75977fe640 1 --2- 172.21.15.31:0/1997396999 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f758406b9c0 0x7f758406de80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f758c036000 tx=0x7f758c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:26.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.503+0000 7f7594ff9640 1 -- 172.21.15.31:0/1997396999 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f75981cf800 con 0x7f7598067180 2024-04-15T00:21:26.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.687+0000 7f759e799640 1 -- 172.21.15.31:0/1997396999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f759809f7c0 con 0x7f7598067180 2024-04-15T00:21:26.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.688+0000 7f7594ff9640 1 -- 172.21.15.31:0/1997396999 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7f7588058070 con 0x7f7598067180 2024-04-15T00:21:26.695 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:21:26.695 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"fsid":"b57c03ab-2810-4ea5-b233-6164468328c0","created":"2024-04-15T00:20:44.073217+0000","modified":"2024-04-15T00:21:12.971956+0000","last_up_change":"2024-04-15T00:20:55.515596+0000","last_in_change":"2024-04-15T00:20:46.364541+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:20:56.423161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:21:06.436169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:21:06.888505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:21:10.610300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b085a2f4-5565-4ccc-a98e-e56180791550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6817","nonce":2355720818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6819","nonce":2355720818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6823","nonce":2355720818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6821","nonce":2355720818}]},"public_addr":"172.21.15.31:6817/2355720818","cluster_addr":"172.21.15.31:6819/2355720818","heartbeat_back_addr":"172.21.15.31:6823/2355720818","heartbeat_front_addr":"172.21.15.31:6821/2355720818","state":["exists","up"]},{"osd":1,"uuid":"0f751557-3f18-464f-8b78-614d19549f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6809","nonce":2705297130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6811","nonce":2705297130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6815","nonce":2705297130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6813","nonce":2705297130}]},"public_addr":"172.21.15.31:6809/2705297130","cluster_addr":"172.21.15.31:6811/2705297130","heartbeat_back_addr":"172.21.15.31:6815/2705297130","heartbeat_front_addr":"172.21.15.31:6813/2705297130","state":["exists","up"]},{"osd":2,"uuid":"17371b09-2bd7-4ef7-926f-e7706319f064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6801","nonce":225061474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6803","nonce":225061474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6807","nonce":225061474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6805","nonce":225061474}]},"public_addr":"172.21.15.31:6801/225061474","cluster_addr":"172.21.15.31:6803/225061474","heartbeat_back_addr":"172.21.15.31:6807/225061474","heartbeat_front_addr":"172.21.15.31:6805/225061474","state":["exists","up"]},{"osd":3,"uuid":"315b6949-f009-4291-9581-aa4912642dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6825","nonce":3722449780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6827","nonce":3722449780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6831","nonce":3722449780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6829","nonce":3722449780}]},"public_addr":"172.21.15.31:6825/3722449780","cluster_addr":"172.21.15.31:6827/3722449780","heartbeat_back_addr":"172.21.15.31:6831/3722449780","heartbeat_front_addr":"172.21.15.31:6829/3722449780","state":["exists","up"]},{"osd":4,"uuid":"e3659369-cc78-4aa8-bd10-a199d4a1569d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6801","nonce":1279970071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6803","nonce":1279970071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6807","nonce":1279970071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6805","nonce":1279970071}]},"public_addr":"172.21.15.50:6801/1279970071","cluster_addr":"172.21.15.50:6803/1279970071","heartbeat_back_addr":"172.21.15.50:6807/1279970071","heartbeat_front_addr":"172.21.15.50:6805/1279970071","state":["exists","up"]},{"osd":5,"uuid":"35c3a4c0-0b45-45d2-85b9-301c347602f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6809","nonce":1589417182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6811","nonce":1589417182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6815","nonce":1589417182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6813","nonce":1589417182}]},"public_addr":"172.21.15.50:6809/1589417182","cluster_addr":"172.21.15.50:6811/1589417182","heartbeat_back_addr":"172.21.15.50:6815/1589417182","heartbeat_front_addr":"172.21.15.50:6813/1589417182","state":["exists","up"]},{"osd":6,"uuid":"20df7a76-245f-4946-9624-6ca9e949227b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6817","nonce":682288274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6819","nonce":682288274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6823","nonce":682288274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6821","nonce":682288274}]},"public_addr":"172.21.15.50:6817/682288274","cluster_addr":"172.21.15.50:6819/682288274","heartbeat_back_addr":"172.21.15.50:6823/682288274","heartbeat_front_addr":"172.21.15.50:6821/682288274","state":["exists","up"]},{"osd":7,"uuid":"95a504b7-e13a-49e6-8484-9dff4d5fc048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6825","nonce":4129060906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6827","nonce":4129060906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6831","nonce":4129060906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6829","nonce":4129060906}]},"public_addr":"172.21.15.50:6825/4129060906","cluster_addr":"172.21.15.50:6827/4129060906","heartbeat_back_addr":"172.21.15.50:6831/4129060906","heartbeat_front_addr":"172.21.15.50:6829/4129060906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.501980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.529961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.540913+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.521396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.448364+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.514136+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.527229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.508950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:21:26.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.690+0000 7f759e799640 1 -- 172.21.15.31:0/1997396999 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f758406b9c0 msgr2=0x7f758406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:26.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.690+0000 7f759e799640 1 --2- 172.21.15.31:0/1997396999 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f758406b9c0 0x7f758406de80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f758c036000 tx=0x7f758c008030 comp rx=0 tx=0).stop 2024-04-15T00:21:26.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.690+0000 7f759e799640 1 -- 172.21.15.31:0/1997396999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7598067180 msgr2=0x7f7598146bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:26.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.690+0000 7f759e799640 1 --2- 172.21.15.31:0/1997396999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7598067180 0x7f7598146bc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f758800c4d0 tx=0x7f758800c990 comp rx=0 tx=0).stop 2024-04-15T00:21:26.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.690+0000 7f759e799640 1 -- 172.21.15.31:0/1997396999 shutdown_connections 2024-04-15T00:21:26.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.690+0000 7f759e799640 1 --2- 172.21.15.31:0/1997396999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75980b0590 0x7f75980b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:26.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.690+0000 7f759e799640 1 --2- 172.21.15.31:0/1997396999 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f758406b9c0 0x7f758406de80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:26.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.690+0000 7f759e799640 1 --2- 172.21.15.31:0/1997396999 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f75980af930 0x7f75980b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:26.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.690+0000 7f759e799640 1 --2- 172.21.15.31:0/1997396999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7598067180 0x7f7598146bc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:26.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.690+0000 7f759e799640 1 -- 172.21.15.31:0/1997396999 >> 172.21.15.31:0/1997396999 conn(0x7f75980b6640 msgr2=0x7f75981d3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:26.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.690+0000 7f759e799640 1 -- 172.21.15.31:0/1997396999 shutdown_connections 2024-04-15T00:21:26.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.690+0000 7f759e799640 1 -- 172.21.15.31:0/1997396999 wait complete. 2024-04-15T00:21:26.707 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-15T00:21:26.707 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:21:26.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.802+0000 7f0a3d284640 1 Processor -- start 2024-04-15T00:21:26.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.802+0000 7f0a3d284640 1 -- start start 2024-04-15T00:21:26.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.802+0000 7f0a3d284640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0a3814b390 0x7f0a3814b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:26.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.802+0000 7f0a3d284640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0a3814ffb0 0x7f0a381523a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:26.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.802+0000 7f0a3d284640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a3806b830 con 0x7f0a380b63c0 2024-04-15T00:21:26.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.802+0000 7f0a3d284640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f0a3806c210 con 0x7f0a3814b390 2024-04-15T00:21:26.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.802+0000 7f0a3d284640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f0a38141e60 con 0x7f0a3814ffb0 2024-04-15T00:21:26.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.803+0000 7f0a36ffd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f0a380b63c0 0x7f0a3806c680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:39356/0 (socket says 172.21.15.31:39356) 2024-04-15T00:21:26.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.803+0000 7f0a36ffd640 1 -- 172.21.15.31:0/2891551474 learned_addr learned my addr 172.21.15.31:0/2891551474 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:26.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.803+0000 7f0a35ffb640 1 -- 172.21.15.31:0/2891551474 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 398008310 0 0) 0x7f0a3806b830 con 0x7f0a380b63c0 2024-04-15T00:21:26.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.803+0000 7f0a377fe640 1 --2- 172.21.15.31:0/2891551474 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0a3814ffb0 0x7f0a381523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:26.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.803+0000 7f0a367fc640 1 --2- 172.21.15.31:0/2891551474 >> v2:172.21.15.50:3300/0 conn(0x7f0a3814b390 0x7f0a3814b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:26.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.803+0000 7f0a35ffb640 1 -- 172.21.15.31:0/2891551474 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a20003520 con 0x7f0a380b63c0 2024-04-15T00:21:26.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.803+0000 7f0a35ffb640 1 -- 172.21.15.31:0/2891551474 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3430619846 0 0) 0x7f0a20003520 con 0x7f0a380b63c0 2024-04-15T00:21:26.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.803+0000 7f0a35ffb640 1 -- 172.21.15.31:0/2891551474 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0a3814ffb0 msgr2=0x7f0a381523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:26.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.803+0000 7f0a35ffb640 1 --2- 172.21.15.31:0/2891551474 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0a3814ffb0 0x7f0a381523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:26.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.803+0000 7f0a35ffb640 1 -- 172.21.15.31:0/2891551474 >> v2:172.21.15.50:3300/0 conn(0x7f0a3814b390 msgr2=0x7f0a3814b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:26.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.803+0000 7f0a35ffb640 1 --2- 172.21.15.31:0/2891551474 >> v2:172.21.15.50:3300/0 conn(0x7f0a3814b390 0x7f0a3814b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:26.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.803+0000 7f0a35ffb640 1 -- 172.21.15.31:0/2891551474 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a380b67a0 con 0x7f0a380b63c0 2024-04-15T00:21:26.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.803+0000 7f0a35ffb640 1 -- 172.21.15.31:0/2891551474 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 697057150 0 0) 0x7f0a28001670 con 0x7f0a380b63c0 2024-04-15T00:21:26.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.803+0000 7f0a35ffb640 1 -- 172.21.15.31:0/2891551474 >> v1:172.21.15.31:6789/0 conn(0x7f0a380b63c0 legacy=0x7f0a3806c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:26.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.803+0000 7f0a35ffb640 1 --2- 172.21.15.31:0/2891551474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a200039b0 0x7f0a20003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:26.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.803+0000 7f0a35ffb640 1 --2- 172.21.15.31:0/2891551474 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0a3814ffb0 0x7f0a20004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:26.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.803+0000 7f0a35ffb640 1 --2- 172.21.15.31:0/2891551474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a20004d40 0x7f0a200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:26.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.803+0000 7f0a35ffb640 1 -- 172.21.15.31:0/2891551474 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0a38141e60 con 0x7f0a20004d40 2024-04-15T00:21:26.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.803+0000 7f0a35ffb640 1 -- 172.21.15.31:0/2891551474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2000b9c0 con 0x7f0a200039b0 2024-04-15T00:21:26.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.803+0000 7f0a35ffb640 1 -- 172.21.15.31:0/2891551474 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f0a2000bb40 con 0x7f0a3814ffb0 2024-04-15T00:21:26.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.803+0000 7f0a36ffd640 1 --2- 172.21.15.31:0/2891551474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a200039b0 0x7f0a20003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:26.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.803+0000 7f0a377fe640 1 --2- 172.21.15.31:0/2891551474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a20004d40 0x7f0a200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:26.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.803+0000 7f0a367fc640 1 --2- 172.21.15.31:0/2891551474 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0a3814ffb0 0x7f0a20004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:26.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.804+0000 7f0a377fe640 1 -- 172.21.15.31:0/2891551474 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0a3814ffb0 msgr2=0x7f0a20004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:26.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.804+0000 7f0a377fe640 1 --2- 172.21.15.31:0/2891551474 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0a3814ffb0 0x7f0a20004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:26.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.804+0000 7f0a377fe640 1 -- 172.21.15.31:0/2891551474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a200039b0 msgr2=0x7f0a20003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:26.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.804+0000 7f0a377fe640 1 --2- 172.21.15.31:0/2891551474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a200039b0 0x7f0a20003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:26.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.804+0000 7f0a377fe640 1 -- 172.21.15.31:0/2891551474 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a20003520 con 0x7f0a20004d40 2024-04-15T00:21:26.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.804+0000 7f0a377fe640 1 --2- 172.21.15.31:0/2891551474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a20004d40 0x7f0a200051c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0a38070220 tx=0x7f0a20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac5ce3cf5ba4587 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:26.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.805+0000 7f0a35ffb640 1 -- 172.21.15.31:0/2891551474 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a30039070 con 0x7f0a20004d40 2024-04-15T00:21:26.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.805+0000 7f0a35ffb640 1 -- 172.21.15.31:0/2891551474 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a3002cb50 con 0x7f0a20004d40 2024-04-15T00:21:26.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.805+0000 7f0a35ffb640 1 -- 172.21.15.31:0/2891551474 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a30009c10 con 0x7f0a20004d40 2024-04-15T00:21:26.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.805+0000 7f0a3d284640 1 -- 172.21.15.31:0/2891551474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a20004d40 msgr2=0x7f0a200051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:26.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.805+0000 7f0a3d284640 1 --2- 172.21.15.31:0/2891551474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a20004d40 0x7f0a200051c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0a38070220 tx=0x7f0a20005830 comp rx=0 tx=0).stop 2024-04-15T00:21:26.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.805+0000 7f0a377fe640 1 -- 172.21.15.31:0/2891551474 reap_dead start 2024-04-15T00:21:26.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.805+0000 7f0a3d284640 1 -- 172.21.15.31:0/2891551474 shutdown_connections 2024-04-15T00:21:26.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.805+0000 7f0a3d284640 1 -- 172.21.15.31:0/2891551474 >> 172.21.15.31:0/2891551474 conn(0x7f0a380b77b0 msgr2=0x7f0a380b7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:26.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.805+0000 7f0a3d284640 1 -- 172.21.15.31:0/2891551474 shutdown_connections 2024-04-15T00:21:26.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.805+0000 7f0a3d284640 1 -- 172.21.15.31:0/2891551474 wait complete. 2024-04-15T00:21:26.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.806+0000 7f0a3d284640 1 Processor -- start 2024-04-15T00:21:26.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.806+0000 7f0a3d284640 1 -- start start 2024-04-15T00:21:26.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.807+0000 7f0a3d284640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a20004d40 0x7f0a38147ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:26.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.807+0000 7f0a3d284640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3813dd20 0x7f0a381e02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:26.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.807+0000 7f0a3d284640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0a381e0800 0x7f0a3813aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:26.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.807+0000 7f0a3d284640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0a380b5a20 con 0x7f0a20004d40 2024-04-15T00:21:26.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.807+0000 7f0a3d284640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3806baa0 con 0x7f0a3813dd20 2024-04-15T00:21:26.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.807+0000 7f0a3d284640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f0a380b5d00 con 0x7f0a381e0800 2024-04-15T00:21:26.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.807+0000 7f0a36ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a20004d40 0x7f0a38147ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:26.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.807+0000 7f0a36ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a20004d40 0x7f0a38147ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51666/0 (socket says 172.21.15.31:51666) 2024-04-15T00:21:26.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.807+0000 7f0a36ffd640 1 -- 172.21.15.31:0/4098891730 learned_addr learned my addr 172.21.15.31:0/4098891730 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:26.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.807+0000 7f0a367fc640 1 --2- 172.21.15.31:0/4098891730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3813dd20 0x7f0a381e02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:26.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.807+0000 7f0a377fe640 1 --2- 172.21.15.31:0/4098891730 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0a381e0800 0x7f0a3813aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:26.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.807+0000 7f0a36ffd640 1 -- 172.21.15.31:0/4098891730 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0a381e0800 msgr2=0x7f0a3813aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:26.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.807+0000 7f0a36ffd640 1 --2- 172.21.15.31:0/4098891730 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0a381e0800 0x7f0a3813aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:26.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.807+0000 7f0a36ffd640 1 -- 172.21.15.31:0/4098891730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3813dd20 msgr2=0x7f0a381e02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:26.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.807+0000 7f0a36ffd640 1 --2- 172.21.15.31:0/4098891730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3813dd20 0x7f0a381e02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:26.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.807+0000 7f0a36ffd640 1 -- 172.21.15.31:0/4098891730 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a3813fa80 con 0x7f0a20004d40 2024-04-15T00:21:26.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.807+0000 7f0a367fc640 1 --2- 172.21.15.31:0/4098891730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3813dd20 0x7f0a381e02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:26.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.807+0000 7f0a36ffd640 1 --2- 172.21.15.31:0/4098891730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a20004d40 0x7f0a38147ca0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0a28007310 tx=0x7f0a280077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:26.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.808+0000 7f0a1f7fe640 1 -- 172.21.15.31:0/4098891730 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2800f9c0 con 0x7f0a20004d40 2024-04-15T00:21:26.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.808+0000 7f0a1f7fe640 1 -- 172.21.15.31:0/4098891730 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a28018070 con 0x7f0a20004d40 2024-04-15T00:21:26.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.808+0000 7f0a3d284640 1 -- 172.21.15.31:0/4098891730 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a3813d890 con 0x7f0a20004d40 2024-04-15T00:21:26.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.808+0000 7f0a1f7fe640 1 -- 172.21.15.31:0/4098891730 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2800fd80 con 0x7f0a20004d40 2024-04-15T00:21:26.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.808+0000 7f0a3d284640 1 -- 172.21.15.31:0/4098891730 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a3813d5b0 con 0x7f0a20004d40 2024-04-15T00:21:26.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.809+0000 7f0a3d284640 1 -- 172.21.15.31:0/4098891730 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a3806b4e0 con 0x7f0a20004d40 2024-04-15T00:21:26.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.809+0000 7f0a1f7fe640 1 -- 172.21.15.31:0/4098891730 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f0a2801d460 con 0x7f0a20004d40 2024-04-15T00:21:26.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.810+0000 7f0a1f7fe640 1 --2- 172.21.15.31:0/4098891730 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f0a2406b990 0x7f0a2406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:26.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.810+0000 7f0a1f7fe640 1 -- 172.21.15.31:0/4098891730 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0a2808ac40 con 0x7f0a20004d40 2024-04-15T00:21:26.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.810+0000 7f0a367fc640 1 --2- 172.21.15.31:0/4098891730 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f0a2406b990 0x7f0a2406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:26.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.810+0000 7f0a367fc640 1 --2- 172.21.15.31:0/4098891730 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f0a2406b990 0x7f0a2406de50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0a3813e100 tx=0x7f0a2c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:26.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.814+0000 7f0a1f7fe640 1 -- 172.21.15.31:0/4098891730 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0a280595a0 con 0x7f0a20004d40 2024-04-15T00:21:27.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.997+0000 7f0a3d284640 1 -- 172.21.15.31:0/4098891730 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0a38142160 con 0x7f0a20004d40 2024-04-15T00:21:27.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:26.998+0000 7f0a1f7fe640 1 -- 172.21.15.31:0/4098891730 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7f0a28058ea0 con 0x7f0a20004d40 2024-04-15T00:21:27.005 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:21:27.005 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"fsid":"b57c03ab-2810-4ea5-b233-6164468328c0","created":"2024-04-15T00:20:44.073217+0000","modified":"2024-04-15T00:21:12.971956+0000","last_up_change":"2024-04-15T00:20:55.515596+0000","last_in_change":"2024-04-15T00:20:46.364541+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:20:56.423161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:21:06.436169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:21:06.888505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:21:10.610300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b085a2f4-5565-4ccc-a98e-e56180791550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6817","nonce":2355720818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6819","nonce":2355720818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6823","nonce":2355720818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6821","nonce":2355720818}]},"public_addr":"172.21.15.31:6817/2355720818","cluster_addr":"172.21.15.31:6819/2355720818","heartbeat_back_addr":"172.21.15.31:6823/2355720818","heartbeat_front_addr":"172.21.15.31:6821/2355720818","state":["exists","up"]},{"osd":1,"uuid":"0f751557-3f18-464f-8b78-614d19549f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6809","nonce":2705297130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6811","nonce":2705297130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6815","nonce":2705297130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6813","nonce":2705297130}]},"public_addr":"172.21.15.31:6809/2705297130","cluster_addr":"172.21.15.31:6811/2705297130","heartbeat_back_addr":"172.21.15.31:6815/2705297130","heartbeat_front_addr":"172.21.15.31:6813/2705297130","state":["exists","up"]},{"osd":2,"uuid":"17371b09-2bd7-4ef7-926f-e7706319f064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6801","nonce":225061474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6803","nonce":225061474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6807","nonce":225061474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6805","nonce":225061474}]},"public_addr":"172.21.15.31:6801/225061474","cluster_addr":"172.21.15.31:6803/225061474","heartbeat_back_addr":"172.21.15.31:6807/225061474","heartbeat_front_addr":"172.21.15.31:6805/225061474","state":["exists","up"]},{"osd":3,"uuid":"315b6949-f009-4291-9581-aa4912642dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6825","nonce":3722449780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6827","nonce":3722449780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6831","nonce":3722449780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6829","nonce":3722449780}]},"public_addr":"172.21.15.31:6825/3722449780","cluster_addr":"172.21.15.31:6827/3722449780","heartbeat_back_addr":"172.21.15.31:6831/3722449780","heartbeat_front_addr":"172.21.15.31:6829/3722449780","state":["exists","up"]},{"osd":4,"uuid":"e3659369-cc78-4aa8-bd10-a199d4a1569d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6801","nonce":1279970071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6803","nonce":1279970071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6807","nonce":1279970071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6805","nonce":1279970071}]},"public_addr":"172.21.15.50:6801/1279970071","cluster_addr":"172.21.15.50:6803/1279970071","heartbeat_back_addr":"172.21.15.50:6807/1279970071","heartbeat_front_addr":"172.21.15.50:6805/1279970071","state":["exists","up"]},{"osd":5,"uuid":"35c3a4c0-0b45-45d2-85b9-301c347602f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6809","nonce":1589417182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6811","nonce":1589417182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6815","nonce":1589417182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6813","nonce":1589417182}]},"public_addr":"172.21.15.50:6809/1589417182","cluster_addr":"172.21.15.50:6811/1589417182","heartbeat_back_addr":"172.21.15.50:6815/1589417182","heartbeat_front_addr":"172.21.15.50:6813/1589417182","state":["exists","up"]},{"osd":6,"uuid":"20df7a76-245f-4946-9624-6ca9e949227b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6817","nonce":682288274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6819","nonce":682288274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6823","nonce":682288274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6821","nonce":682288274}]},"public_addr":"172.21.15.50:6817/682288274","cluster_addr":"172.21.15.50:6819/682288274","heartbeat_back_addr":"172.21.15.50:6823/682288274","heartbeat_front_addr":"172.21.15.50:6821/682288274","state":["exists","up"]},{"osd":7,"uuid":"95a504b7-e13a-49e6-8484-9dff4d5fc048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6825","nonce":4129060906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6827","nonce":4129060906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6831","nonce":4129060906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6829","nonce":4129060906}]},"public_addr":"172.21.15.50:6825/4129060906","cluster_addr":"172.21.15.50:6827/4129060906","heartbeat_back_addr":"172.21.15.50:6831/4129060906","heartbeat_front_addr":"172.21.15.50:6829/4129060906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.501980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.529961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.540913+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.521396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.448364+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.514136+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.527229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.508950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:21:27.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.001+0000 7f0a3d284640 1 -- 172.21.15.31:0/4098891730 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f0a2406b990 msgr2=0x7f0a2406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.001+0000 7f0a3d284640 1 --2- 172.21.15.31:0/4098891730 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f0a2406b990 0x7f0a2406de50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0a3813e100 tx=0x7f0a2c008040 comp rx=0 tx=0).stop 2024-04-15T00:21:27.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.001+0000 7f0a3d284640 1 -- 172.21.15.31:0/4098891730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a20004d40 msgr2=0x7f0a38147ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.001+0000 7f0a3d284640 1 --2- 172.21.15.31:0/4098891730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a20004d40 0x7f0a38147ca0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0a28007310 tx=0x7f0a280077d0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.001+0000 7f0a3d284640 1 -- 172.21.15.31:0/4098891730 shutdown_connections 2024-04-15T00:21:27.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.001+0000 7f0a3d284640 1 --2- 172.21.15.31:0/4098891730 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f0a2406b990 0x7f0a2406de50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.001+0000 7f0a3d284640 1 --2- 172.21.15.31:0/4098891730 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0a381e0800 0x7f0a3813aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.001+0000 7f0a3d284640 1 --2- 172.21.15.31:0/4098891730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3813dd20 0x7f0a381e02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.001+0000 7f0a3d284640 1 --2- 172.21.15.31:0/4098891730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a20004d40 0x7f0a38147ca0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.001+0000 7f0a3d284640 1 -- 172.21.15.31:0/4098891730 >> 172.21.15.31:0/4098891730 conn(0x7f0a380b77b0 msgr2=0x7f0a380b9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.001+0000 7f0a3d284640 1 -- 172.21.15.31:0/4098891730 shutdown_connections 2024-04-15T00:21:27.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.001+0000 7f0a3d284640 1 -- 172.21.15.31:0/4098891730 wait complete. 2024-04-15T00:21:27.018 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-15T00:21:27.018 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-15T00:21:27.019 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-15T00:21:27.019 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-15T00:21:27.019 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-15T00:21:27.020 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-15T00:21:27.020 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-15T00:21:27.020 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-15T00:21:27.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.185+0000 7f7c648dd640 1 Processor -- start 2024-04-15T00:21:27.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.185+0000 7f7c648dd640 1 -- start start 2024-04-15T00:21:27.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.186+0000 7fd3911fe640 1 Processor -- start 2024-04-15T00:21:27.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.186+0000 7f7c648dd640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7c6014fbb0 0x7f7c60157700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.186+0000 7f7c648dd640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c600afbf0 con 0x7f7c600aebf0 2024-04-15T00:21:27.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.186+0000 7f7c648dd640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c600ae360 con 0x7f7c600adf80 2024-04-15T00:21:27.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.186+0000 7f7c648dd640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f7c600af9c0 con 0x7f7c6014fbb0 2024-04-15T00:21:27.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.186+0000 7f7c5e59c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7c600aebf0 0x7f7c6006cf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:39372/0 (socket says 172.21.15.31:39372) 2024-04-15T00:21:27.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.186+0000 7f7c5e59c640 1 -- 172.21.15.31:0/4241780005 learned_addr learned my addr 172.21.15.31:0/4241780005 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:27.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.186+0000 7f7c5f59e640 1 --2- 172.21.15.31:0/4241780005 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7c6014fbb0 0x7f7c60157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.186+0000 7fd3911fe640 1 -- start start 2024-04-15T00:21:27.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.187+0000 7f7c5f59e640 1 -- 172.21.15.31:0/4241780005 >> v1:172.21.15.50:6789/0 conn(0x7f7c600adf80 legacy=0x7f7c6014f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.187+0000 7f7c5f59e640 1 -- 172.21.15.31:0/4241780005 >> v1:172.21.15.31:6789/0 conn(0x7f7c600aebf0 legacy=0x7f7c6006cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.187+0000 7f7c5f59e640 1 -- 172.21.15.31:0/4241780005 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c600af250 con 0x7f7c6014fbb0 2024-04-15T00:21:27.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.186+0000 7fc16a5ad640 1 Processor -- start 2024-04-15T00:21:27.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.187+0000 7fc2e482c640 1 Processor -- start 2024-04-15T00:21:27.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.187+0000 7fc2e482c640 1 -- start start 2024-04-15T00:21:27.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.187+0000 7fac4f055640 1 Processor -- start 2024-04-15T00:21:27.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.187+0000 7fac4f055640 1 -- start start 2024-04-15T00:21:27.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.187+0000 7fc16a5ad640 1 -- start start 2024-04-15T00:21:27.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.187+0000 7fd3911fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd38c0b0080 0x7fd38c06c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.187+0000 7fd3911fe640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd38c146d90 con 0x7fd38c0b6080 2024-04-15T00:21:27.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.187+0000 7fd3911fe640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd38c0b05d0 con 0x7fd38c147980 2024-04-15T00:21:27.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.187+0000 7fd3911fe640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fd38c0b4f70 con 0x7fd38c0b0080 2024-04-15T00:21:27.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.187+0000 7feca4f1e640 1 Processor -- start 2024-04-15T00:21:27.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.187+0000 7feca4f1e640 1 -- start start 2024-04-15T00:21:27.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.188+0000 7fce9cfd4640 1 Processor -- start 2024-04-15T00:21:27.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.188+0000 7fc16a5ad640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc15c0064d0 0x7fc15c031540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.188+0000 7fc16a5ad640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc15c01b8a0 0x7fc15c0db480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.188+0000 7fc16a5ad640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc15c0068b0 con 0x7fc15c039ea0 2024-04-15T00:21:27.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.188+0000 7fc16a5ad640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fc15c01cce0 con 0x7fc15c01b8a0 2024-04-15T00:21:27.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.188+0000 7fc16a5ad640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc15c01cf30 con 0x7fc15c0064d0 2024-04-15T00:21:27.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.188+0000 7fd38ad9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd38c0b0080 0x7fd38c06c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.188+0000 7fd38ad9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd38c0b0080 0x7fd38c06c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.31:37540/0 (socket says 172.21.15.31:37540) 2024-04-15T00:21:27.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.188+0000 7fd38ad9d640 1 -- 172.21.15.31:0/3474825678 learned_addr learned my addr 172.21.15.31:0/3474825678 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:27.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.188+0000 7fc169dac640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc15c01b8a0 0x7fc15c0db480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.188+0000 7fc2e482c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc2d8036b70 0x7fc2d8036510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.188+0000 7fc2e482c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc2d80c8590 0x7fc2d80c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.188+0000 7fc2e482c640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2d8029f60 con 0x7fc2d8036f50 2024-04-15T00:21:27.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.188+0000 7fc2e482c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fc2d8035590 con 0x7fc2d8036b70 2024-04-15T00:21:27.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.188+0000 7fc2e482c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc2d8035e30 con 0x7fc2d80c8590 2024-04-15T00:21:27.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.188+0000 7fc169dac640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc15c01b8a0 0x7fc15c0db480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51674/0 (socket says 172.21.15.31:51674) 2024-04-15T00:21:27.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.188+0000 7fc2ded9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc2d8036b70 0x7fc2d8036510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.188+0000 7fc169dac640 1 -- 172.21.15.31:0/2537416081 learned_addr learned my addr 172.21.15.31:0/2537416081 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:27.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.188+0000 7fc2ded9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc2d8036b70 0x7fc2d8036510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51682/0 (socket says 172.21.15.31:51682) 2024-04-15T00:21:27.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.188+0000 7fc2ded9d640 1 -- 172.21.15.31:0/1095145844 learned_addr learned my addr 172.21.15.31:0/1095145844 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:27.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7fc2df59e640 1 --2- 172.21.15.31:0/1095145844 >> v2:172.21.15.50:3300/0 conn(0x7fc2d80c8590 0x7fc2d80c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7fac4f055640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fac480b9d50 0x7fac48141470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7fac4f055640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac480ba130 con 0x7fac48147b70 2024-04-15T00:21:27.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7fac4f055640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac4809b380 con 0x7fac481419b0 2024-04-15T00:21:27.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7fac4f055640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fac4809b660 con 0x7fac480b9d50 2024-04-15T00:21:27.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.188+0000 7fce9cfd4640 1 -- start start 2024-04-15T00:21:27.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7fac4e053640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fac480b9d50 0x7fac48141470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7fac4e053640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fac480b9d50 0x7fac48141470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51688/0 (socket says 172.21.15.31:51688) 2024-04-15T00:21:27.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7fac4e053640 1 -- 172.21.15.31:0/1212664812 learned_addr learned my addr 172.21.15.31:0/1212664812 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:27.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7feca4f1e640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feca00ae5e0 0x7feca006d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7feca4f1e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feca00729e0 0x7feca006d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7feca4f1e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feca00af2a0 0x7feca006bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7feca4f1e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7feca00b4b80 con 0x7feca00af2a0 2024-04-15T00:21:27.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7feca4f1e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7feca00b2f30 con 0x7feca00729e0 2024-04-15T00:21:27.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7feca4f1e640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7feca00af7f0 con 0x7feca00ae5e0 2024-04-15T00:21:27.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7fc169dac640 1 -- 172.21.15.31:0/2537416081 >> v2:172.21.15.50:3300/0 conn(0x7fc15c0064d0 msgr2=0x7fc15c031540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-15T00:21:27.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7f7c5f59e640 1 --2- 172.21.15.31:0/4241780005 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7c6014fbb0 0x7f7c60157700 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7c540097d0 tx=0x7f7c5402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fb479c4847b641f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7fce9cfd4640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fce900ca720 0x7fce900cab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7fce9cfd4640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce90036f40 con 0x7fce90038380 2024-04-15T00:21:27.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7fce9cfd4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce900d0b70 con 0x7fce90036b60 2024-04-15T00:21:27.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7fce9cfd4640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fce900cb0d0 con 0x7fce900ca720 2024-04-15T00:21:27.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7fc169dac640 1 --2- 172.21.15.31:0/2537416081 >> v2:172.21.15.50:3300/0 conn(0x7fc15c0064d0 0x7fc15c031540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7fc169dac640 1 -- 172.21.15.31:0/2537416081 >> v1:172.21.15.31:6789/0 conn(0x7fc15c039ea0 legacy=0x7fc15c0ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:27.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7fce97fff640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fce900ca720 0x7fce900cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7fce977fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fce90036b60 0x7fce900d1370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.31:46680/0 (socket says 172.21.15.31:46680) 2024-04-15T00:21:27.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7fce977fe640 1 -- 172.21.15.31:0/3299547203 learned_addr learned my addr 172.21.15.31:0/3299547203 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:27.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7f7c5dd9b640 1 -- 172.21.15.31:0/4241780005 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c54035020 con 0x7f7c6014fbb0 2024-04-15T00:21:27.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7fc169dac640 1 -- 172.21.15.31:0/2537416081 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc15c01d580 con 0x7fc15c01b8a0 2024-04-15T00:21:27.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7fe7b74c8640 1 Processor -- start 2024-04-15T00:21:27.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7f7c5dd9b640 1 -- 172.21.15.31:0/4241780005 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c54031810 con 0x7f7c6014fbb0 2024-04-15T00:21:27.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7f7c5dd9b640 1 -- 172.21.15.31:0/4241780005 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c54031be0 con 0x7f7c6014fbb0 2024-04-15T00:21:27.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.188+0000 7fd38ad9d640 1 -- 172.21.15.31:0/3474825678 >> v1:172.21.15.50:6789/0 conn(0x7fd38c147980 legacy=0x7fd38c143950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.188+0000 7fd38ad9d640 1 -- 172.21.15.31:0/3474825678 >> v1:172.21.15.31:6789/0 conn(0x7fd38c0b6080 legacy=0x7fd38c147270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:27.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.188+0000 7fd38ad9d640 1 -- 172.21.15.31:0/3474825678 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd38c0b2d50 con 0x7fd38c0b0080 2024-04-15T00:21:27.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7fec9ed9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feca00af2a0 0x7feca006bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7fec9ed9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feca00af2a0 0x7feca006bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51702/0 (socket says 172.21.15.31:51702) 2024-04-15T00:21:27.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7fec9ed9d640 1 -- 172.21.15.31:0/832946594 learned_addr learned my addr 172.21.15.31:0/832946594 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:27.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7fec9e59c640 1 --2- 172.21.15.31:0/832946594 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feca00ae5e0 0x7feca006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7fec9dd9b640 1 --2- 172.21.15.31:0/832946594 >> v2:172.21.15.50:3300/0 conn(0x7feca00729e0 0x7feca006d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7fce967fc640 1 -- 172.21.15.31:0/3299547203 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1029867604 0 0) 0x7fce900d0b70 con 0x7fce90036b60 2024-04-15T00:21:27.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7fce97fff640 1 -- 172.21.15.31:0/3299547203 >> v1:172.21.15.50:6789/0 conn(0x7fce90036b60 legacy=0x7fce900d1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7fce97fff640 1 -- 172.21.15.31:0/3299547203 >> v1:172.21.15.31:6789/0 conn(0x7fce90038380 legacy=0x7fce900d4430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-15T00:21:27.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7fe7b74c8640 1 -- start start 2024-04-15T00:21:27.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7fec9e59c640 1 -- 172.21.15.31:0/832946594 >> v2:172.21.15.50:3300/0 conn(0x7feca00729e0 msgr2=0x7feca006d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:27.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7fec9e59c640 1 --2- 172.21.15.31:0/832946594 >> v2:172.21.15.50:3300/0 conn(0x7feca00729e0 0x7feca006d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7fec9e59c640 1 -- 172.21.15.31:0/832946594 >> v2:172.21.15.31:3300/0 conn(0x7feca00af2a0 msgr2=0x7feca006bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:27.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7fce97fff640 1 -- 172.21.15.31:0/3299547203 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce900d0e50 con 0x7fce900ca720 2024-04-15T00:21:27.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7fac4d051640 1 -- 172.21.15.31:0/1212664812 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2271486994 0 0) 0x7fac480ba130 con 0x7fac48147b70 2024-04-15T00:21:27.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7fac4d051640 1 -- 172.21.15.31:0/1212664812 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac34003520 con 0x7fac48147b70 2024-04-15T00:21:27.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7fac4d051640 1 -- 172.21.15.31:0/1212664812 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1370687677 0 0) 0x7fac4809b380 con 0x7fac481419b0 2024-04-15T00:21:27.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7fac4d051640 1 -- 172.21.15.31:0/1212664812 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac480ba130 con 0x7fac481419b0 2024-04-15T00:21:27.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7fac4d051640 1 -- 172.21.15.31:0/1212664812 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3835089250 0 0) 0x7fac34003520 con 0x7fac48147b70 2024-04-15T00:21:27.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7fac4d051640 1 -- 172.21.15.31:0/1212664812 >> v2:172.21.15.31:3300/0 conn(0x7fac480b9d50 msgr2=0x7fac48141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:27.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7fac4d051640 1 --2- 172.21.15.31:0/1212664812 >> v2:172.21.15.31:3300/0 conn(0x7fac480b9d50 0x7fac48141470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7fac4d051640 1 -- 172.21.15.31:0/1212664812 >> v1:172.21.15.50:6789/0 conn(0x7fac481419b0 legacy=0x7fac48147460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7fc2ded9d640 1 -- 172.21.15.31:0/1095145844 >> v2:172.21.15.50:3300/0 conn(0x7fc2d80c8590 msgr2=0x7fc2d80c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:27.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7fc2ded9d640 1 --2- 172.21.15.31:0/1095145844 >> v2:172.21.15.50:3300/0 conn(0x7fc2d80c8590 0x7fc2d80c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7fc2ded9d640 1 -- 172.21.15.31:0/1095145844 >> v1:172.21.15.31:6789/0 conn(0x7fc2d8036f50 legacy=0x7fc2d8033720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.189+0000 7fc2ded9d640 1 -- 172.21.15.31:0/1095145844 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d80357e0 con 0x7fc2d8036b70 2024-04-15T00:21:27.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7fac4d051640 1 -- 172.21.15.31:0/1212664812 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac4809b940 con 0x7fac48147b70 2024-04-15T00:21:27.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7fac4d051640 1 -- 172.21.15.31:0/1212664812 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 697057150 0 0) 0x7fac40001920 con 0x7fac48147b70 2024-04-15T00:21:27.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7fac4d051640 1 -- 172.21.15.31:0/1212664812 >> v1:172.21.15.31:6789/0 conn(0x7fac48147b70 legacy=0x7fac48151d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7fac4d051640 1 --2- 172.21.15.31:0/1212664812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac34004ba0 0x7fac34004f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7fac4d051640 1 --2- 172.21.15.31:0/1212664812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac340037a0 0x7fac34003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7fac4d051640 1 --2- 172.21.15.31:0/1212664812 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac34004160 0x7fac3400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7fac4d051640 1 -- 172.21.15.31:0/1212664812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fac4809b660 con 0x7fac34004ba0 2024-04-15T00:21:27.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7fac4d051640 1 -- 172.21.15.31:0/1212664812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fac3400c0c0 con 0x7fac340037a0 2024-04-15T00:21:27.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7fac4d051640 1 -- 172.21.15.31:0/1212664812 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fac3400c2c0 con 0x7fac34004160 2024-04-15T00:21:27.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7fac4e053640 1 --2- 172.21.15.31:0/1212664812 >> v2:172.21.15.31:3300/0 conn(0x7fac480b9d50 0x7fac48141470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:21:27.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7fec9e59c640 1 --2- 172.21.15.31:0/832946594 >> v2:172.21.15.31:3300/0 conn(0x7feca00af2a0 0x7feca006bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7fec9e59c640 1 -- 172.21.15.31:0/832946594 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feca00ae0b0 con 0x7feca00ae5e0 2024-04-15T00:21:27.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7fec9ed9d640 1 --2- 172.21.15.31:0/832946594 >> v2:172.21.15.31:3300/0 conn(0x7feca00af2a0 0x7feca006bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:27.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7fc169dac640 1 --2- 172.21.15.31:0/2537416081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc15c01b8a0 0x7fc15c0db480 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc16404fa60 tx=0x7fc164064f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2957974ec5bf95e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.190+0000 7fac4e854640 1 --2- 172.21.15.31:0/1212664812 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac34004160 0x7fac3400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7fac4d852640 1 --2- 172.21.15.31:0/1212664812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac340037a0 0x7fac34003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7fac4e053640 1 --2- 172.21.15.31:0/1212664812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac34004ba0 0x7fac34004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7fd38ad9d640 1 --2- 172.21.15.31:0/3474825678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd38c0b0080 0x7fd38c06c230 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd38c0af830 tx=0x7fd37c02b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a22e59a39947474f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7fe7b74c8640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe7b006d180 0x7fe7b00af200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7fe7b74c8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe7b00ae800 0x7fe7b00b0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7fe7b74c8640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7b006d560 con 0x7fe7b00b3410 2024-04-15T00:21:27.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7fe7b74c8640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe7b00ae090 con 0x7fe7b00ae800 2024-04-15T00:21:27.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7fe7b74c8640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fe7b00af860 con 0x7fe7b006d180 2024-04-15T00:21:27.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7fc15bfff640 1 -- 172.21.15.31:0/2537416081 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1640b1020 con 0x7fc15c01b8a0 2024-04-15T00:21:27.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7fac4e854640 1 -- 172.21.15.31:0/1212664812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac340037a0 msgr2=0x7fac34003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:27.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7fac4e854640 1 --2- 172.21.15.31:0/1212664812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac340037a0 0x7fac34003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7fac4e854640 1 -- 172.21.15.31:0/1212664812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac34004ba0 msgr2=0x7fac34004f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:27.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7fac4e854640 1 --2- 172.21.15.31:0/1212664812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac34004ba0 0x7fac34004f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7fac4e854640 1 -- 172.21.15.31:0/1212664812 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac4809b940 con 0x7fac34004160 2024-04-15T00:21:27.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7fd389d9b640 1 -- 172.21.15.31:0/3474825678 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37c0317c0 con 0x7fd38c0b0080 2024-04-15T00:21:27.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7fe7b5a65640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe7b00b3410 0x7fe7b00b3860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:39416/0 (socket says 172.21.15.31:39416) 2024-04-15T00:21:27.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7fe7b5a65640 1 -- 172.21.15.31:0/2237032695 learned_addr learned my addr 172.21.15.31:0/2237032695 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:27.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7fe7b4a63640 1 --2- 172.21.15.31:0/2237032695 >> v2:172.21.15.50:3300/0 conn(0x7fe7b00ae800 0x7fe7b00b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7fd389d9b640 1 -- 172.21.15.31:0/3474825678 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd37c037070 con 0x7fd38c0b0080 2024-04-15T00:21:27.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7f7c648dd640 1 -- 172.21.15.31:0/4241780005 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7c6014fbb0 msgr2=0x7f7c60157700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7f7c648dd640 1 --2- 172.21.15.31:0/4241780005 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7c6014fbb0 0x7f7c60157700 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7c540097d0 tx=0x7f7c5402b8b0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7fc15bfff640 1 -- 172.21.15.31:0/2537416081 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1640ad6d0 con 0x7fc15c01b8a0 2024-04-15T00:21:27.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7fc15bfff640 1 -- 172.21.15.31:0/2537416081 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1640adb60 con 0x7fc15c01b8a0 2024-04-15T00:21:27.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7fd389d9b640 1 -- 172.21.15.31:0/3474825678 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37c031b80 con 0x7fd38c0b0080 2024-04-15T00:21:27.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7fc2ded9d640 1 --2- 172.21.15.31:0/1095145844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2d8036b70 0x7fc2d8036510 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8037940 tx=0x7fc2d002b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=583f86ed0469a8a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7f7c648dd640 1 -- 172.21.15.31:0/4241780005 shutdown_connections 2024-04-15T00:21:27.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7f7c648dd640 1 --2- 172.21.15.31:0/4241780005 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7c6014fbb0 0x7f7c60157700 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7f7c648dd640 1 -- 172.21.15.31:0/4241780005 >> 172.21.15.31:0/4241780005 conn(0x7f7c600b8c60 msgr2=0x7f7c600b9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7fe7b5264640 1 --2- 172.21.15.31:0/2237032695 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe7b006d180 0x7fe7b00af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7fec9e59c640 1 --2- 172.21.15.31:0/832946594 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feca00ae5e0 0x7feca006d110 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7feca00b65d0 tx=0x7fec9802bd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18a7e8de0cb3451d server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.191+0000 7fce97fff640 1 --2- 172.21.15.31:0/3299547203 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fce900ca720 0x7fce900cab90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fce980507b0 tx=0x7fce98069eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a093c8348a2d6e94 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.192+0000 7f7c648dd640 1 -- 172.21.15.31:0/4241780005 shutdown_connections 2024-04-15T00:21:27.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.192+0000 7f7c648dd640 1 -- 172.21.15.31:0/4241780005 wait complete. 2024-04-15T00:21:27.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.192+0000 7fec9d59a640 1 -- 172.21.15.31:0/832946594 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec98039070 con 0x7feca00ae5e0 2024-04-15T00:21:27.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.192+0000 7fac4e854640 1 -- 172.21.15.31:0/1212664812 reap_dead start 2024-04-15T00:21:27.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.192+0000 7fe7b4a63640 1 -- 172.21.15.31:0/2237032695 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe7b006d180 msgr2=0x7fe7b00af200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:27.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.192+0000 7fac4e854640 1 --2- 172.21.15.31:0/1212664812 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac34004160 0x7fac3400b9c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fac4000c510 tx=0x7fac34005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5c61ed64d1029af server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.192+0000 7fe7b4a63640 1 --2- 172.21.15.31:0/2237032695 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe7b006d180 0x7fe7b00af200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.192+0000 7fe7b4a63640 1 -- 172.21.15.31:0/2237032695 >> v1:172.21.15.31:6789/0 conn(0x7fe7b00b3410 legacy=0x7fe7b00b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.192+0000 7fd3911fe640 1 -- 172.21.15.31:0/3474825678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd38c0b0080 msgr2=0x7fd38c06c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.192+0000 7fd3911fe640 1 --2- 172.21.15.31:0/3474825678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd38c0b0080 0x7fd38c06c230 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd38c0af830 tx=0x7fd37c02b860 comp rx=0 tx=0).stop 2024-04-15T00:21:27.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.192+0000 7fe7b4a63640 1 -- 172.21.15.31:0/2237032695 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7b00b4cb0 con 0x7fe7b00ae800 2024-04-15T00:21:27.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.192+0000 7fce967fc640 1 -- 172.21.15.31:0/3299547203 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce980b4070 con 0x7fce900ca720 2024-04-15T00:21:27.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.192+0000 7fce967fc640 1 -- 172.21.15.31:0/3299547203 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce980af680 con 0x7fce900ca720 2024-04-15T00:21:27.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.192+0000 7fce967fc640 1 -- 172.21.15.31:0/3299547203 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce980afb10 con 0x7fce900ca720 2024-04-15T00:21:27.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.192+0000 7fc2ddd9b640 1 -- 172.21.15.31:0/1095145844 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0034070 con 0x7fc2d8036b70 2024-04-15T00:21:27.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.192+0000 7fec9d59a640 1 -- 172.21.15.31:0/832946594 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec9802cab0 con 0x7feca00ae5e0 2024-04-15T00:21:27.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.192+0000 7fc2ddd9b640 1 -- 172.21.15.31:0/1095145844 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d0030880 con 0x7fc2d8036b70 2024-04-15T00:21:27.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.192+0000 7fd3911fe640 1 -- 172.21.15.31:0/3474825678 shutdown_connections 2024-04-15T00:21:27.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.192+0000 7fd3911fe640 1 --2- 172.21.15.31:0/3474825678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd38c0b0080 0x7fd38c06c230 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.192+0000 7fd3911fe640 1 -- 172.21.15.31:0/3474825678 >> 172.21.15.31:0/3474825678 conn(0x7fd38c0b5560 msgr2=0x7fd38c0b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.193+0000 7fc2ddd9b640 1 -- 172.21.15.31:0/1095145844 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0030c90 con 0x7fc2d8036b70 2024-04-15T00:21:27.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.192+0000 7fac4d051640 1 -- 172.21.15.31:0/1212664812 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac40039070 con 0x7fac34004160 2024-04-15T00:21:27.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.192+0000 7fac4d051640 1 -- 172.21.15.31:0/1212664812 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac4002cc90 con 0x7fac34004160 2024-04-15T00:21:27.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.192+0000 7fac4d051640 1 -- 172.21.15.31:0/1212664812 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4000c0e0 con 0x7fac34004160 2024-04-15T00:21:27.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.193+0000 7fd3911fe640 1 -- 172.21.15.31:0/3474825678 shutdown_connections 2024-04-15T00:21:27.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.193+0000 7fce9cfd4640 1 -- 172.21.15.31:0/3299547203 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fce900ca720 msgr2=0x7fce900cab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.193+0000 7fce9cfd4640 1 --2- 172.21.15.31:0/3299547203 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fce900ca720 0x7fce900cab90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fce980507b0 tx=0x7fce98069eb0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.193+0000 7fc16a5ad640 1 -- 172.21.15.31:0/2537416081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc15c01b8a0 msgr2=0x7fc15c0db480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.193+0000 7fc16a5ad640 1 --2- 172.21.15.31:0/2537416081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc15c01b8a0 0x7fc15c0db480 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc16404fa60 tx=0x7fc164064f70 comp rx=0 tx=0).stop 2024-04-15T00:21:27.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.193+0000 7fec9d59a640 1 -- 172.21.15.31:0/832946594 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec98034440 con 0x7feca00ae5e0 2024-04-15T00:21:27.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.193+0000 7fce9cfd4640 1 -- 172.21.15.31:0/3299547203 shutdown_connections 2024-04-15T00:21:27.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.193+0000 7fce9cfd4640 1 --2- 172.21.15.31:0/3299547203 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fce900ca720 0x7fce900cab90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.193+0000 7fce9cfd4640 1 -- 172.21.15.31:0/3299547203 >> 172.21.15.31:0/3299547203 conn(0x7fce9003abc0 msgr2=0x7fce90005ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.193+0000 7fc16a5ad640 1 -- 172.21.15.31:0/2537416081 shutdown_connections 2024-04-15T00:21:27.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.193+0000 7fc16a5ad640 1 --2- 172.21.15.31:0/2537416081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc15c01b8a0 0x7fc15c0db480 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.193+0000 7fc16a5ad640 1 --2- 172.21.15.31:0/2537416081 >> v2:172.21.15.50:3300/0 conn(0x7fc15c0064d0 0x7fc15c031540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.193+0000 7fc16a5ad640 1 -- 172.21.15.31:0/2537416081 >> 172.21.15.31:0/2537416081 conn(0x7fc15c00ab30 msgr2=0x7fc15c006af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.193+0000 7fd3911fe640 1 -- 172.21.15.31:0/3474825678 wait complete. 2024-04-15T00:21:27.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.193+0000 7fce9cfd4640 1 -- 172.21.15.31:0/3299547203 shutdown_connections 2024-04-15T00:21:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.193+0000 7fc16a5ad640 1 -- 172.21.15.31:0/2537416081 shutdown_connections 2024-04-15T00:21:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.193+0000 7fc16a5ad640 1 -- 172.21.15.31:0/2537416081 wait complete. 2024-04-15T00:21:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.193+0000 7fc2e482c640 1 -- 172.21.15.31:0/1095145844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2d8036b70 msgr2=0x7fc2d8036510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.193+0000 7fc2e482c640 1 --2- 172.21.15.31:0/1095145844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2d8036b70 0x7fc2d8036510 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8037940 tx=0x7fc2d002b9c0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.193+0000 7feca4f1e640 1 -- 172.21.15.31:0/832946594 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feca00ae5e0 msgr2=0x7feca006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.193+0000 7feca4f1e640 1 --2- 172.21.15.31:0/832946594 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feca00ae5e0 0x7feca006d110 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7feca00b65d0 tx=0x7fec9802bd00 comp rx=0 tx=0).stop 2024-04-15T00:21:27.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.194+0000 7f7c648dd640 1 Processor -- start 2024-04-15T00:21:27.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.194+0000 7fc2e482c640 1 -- 172.21.15.31:0/1095145844 shutdown_connections 2024-04-15T00:21:27.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.194+0000 7fc2e482c640 1 --2- 172.21.15.31:0/1095145844 >> v2:172.21.15.50:3300/0 conn(0x7fc2d80c8590 0x7fc2d80c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.194+0000 7fc2e482c640 1 --2- 172.21.15.31:0/1095145844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2d8036b70 0x7fc2d8036510 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.194+0000 7fc2e482c640 1 -- 172.21.15.31:0/1095145844 >> 172.21.15.31:0/1095145844 conn(0x7fc2d803a8a0 msgr2=0x7fc2d803acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.194+0000 7f7c648dd640 1 -- start start 2024-04-15T00:21:27.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.193+0000 7fce9cfd4640 1 -- 172.21.15.31:0/3299547203 wait complete. 2024-04-15T00:21:27.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.194+0000 7fc2e482c640 1 -- 172.21.15.31:0/1095145844 shutdown_connections 2024-04-15T00:21:27.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.193+0000 7fac4f055640 1 -- 172.21.15.31:0/1212664812 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac34004160 msgr2=0x7fac3400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.193+0000 7fac4f055640 1 --2- 172.21.15.31:0/1212664812 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac34004160 0x7fac3400b9c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fac4000c510 tx=0x7fac34005830 comp rx=0 tx=0).stop 2024-04-15T00:21:27.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.194+0000 7feca4f1e640 1 -- 172.21.15.31:0/832946594 shutdown_connections 2024-04-15T00:21:27.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.194+0000 7feca4f1e640 1 --2- 172.21.15.31:0/832946594 >> v2:172.21.15.31:3300/0 conn(0x7feca00af2a0 0x7feca006bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.194+0000 7feca4f1e640 1 --2- 172.21.15.31:0/832946594 >> v2:172.21.15.50:3300/0 conn(0x7feca00729e0 0x7feca006d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.194+0000 7feca4f1e640 1 --2- 172.21.15.31:0/832946594 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feca00ae5e0 0x7feca006d110 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.194+0000 7feca4f1e640 1 -- 172.21.15.31:0/832946594 >> 172.21.15.31:0/832946594 conn(0x7feca00b5510 msgr2=0x7feca00b5920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.194+0000 7feca4f1e640 1 -- 172.21.15.31:0/832946594 shutdown_connections 2024-04-15T00:21:27.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.194+0000 7fc2e482c640 1 -- 172.21.15.31:0/1095145844 wait complete. 2024-04-15T00:21:27.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.194+0000 7fac4f055640 1 -- 172.21.15.31:0/1212664812 shutdown_connections 2024-04-15T00:21:27.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.194+0000 7fac4f055640 1 --2- 172.21.15.31:0/1212664812 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac34004160 0x7fac3400b9c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.194+0000 7fac4f055640 1 -- 172.21.15.31:0/1212664812 >> 172.21.15.31:0/1212664812 conn(0x7fac4809edc0 msgr2=0x7fac4809f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.194+0000 7fe7b4a63640 1 --2- 172.21.15.31:0/2237032695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7b00ae800 0x7fe7b00b0160 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac0097a0 tx=0x7fe7ac02b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f72a439e92d576fb server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.195+0000 7fd3911fe640 1 Processor -- start 2024-04-15T00:21:27.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.194+0000 7fac4f055640 1 -- 172.21.15.31:0/1212664812 shutdown_connections 2024-04-15T00:21:27.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.195+0000 7fce9cfd4640 1 Processor -- start 2024-04-15T00:21:27.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.195+0000 7fc16a5ad640 1 Processor -- start 2024-04-15T00:21:27.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.195+0000 7fd3911fe640 1 -- start start 2024-04-15T00:21:27.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.195+0000 7f7c648dd640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7c600adf80 0x7f7c6009d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.194+0000 7fac4f055640 1 -- 172.21.15.31:0/1212664812 wait complete. 2024-04-15T00:21:27.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.195+0000 7fc2e482c640 1 Processor -- start 2024-04-15T00:21:27.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.195+0000 7f7c648dd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c600aebf0 0x7f7c6014b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.195+0000 7fc2e482c640 1 -- start start 2024-04-15T00:21:27.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fd3911fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd38c0b0080 0x7fd38c151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.195+0000 7fce9cfd4640 1 -- start start 2024-04-15T00:21:27.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fe7a7fff640 1 -- 172.21.15.31:0/2237032695 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac031780 con 0x7fe7b00ae800 2024-04-15T00:21:27.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fe7a7fff640 1 -- 172.21.15.31:0/2237032695 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7ac037070 con 0x7fe7b00ae800 2024-04-15T00:21:27.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fe7a7fff640 1 -- 172.21.15.31:0/2237032695 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac031b40 con 0x7fe7b00ae800 2024-04-15T00:21:27.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fd3911fe640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd38c0b6080 0x7fd38c1529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.195+0000 7fc16a5ad640 1 -- start start 2024-04-15T00:21:27.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fce9cfd4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce90036b60 0x7fce900c2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fc16a5ad640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc15c0064d0 0x7fc15c0374a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fc16a5ad640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc15c01b8a0 0x7fc15c1660b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fd38ad9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd38c0b0080 0x7fd38c151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fd3911fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd38c147980 0x7fd38c1352c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fd38ad9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd38c0b0080 0x7fd38c151780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51730/0 (socket says 172.21.15.31:51730) 2024-04-15T00:21:27.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fce9cfd4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce90038380 0x7fce90169670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fc16a5ad640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc15c039ea0 0x7fc15c0380f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fc16a5ad640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc15c031a80 con 0x7fc15c01b8a0 2024-04-15T00:21:27.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fc16a5ad640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc15c01be50 con 0x7fc15c0064d0 2024-04-15T00:21:27.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fc169dac640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc15c039ea0 0x7fc15c0380f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fc168daa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc15c01b8a0 0x7fc15c1660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fc169dac640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc15c039ea0 0x7fc15c0380f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.31:42104/0 (socket says 172.21.15.31:42104) 2024-04-15T00:21:27.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fc2e482c640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc2d8036b70 0x7fc2d8154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fac4f055640 1 Processor -- start 2024-04-15T00:21:27.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fc169dac640 1 -- 172.21.15.31:0/1966349602 learned_addr learned my addr 172.21.15.31:0/1966349602 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:27.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fac4f055640 1 -- start start 2024-04-15T00:21:27.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fc16a5ad640 1 -- 172.21.15.31:0/1966349602 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fc15c031c00 con 0x7fc15c039ea0 2024-04-15T00:21:27.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fc2e482c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2d8036f50 0x7fc2d8153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fc1695ab640 1 --2- 172.21.15.31:0/1966349602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc15c0064d0 0x7fc15c0374a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fce977fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce90036b60 0x7fce900c2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fce96ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce90038380 0x7fce90169670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fce977fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce90036b60 0x7fce900c2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51756/0 (socket says 172.21.15.31:51756) 2024-04-15T00:21:27.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fc2e482c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2d80c8590 0x7fc2d80c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fce96ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce90038380 0x7fce90169670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.31:37608/0 (socket says 172.21.15.31:37608) 2024-04-15T00:21:27.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fce9cfd4640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fce900ca720 0x7fce900d0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fc2e482c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d8029c80 con 0x7fc2d8036f50 2024-04-15T00:21:27.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fc2e482c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d80362c0 con 0x7fc2d80c8590 2024-04-15T00:21:27.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fc2e482c640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fc2d8033e30 con 0x7fc2d8036b70 2024-04-15T00:21:27.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.194+0000 7feca4f1e640 1 -- 172.21.15.31:0/832946594 wait complete. 2024-04-15T00:21:27.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7feca4f1e640 1 Processor -- start 2024-04-15T00:21:27.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7feca4f1e640 1 -- start start 2024-04-15T00:21:27.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7feca4f1e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca00ae5e0 0x7feca009cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7feca4f1e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feca00af2a0 0x7feca01c8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7feca4f1e640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feca01e10f0 0x7feca01d9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7feca4f1e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7feca006c440 con 0x7feca00af2a0 2024-04-15T00:21:27.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fce977fe640 1 -- 172.21.15.31:0/977230053 learned_addr learned my addr 172.21.15.31:0/977230053 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:27.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fc2ded9d640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc2d8036b70 0x7fc2d8154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7feca4f1e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7feca00ae9c0 con 0x7feca00ae5e0 2024-04-15T00:21:27.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7feca4f1e640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7feca006c5c0 con 0x7feca01e10f0 2024-04-15T00:21:27.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fce9cfd4640 1 -- 172.21.15.31:0/977230053 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fce900dc2f0 con 0x7fce90036b60 2024-04-15T00:21:27.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fce9cfd4640 1 -- 172.21.15.31:0/977230053 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fce90034e70 con 0x7fce90038380 2024-04-15T00:21:27.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fce9cfd4640 1 -- 172.21.15.31:0/977230053 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fce900dc470 con 0x7fce900ca720 2024-04-15T00:21:27.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fce97fff640 1 --2- 172.21.15.31:0/977230053 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fce900ca720 0x7fce900d0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7f7c648dd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c6014fbb0 0x7f7c60148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7f7c648dd640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7c600b29c0 con 0x7f7c600aebf0 2024-04-15T00:21:27.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7f7c5f59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c6014fbb0 0x7f7c60148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7f7c5f59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c6014fbb0 0x7f7c60148430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.31:37612/0 (socket says 172.21.15.31:37612) 2024-04-15T00:21:27.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7f7c5f59e640 1 -- 172.21.15.31:0/2772854060 learned_addr learned my addr 172.21.15.31:0/2772854060 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:27.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7f7c5ed9d640 1 --2- 172.21.15.31:0/2772854060 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7c600adf80 0x7f7c6009d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7f7c5e59c640 1 --2- 172.21.15.31:0/2772854060 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c600aebf0 0x7f7c6014b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7f7c648dd640 1 -- 172.21.15.31:0/2772854060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7c600b4e30 con 0x7f7c6014fbb0 2024-04-15T00:21:27.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7f7c648dd640 1 -- 172.21.15.31:0/2772854060 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f7c600b2ee0 con 0x7f7c600adf80 2024-04-15T00:21:27.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fc169dac640 1 -- 172.21.15.31:0/1966349602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc15c0064d0 msgr2=0x7fc15c0374a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fc169dac640 1 --2- 172.21.15.31:0/1966349602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc15c0064d0 0x7fc15c0374a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fc169dac640 1 -- 172.21.15.31:0/1966349602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc15c01b8a0 msgr2=0x7fc15c1660b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fc169dac640 1 --2- 172.21.15.31:0/1966349602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc15c01b8a0 0x7fc15c1660b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fc169dac640 1 -- 172.21.15.31:0/1966349602 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc15c038630 con 0x7fc15c039ea0 2024-04-15T00:21:27.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fc168daa640 1 --2- 172.21.15.31:0/1966349602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc15c01b8a0 0x7fc15c1660b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:21:27.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fc1695ab640 1 --2- 172.21.15.31:0/1966349602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc15c0064d0 0x7fc15c0374a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:21:27.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fd3911fe640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd38c0afa40 con 0x7fd38c0b0080 2024-04-15T00:21:27.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fd3911fe640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd38c0af8c0 con 0x7fd38c147980 2024-04-15T00:21:27.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fd3911fe640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fd38c144060 con 0x7fd38c0b6080 2024-04-15T00:21:27.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fd38a59c640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd38c0b6080 0x7fd38c1529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fd38a59c640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd38c0b6080 0x7fd38c1529e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.31:42090/0 (socket says 172.21.15.31:42090) 2024-04-15T00:21:27.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fd38a59c640 1 -- 172.21.15.31:0/4143571674 learned_addr learned my addr 172.21.15.31:0/4143571674 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:27.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.196+0000 7fd38b59e640 1 --2- 172.21.15.31:0/4143571674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd38c147980 0x7fd38c1352c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fd38a59c640 1 -- 172.21.15.31:0/4143571674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd38c147980 msgr2=0x7fd38c1352c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fd38a59c640 1 --2- 172.21.15.31:0/4143571674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd38c147980 0x7fd38c1352c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fd38a59c640 1 -- 172.21.15.31:0/4143571674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd38c0b0080 msgr2=0x7fd38c151780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fd38a59c640 1 --2- 172.21.15.31:0/4143571674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd38c0b0080 0x7fd38c151780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fd38a59c640 1 -- 172.21.15.31:0/4143571674 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd38c153130 con 0x7fd38c0b6080 2024-04-15T00:21:27.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fc2ded9d640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc2d8036b70 0x7fc2d8154b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.31:42110/0 (socket says 172.21.15.31:42110) 2024-04-15T00:21:27.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fc2ded9d640 1 -- 172.21.15.31:0/1659016300 learned_addr learned my addr 172.21.15.31:0/1659016300 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:27.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fc2de59c640 1 --2- 172.21.15.31:0/1659016300 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2d8036f50 0x7fc2d8153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fec9dd9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feca00af2a0 0x7feca01c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fec9dd9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feca00af2a0 0x7feca01c8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51770/0 (socket says 172.21.15.31:51770) 2024-04-15T00:21:27.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fec9dd9b640 1 -- 172.21.15.31:0/1289891001 learned_addr learned my addr 172.21.15.31:0/1289891001 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:27.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fec9e59c640 1 --2- 172.21.15.31:0/1289891001 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca00ae5e0 0x7feca009cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fec9ed9d640 1 --2- 172.21.15.31:0/1289891001 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feca01e10f0 0x7feca01d9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7f7c5f59e640 1 -- 172.21.15.31:0/2772854060 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7c600adf80 msgr2=0x7f7c6009d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7f7c5f59e640 1 --2- 172.21.15.31:0/2772854060 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7c600adf80 0x7f7c6009d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7f7c5f59e640 1 -- 172.21.15.31:0/2772854060 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c600aebf0 msgr2=0x7f7c6014b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7f7c5f59e640 1 --2- 172.21.15.31:0/2772854060 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c600aebf0 0x7f7c6014b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7f7c5f59e640 1 -- 172.21.15.31:0/2772854060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c6009c6d0 con 0x7f7c6014fbb0 2024-04-15T00:21:27.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fc2ded9d640 1 -- 172.21.15.31:0/1659016300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2d80c8590 msgr2=0x7fc2d80c3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fce96ffd640 1 -- 172.21.15.31:0/977230053 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fce900ca720 msgr2=0x7fce900d0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fce96ffd640 1 --2- 172.21.15.31:0/977230053 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fce900ca720 0x7fce900d0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fce96ffd640 1 -- 172.21.15.31:0/977230053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce90036b60 msgr2=0x7fce900c2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fce96ffd640 1 --2- 172.21.15.31:0/977230053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce90036b60 0x7fce900c2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fce96ffd640 1 -- 172.21.15.31:0/977230053 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce900cd110 con 0x7fce90038380 2024-04-15T00:21:27.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fec9ed9d640 1 -- 172.21.15.31:0/1289891001 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca00ae5e0 msgr2=0x7feca009cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fec9ed9d640 1 --2- 172.21.15.31:0/1289891001 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca00ae5e0 0x7feca009cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fec9ed9d640 1 -- 172.21.15.31:0/1289891001 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feca00af2a0 msgr2=0x7feca01c8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fec9ed9d640 1 --2- 172.21.15.31:0/1289891001 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feca00af2a0 0x7feca01c8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fec9ed9d640 1 -- 172.21.15.31:0/1289891001 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feca01dbcf0 con 0x7feca01e10f0 2024-04-15T00:21:27.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fe7b74c8640 1 -- 172.21.15.31:0/2237032695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7b00ae800 msgr2=0x7fe7b00b0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fe7b74c8640 1 --2- 172.21.15.31:0/2237032695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7b00ae800 0x7fe7b00b0160 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac0097a0 tx=0x7fe7ac02b820 comp rx=0 tx=0).stop 2024-04-15T00:21:27.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fc169dac640 1 --2- 172.21.15.31:0/1966349602 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc15c039ea0 0x7fc15c0380f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc16402d740 tx=0x7fc164069eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.197+0000 7fc2ded9d640 1 --2- 172.21.15.31:0/1659016300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2d80c8590 0x7fc2d80c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fc2ded9d640 1 -- 172.21.15.31:0/1659016300 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2d8036f50 msgr2=0x7fc2d8153690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fc2ded9d640 1 --2- 172.21.15.31:0/1659016300 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2d8036f50 0x7fc2d8153690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fc2ded9d640 1 -- 172.21.15.31:0/1659016300 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d8154110 con 0x7fc2d8036b70 2024-04-15T00:21:27.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fd38a59c640 1 --2- 172.21.15.31:0/4143571674 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd38c0b6080 0x7fd38c1529e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd38000c400 tx=0x7fd38000c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fac4f055640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac34004160 0x7fac4813d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fac4f055640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac480a0190 0x7fac48142260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fec9ed9d640 1 --2- 172.21.15.31:0/1289891001 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feca01e10f0 0x7feca01d9800 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fec9000e5e0 tx=0x7fec9000eaa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fac4f055640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac481427a0 0x7fac481430d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fe7b74c8640 1 -- 172.21.15.31:0/2237032695 shutdown_connections 2024-04-15T00:21:27.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fe7b74c8640 1 --2- 172.21.15.31:0/2237032695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7b00ae800 0x7fe7b00b0160 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fe7b74c8640 1 --2- 172.21.15.31:0/2237032695 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe7b006d180 0x7fe7b00af200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fe7b74c8640 1 -- 172.21.15.31:0/2237032695 >> 172.21.15.31:0/2237032695 conn(0x7fe7b00b5510 msgr2=0x7fe7b00b5920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fce96ffd640 1 --2- 172.21.15.31:0/977230053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce90038380 0x7fce90169670 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fce84009fd0 tx=0x7fce8400b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fc159ffb640 1 -- 172.21.15.31:0/1966349602 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1640c6070 con 0x7fc15c039ea0 2024-04-15T00:21:27.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7f7c5f59e640 1 --2- 172.21.15.31:0/2772854060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c6014fbb0 0x7f7c60148430 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7c540097d0 tx=0x7f7c540046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fe7b74c8640 1 -- 172.21.15.31:0/2237032695 shutdown_connections 2024-04-15T00:21:27.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fe7b74c8640 1 -- 172.21.15.31:0/2237032695 wait complete. 2024-04-15T00:21:27.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fc2ded9d640 1 --2- 172.21.15.31:0/1659016300 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc2d8036b70 0x7fc2d8154b80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc2d002bfd0 tx=0x7fc2d00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fd3737fe640 1 -- 172.21.15.31:0/4143571674 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3800225a0 con 0x7fd38c0b6080 2024-04-15T00:21:27.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fce83fff640 1 -- 172.21.15.31:0/977230053 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce84015020 con 0x7fce90038380 2024-04-15T00:21:27.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fce83fff640 1 -- 172.21.15.31:0/977230053 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce84011850 con 0x7fce90038380 2024-04-15T00:21:27.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fce83fff640 1 -- 172.21.15.31:0/977230053 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce84011c40 con 0x7fce90038380 2024-04-15T00:21:27.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fc159ffb640 1 -- 172.21.15.31:0/1966349602 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1640b6a50 con 0x7fc15c039ea0 2024-04-15T00:21:27.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fc159ffb640 1 -- 172.21.15.31:0/1966349602 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1640b6e00 con 0x7fc15c039ea0 2024-04-15T00:21:27.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fc16a5ad640 1 -- 172.21.15.31:0/1966349602 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc15c021230 con 0x7fc15c039ea0 2024-04-15T00:21:27.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fd3737fe640 1 -- 172.21.15.31:0/4143571674 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd380028070 con 0x7fd38c0b6080 2024-04-15T00:21:27.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fd3911fe640 1 -- 172.21.15.31:0/4143571674 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd38c072230 con 0x7fd38c0b6080 2024-04-15T00:21:27.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fac4e854640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac481427a0 0x7fac481430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fac4d852640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac480a0190 0x7fac48142260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fac4d852640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac480a0190 0x7fac48142260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.31:42138/0 (socket says 172.21.15.31:42138) 2024-04-15T00:21:27.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fac4e854640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac481427a0 0x7fac481430d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51786/0 (socket says 172.21.15.31:51786) 2024-04-15T00:21:27.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fac4f055640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fac480bc980 con 0x7fac481427a0 2024-04-15T00:21:27.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fac4d852640 1 -- 172.21.15.31:0/1728034986 learned_addr learned my addr 172.21.15.31:0/1728034986 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:27.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fac4f055640 1 -- 172.21.15.31:0/1728034986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fac480bc800 con 0x7fac34004160 2024-04-15T00:21:27.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fac4f055640 1 -- 172.21.15.31:0/1728034986 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fac480bcb00 con 0x7fac480a0190 2024-04-15T00:21:27.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.198+0000 7fac4e053640 1 --2- 172.21.15.31:0/1728034986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac34004160 0x7fac4813d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.199+0000 7fce9cfd4640 1 -- 172.21.15.31:0/977230053 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce900cd3f0 con 0x7fce90038380 2024-04-15T00:21:27.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.199+0000 7fce9cfd4640 1 -- 172.21.15.31:0/977230053 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce900c2270 con 0x7fce90038380 2024-04-15T00:21:27.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.199+0000 7fc16a5ad640 1 -- 172.21.15.31:0/1966349602 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc15c035f50 con 0x7fc15c039ea0 2024-04-15T00:21:27.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.199+0000 7fec8effd640 1 -- 172.21.15.31:0/1289891001 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec90017070 con 0x7feca01e10f0 2024-04-15T00:21:27.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.199+0000 7fec8effd640 1 -- 172.21.15.31:0/1289891001 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec90013610 con 0x7feca01e10f0 2024-04-15T00:21:27.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.199+0000 7fec8effd640 1 -- 172.21.15.31:0/1289891001 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9000f040 con 0x7feca01e10f0 2024-04-15T00:21:27.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.199+0000 7feca4f1e640 1 -- 172.21.15.31:0/1289891001 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feca01dacd0 con 0x7feca01e10f0 2024-04-15T00:21:27.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.199+0000 7feca4f1e640 1 -- 172.21.15.31:0/1289891001 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feca01d8510 con 0x7feca01e10f0 2024-04-15T00:21:27.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.200+0000 7f7c477fe640 1 -- 172.21.15.31:0/2772854060 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c54040070 con 0x7f7c6014fbb0 2024-04-15T00:21:27.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.200+0000 7f7c477fe640 1 -- 172.21.15.31:0/2772854060 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c5403e070 con 0x7f7c6014fbb0 2024-04-15T00:21:27.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.200+0000 7f7c477fe640 1 -- 172.21.15.31:0/2772854060 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c54035040 con 0x7f7c6014fbb0 2024-04-15T00:21:27.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.199+0000 7fd3737fe640 1 -- 172.21.15.31:0/4143571674 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3800229c0 con 0x7fd38c0b6080 2024-04-15T00:21:27.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.199+0000 7fac4e854640 1 -- 172.21.15.31:0/1728034986 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac480a0190 msgr2=0x7fac48142260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.199+0000 7fac4e854640 1 --2- 172.21.15.31:0/1728034986 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac480a0190 0x7fac48142260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.199+0000 7fac4e854640 1 -- 172.21.15.31:0/1728034986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac34004160 msgr2=0x7fac4813d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.199+0000 7fac4e854640 1 --2- 172.21.15.31:0/1728034986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac34004160 0x7fac4813d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.199+0000 7fac4e854640 1 -- 172.21.15.31:0/1728034986 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac48142c20 con 0x7fac481427a0 2024-04-15T00:21:27.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.199+0000 7fac4e854640 1 --2- 172.21.15.31:0/1728034986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac481427a0 0x7fac481430d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fac4809ae10 tx=0x7fac40001c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.199+0000 7fac4d852640 1 --2- 172.21.15.31:0/1728034986 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fac480a0190 0x7fac48142260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:21:27.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.200+0000 7fac3effd640 1 -- 172.21.15.31:0/1728034986 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac40043070 con 0x7fac481427a0 2024-04-15T00:21:27.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.200+0000 7fac4f055640 1 -- 172.21.15.31:0/1728034986 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac480a06e0 con 0x7fac481427a0 2024-04-15T00:21:27.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.200+0000 7fe7b74c8640 1 Processor -- start 2024-04-15T00:21:27.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.200+0000 7fe7b74c8640 1 -- start start 2024-04-15T00:21:27.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.201+0000 7fac3effd640 1 -- 172.21.15.31:0/1728034986 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac40034e40 con 0x7fac481427a0 2024-04-15T00:21:27.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.200+0000 7f7c648dd640 1 -- 172.21.15.31:0/2772854060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c6009dae0 con 0x7f7c6014fbb0 2024-04-15T00:21:27.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.200+0000 7f7c648dd640 1 -- 172.21.15.31:0/2772854060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c6009c1f0 con 0x7f7c6014fbb0 2024-04-15T00:21:27.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.201+0000 7fc159ffb640 1 -- 172.21.15.31:0/1966349602 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc1640b4020 con 0x7fc15c039ea0 2024-04-15T00:21:27.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.200+0000 7fd3911fe640 1 -- 172.21.15.31:0/4143571674 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd38c150810 con 0x7fd38c0b6080 2024-04-15T00:21:27.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.201+0000 7fd3737fe640 1 -- 172.21.15.31:0/4143571674 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fd380022b60 con 0x7fd38c0b6080 2024-04-15T00:21:27.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.202+0000 7fd3737fe640 1 --2- 172.21.15.31:0/4143571674 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fd37806b9c0 0x7fd37806de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.202+0000 7fd3737fe640 1 -- 172.21.15.31:0/4143571674 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd380067170 con 0x7fd38c0b6080 2024-04-15T00:21:27.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.201+0000 7fac4f055640 1 -- 172.21.15.31:0/1728034986 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac481449e0 con 0x7fac481427a0 2024-04-15T00:21:27.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.201+0000 7fe7b74c8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7b006d180 0x7fe7b0071ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.201+0000 7fe7b74c8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7b00ae800 0x7fe7b00710d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.201+0000 7fe7b74c8640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe7b00b3410 0x7fe7b009bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.201+0000 7fe7b74c8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b00afb40 con 0x7fe7b006d180 2024-04-15T00:21:27.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.201+0000 7fe7b74c8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b00b06a0 con 0x7fe7b00ae800 2024-04-15T00:21:27.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.201+0000 7fe7b74c8640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fe7b00b3f70 con 0x7fe7b00b3410 2024-04-15T00:21:27.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.201+0000 7fe7b5264640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7b006d180 0x7fe7b0071ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.201+0000 7fe7b5264640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7b006d180 0x7fe7b0071ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51788/0 (socket says 172.21.15.31:51788) 2024-04-15T00:21:27.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.201+0000 7fe7b5264640 1 -- 172.21.15.31:0/2001924345 learned_addr learned my addr 172.21.15.31:0/2001924345 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:27.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.201+0000 7fe7b4a63640 1 --2- 172.21.15.31:0/2001924345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7b00ae800 0x7fe7b00710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.202+0000 7fe7b5a65640 1 --2- 172.21.15.31:0/2001924345 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe7b00b3410 0x7fe7b009bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.202+0000 7fe7b4a63640 1 -- 172.21.15.31:0/2001924345 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe7b00b3410 msgr2=0x7fe7b009bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.202+0000 7fe7b4a63640 1 --2- 172.21.15.31:0/2001924345 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe7b00b3410 0x7fe7b009bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.202+0000 7fe7b4a63640 1 -- 172.21.15.31:0/2001924345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7b006d180 msgr2=0x7fe7b0071ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.202+0000 7fe7b4a63640 1 --2- 172.21.15.31:0/2001924345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7b006d180 0x7fe7b0071ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.201+0000 7fc2c77fe640 1 -- 172.21.15.31:0/1659016300 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0044070 con 0x7fc2d8036b70 2024-04-15T00:21:27.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.201+0000 7fc2c77fe640 1 -- 172.21.15.31:0/1659016300 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d0039e50 con 0x7fc2d8036b70 2024-04-15T00:21:27.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.201+0000 7fc2c77fe640 1 -- 172.21.15.31:0/1659016300 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0034040 con 0x7fc2d8036b70 2024-04-15T00:21:27.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.202+0000 7fc2e482c640 1 -- 172.21.15.31:0/1659016300 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2d81543f0 con 0x7fc2d8036b70 2024-04-15T00:21:27.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.202+0000 7fe7b4a63640 1 -- 172.21.15.31:0/2001924345 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7b01d4810 con 0x7fe7b00ae800 2024-04-15T00:21:27.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.202+0000 7fe7b5264640 1 --2- 172.21.15.31:0/2001924345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7b006d180 0x7fe7b0071ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:21:27.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.202+0000 7fac3effd640 1 -- 172.21.15.31:0/1728034986 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac40039040 con 0x7fac481427a0 2024-04-15T00:21:27.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.202+0000 7fd38ad9d640 1 --2- 172.21.15.31:0/4143571674 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fd37806b9c0 0x7fd37806de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.202+0000 7fd3717fa640 1 --2- 172.21.15.31:0/4143571674 >> [v2:172.21.15.31:6824/3722449780,v1:172.21.15.31:6825/3722449780] conn(0x7fd38c150a10 0x7fd38c1e1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.202+0000 7fc2e482c640 1 -- 172.21.15.31:0/1659016300 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2d8153bd0 con 0x7fc2d8036b70 2024-04-15T00:21:27.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.202+0000 7fe7b4a63640 1 --2- 172.21.15.31:0/2001924345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7b00ae800 0x7fe7b00710d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac033000 tx=0x7fe7ac0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.203+0000 7fd38b59e640 1 --2- 172.21.15.31:0/4143571674 >> [v2:172.21.15.31:6824/3722449780,v1:172.21.15.31:6825/3722449780] conn(0x7fd38c150a10 0x7fd38c1e1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.200+0000 7feca4f1e640 1 -- 172.21.15.31:0/1289891001 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feca01d9130 con 0x7feca01e10f0 2024-04-15T00:21:27.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.203+0000 7fec8effd640 1 -- 172.21.15.31:0/1289891001 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fec9001a070 con 0x7feca01e10f0 2024-04-15T00:21:27.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.202+0000 7fc16a5ad640 1 -- 172.21.15.31:0/1966349602 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc15c005700 con 0x7fc15c039ea0 2024-04-15T00:21:27.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.203+0000 7fac3effd640 1 -- 172.21.15.31:0/1728034986 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fac40046070 con 0x7fac481427a0 2024-04-15T00:21:27.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.203+0000 7fe7a5ffb640 1 -- 172.21.15.31:0/2001924345 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac032620 con 0x7fe7b00ae800 2024-04-15T00:21:27.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.203+0000 7fe7a5ffb640 1 -- 172.21.15.31:0/2001924345 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7ac0327e0 con 0x7fe7b00ae800 2024-04-15T00:21:27.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.203+0000 7fe7a5ffb640 1 -- 172.21.15.31:0/2001924345 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac032bd0 con 0x7fe7b00ae800 2024-04-15T00:21:27.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.203+0000 7fe7b74c8640 1 -- 172.21.15.31:0/2001924345 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7b0071860 con 0x7fe7b00ae800 2024-04-15T00:21:27.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.203+0000 7fe7b74c8640 1 -- 172.21.15.31:0/2001924345 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7b01d4490 con 0x7fe7b00ae800 2024-04-15T00:21:27.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.203+0000 7fd38b59e640 1 --2- 172.21.15.31:0/4143571674 >> [v2:172.21.15.31:6824/3722449780,v1:172.21.15.31:6825/3722449780] conn(0x7fd38c150a10 0x7fd38c1e1cc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.203+0000 7fd3717fa640 1 -- 172.21.15.31:0/4143571674 --> [v2:172.21.15.31:6824/3722449780,v1:172.21.15.31:6825/3722449780] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd38c0b2330 con 0x7fd38c150a10 2024-04-15T00:21:27.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.203+0000 7fac4f055640 1 -- 172.21.15.31:0/1728034986 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fac30001030 con 0x7fac481427a0 2024-04-15T00:21:27.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.204+0000 7fc2c57fa640 1 -- 172.21.15.31:0/1659016300 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc2b8001030 con 0x7fc2d8036b70 2024-04-15T00:21:27.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.204+0000 7fd38ad9d640 1 --2- 172.21.15.31:0/4143571674 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fd37806b9c0 0x7fd37806de80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd37c036000 tx=0x7fd37c03d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.204+0000 7fac3effd640 1 --2- 172.21.15.31:0/1728034986 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fac2c074270 0x7fac2c076730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.201+0000 7fce81ffb640 1 -- 172.21.15.31:0/977230053 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fce900052c0 con 0x7fce90038380 2024-04-15T00:21:27.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.202+0000 7fce83fff640 1 -- 172.21.15.31:0/977230053 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fce84018020 con 0x7fce90038380 2024-04-15T00:21:27.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.202+0000 7fce83fff640 1 --2- 172.21.15.31:0/977230053 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fce7c06ba90 0x7fce7c06df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.202+0000 7fce83fff640 1 -- 172.21.15.31:0/977230053 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fce8408a440 con 0x7fce90038380 2024-04-15T00:21:27.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.203+0000 7fce83fff640 1 --2- 172.21.15.31:0/977230053 >> [v2:172.21.15.31:6816/2355720818,v1:172.21.15.31:6817/2355720818] conn(0x7fce7c075180 0x7fce7c0775c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.203+0000 7fce83fff640 1 -- 172.21.15.31:0/977230053 --> [v2:172.21.15.31:6816/2355720818,v1:172.21.15.31:6817/2355720818] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fce7c077c90 con 0x7fce7c075180 2024-04-15T00:21:27.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.203+0000 7fec8effd640 1 --2- 172.21.15.31:0/1289891001 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fec8006b9e0 0x7fec8006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.203+0000 7fec8effd640 1 -- 172.21.15.31:0/1289891001 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fec9008a740 con 0x7feca01e10f0 2024-04-15T00:21:27.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.204+0000 7fec8effd640 1 --2- 172.21.15.31:0/1289891001 >> [v2:172.21.15.50:6816/682288274,v1:172.21.15.50:6817/682288274] conn(0x7fec80075150 0x7fec80077590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.204+0000 7fec8effd640 1 -- 172.21.15.31:0/1289891001 --> [v2:172.21.15.50:6816/682288274,v1:172.21.15.50:6817/682288274] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fec90001d30 con 0x7fec80075150 2024-04-15T00:21:27.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.204+0000 7fec8effd640 1 -- 172.21.15.31:0/1289891001 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fec9008abd0 con 0x7feca01e10f0 2024-04-15T00:21:27.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.204+0000 7fec9e59c640 1 --2- 172.21.15.31:0/1289891001 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fec8006b9e0 0x7fec8006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.204+0000 7fec9e59c640 1 --2- 172.21.15.31:0/1289891001 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fec8006b9e0 0x7fec8006dea0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fec98036000 tx=0x7fec98030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.203+0000 7fc159ffb640 1 --2- 172.21.15.31:0/1966349602 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc14806b990 0x7fc14806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.203+0000 7fc159ffb640 1 -- 172.21.15.31:0/1966349602 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc164128460 con 0x7fc15c039ea0 2024-04-15T00:21:27.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.204+0000 7fac3effd640 1 -- 172.21.15.31:0/1728034986 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fac400abb30 con 0x7fac481427a0 2024-04-15T00:21:27.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.204+0000 7f7c477fe640 1 -- 172.21.15.31:0/2772854060 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f7c54038020 con 0x7f7c6014fbb0 2024-04-15T00:21:27.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.204+0000 7f7c477fe640 1 --2- 172.21.15.31:0/2772854060 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f7c4c06ba60 0x7f7c4c06df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.204+0000 7f7c477fe640 1 -- 172.21.15.31:0/2772854060 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7c540ac720 con 0x7f7c6014fbb0 2024-04-15T00:21:27.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.205+0000 7fac3effd640 1 --2- 172.21.15.31:0/1728034986 >> [v2:172.21.15.50:6808/1589417182,v1:172.21.15.50:6809/1589417182] conn(0x7fac2c07d9e0 0x7fac2c07fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.205+0000 7fac3effd640 1 -- 172.21.15.31:0/1728034986 --> [v2:172.21.15.50:6808/1589417182,v1:172.21.15.50:6809/1589417182] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fac40039e90 con 0x7fac2c07d9e0 2024-04-15T00:21:27.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.205+0000 7fac3effd640 1 -- 172.21.15.31:0/1728034986 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fac400b2050 con 0x7fac481427a0 2024-04-15T00:21:27.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.205+0000 7fe7b74c8640 1 -- 172.21.15.31:0/2001924345 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe7b0071670 con 0x7fe7b00ae800 2024-04-15T00:21:27.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.205+0000 7fc159ffb640 1 --2- 172.21.15.31:0/1966349602 >> [v2:172.21.15.31:6800/225061474,v1:172.21.15.31:6801/225061474] conn(0x7fc148075090 0x7fc1480774d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.205+0000 7fc159ffb640 1 -- 172.21.15.31:0/1966349602 --> [v2:172.21.15.31:6800/225061474,v1:172.21.15.31:6801/225061474] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc164071170 con 0x7fc148075090 2024-04-15T00:21:27.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.205+0000 7f7c648dd640 1 --2- 172.21.15.31:0/2772854060 >> [v2:172.21.15.31:6808/2705297130,v1:172.21.15.31:6809/2705297130] conn(0x7f7c6006cf10 0x7f7c60148970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.205+0000 7f7c648dd640 1 -- 172.21.15.31:0/2772854060 --> [v2:172.21.15.31:6808/2705297130,v1:172.21.15.31:6809/2705297130] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7c6009c480 con 0x7f7c6006cf10 2024-04-15T00:21:27.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.205+0000 7fd3737fe640 1 -- 172.21.15.31:0/4143571674 <== osd.3 v2:172.21.15.31:6824/3722449780 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd38c0b2330 con 0x7fd38c150a10 2024-04-15T00:21:27.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.205+0000 7fce83fff640 1 -- 172.21.15.31:0/977230053 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fce84091050 con 0x7fce90038380 2024-04-15T00:21:27.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.205+0000 7fec9dd9b640 1 --2- 172.21.15.31:0/1289891001 >> [v2:172.21.15.50:6816/682288274,v1:172.21.15.50:6817/682288274] conn(0x7fec80075150 0x7fec80077590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.205+0000 7fc168daa640 1 --2- 172.21.15.31:0/1966349602 >> [v2:172.21.15.31:6800/225061474,v1:172.21.15.31:6801/225061474] conn(0x7fc148075090 0x7fc1480774d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.205+0000 7fc2c77fe640 1 -- 172.21.15.31:0/1659016300 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc2d0037070 con 0x7fc2d8036b70 2024-04-15T00:21:27.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.205+0000 7f7c5ed9d640 1 --2- 172.21.15.31:0/2772854060 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f7c4c06ba60 0x7f7c4c06df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.205+0000 7fce97fff640 1 --2- 172.21.15.31:0/977230053 >> [v2:172.21.15.31:6816/2355720818,v1:172.21.15.31:6817/2355720818] conn(0x7fce7c075180 0x7fce7c0775c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.205+0000 7f7c5e59c640 1 --2- 172.21.15.31:0/2772854060 >> [v2:172.21.15.31:6808/2705297130,v1:172.21.15.31:6809/2705297130] conn(0x7f7c6006cf10 0x7f7c60148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.205+0000 7fc159ffb640 1 -- 172.21.15.31:0/1966349602 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc1640f28c0 con 0x7fc15c039ea0 2024-04-15T00:21:27.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.205+0000 7fc1695ab640 1 --2- 172.21.15.31:0/1966349602 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc14806b990 0x7fc14806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.205+0000 7fc2c77fe640 1 --2- 172.21.15.31:0/1659016300 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc2cc06ba60 0x7fc2cc06df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.205+0000 7fc2c77fe640 1 -- 172.21.15.31:0/1659016300 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc2d00b0e60 con 0x7fc2d8036b70 2024-04-15T00:21:27.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.205+0000 7fac4e053640 1 --2- 172.21.15.31:0/1728034986 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fac2c074270 0x7fac2c076730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.205+0000 7fc2c77fe640 1 --2- 172.21.15.31:0/1659016300 >> [v2:172.21.15.50:6800/1279970071,v1:172.21.15.50:6801/1279970071] conn(0x7fc2cc0751e0 0x7fc2cc077620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.205+0000 7fc2c77fe640 1 -- 172.21.15.31:0/1659016300 --> [v2:172.21.15.50:6800/1279970071,v1:172.21.15.50:6801/1279970071] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc2cc077cf0 con 0x7fc2cc0751e0 2024-04-15T00:21:27.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.206+0000 7fc2c77fe640 1 -- 172.21.15.31:0/1659016300 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc2d00b34c0 con 0x7fc2d8036b70 2024-04-15T00:21:27.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.205+0000 7fc168daa640 1 --2- 172.21.15.31:0/1966349602 >> [v2:172.21.15.31:6800/225061474,v1:172.21.15.31:6801/225061474] conn(0x7fc148075090 0x7fc1480774d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.206+0000 7fce977fe640 1 --2- 172.21.15.31:0/977230053 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fce7c06ba90 0x7fce7c06df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.206+0000 7fce97fff640 1 --2- 172.21.15.31:0/977230053 >> [v2:172.21.15.31:6816/2355720818,v1:172.21.15.31:6817/2355720818] conn(0x7fce7c075180 0x7fce7c0775c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.206+0000 7fc2de59c640 1 --2- 172.21.15.31:0/1659016300 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc2cc06ba60 0x7fc2cc06df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.206+0000 7fc2df59e640 1 --2- 172.21.15.31:0/1659016300 >> [v2:172.21.15.50:6800/1279970071,v1:172.21.15.50:6801/1279970071] conn(0x7fc2cc0751e0 0x7fc2cc077620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.206+0000 7f7c5e59c640 1 --2- 172.21.15.31:0/2772854060 >> [v2:172.21.15.31:6808/2705297130,v1:172.21.15.31:6809/2705297130] conn(0x7f7c6006cf10 0x7f7c60148970 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.206+0000 7fac4d852640 1 --2- 172.21.15.31:0/1728034986 >> [v2:172.21.15.50:6808/1589417182,v1:172.21.15.50:6809/1589417182] conn(0x7fac2c07d9e0 0x7fac2c07fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.206+0000 7fc1695ab640 1 --2- 172.21.15.31:0/1966349602 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc14806b990 0x7fc14806de50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc16000a8b0 tx=0x7fc160008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.206+0000 7fc2de59c640 1 --2- 172.21.15.31:0/1659016300 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc2cc06ba60 0x7fc2cc06df20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc2d80c5030 tx=0x7fc2d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.206+0000 7fec9dd9b640 1 --2- 172.21.15.31:0/1289891001 >> [v2:172.21.15.50:6816/682288274,v1:172.21.15.50:6817/682288274] conn(0x7fec80075150 0x7fec80077590 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.207+0000 7f7c5ed9d640 1 --2- 172.21.15.31:0/2772854060 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f7c4c06ba60 0x7f7c4c06df20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7c580012e0 tx=0x7f7c58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.207+0000 7fce83fff640 1 -- 172.21.15.31:0/977230053 <== osd.0 v2:172.21.15.31:6816/2355720818 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fce7c077c90 con 0x7fce7c075180 2024-04-15T00:21:27.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.207+0000 7fce977fe640 1 --2- 172.21.15.31:0/977230053 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fce7c06ba90 0x7fce7c06df50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fce8c007fd0 tx=0x7fce8c007c20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.207+0000 7fc159ffb640 1 -- 172.21.15.31:0/1966349602 <== osd.2 v2:172.21.15.31:6800/225061474 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc164071170 con 0x7fc148075090 2024-04-15T00:21:27.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.207+0000 7fac4e053640 1 --2- 172.21.15.31:0/1728034986 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fac2c074270 0x7fac2c076730 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fac380094a0 tx=0x7fac38008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.207+0000 7f7c477fe640 1 -- 172.21.15.31:0/2772854060 <== osd.1 v2:172.21.15.31:6808/2705297130 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7c6009c480 con 0x7f7c6006cf10 2024-04-15T00:21:27.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.207+0000 7fec8effd640 1 -- 172.21.15.31:0/1289891001 <== osd.6 v2:172.21.15.50:6816/682288274 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fec90001d30 con 0x7fec80075150 2024-04-15T00:21:27.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.207+0000 7fe7a5ffb640 1 -- 172.21.15.31:0/2001924345 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fe7ac04e440 con 0x7fe7b00ae800 2024-04-15T00:21:27.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.207+0000 7fe7a5ffb640 1 --2- 172.21.15.31:0/2001924345 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe79406ba90 0x7fe79406df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.208+0000 7fc2df59e640 1 --2- 172.21.15.31:0/1659016300 >> [v2:172.21.15.50:6800/1279970071,v1:172.21.15.50:6801/1279970071] conn(0x7fc2cc0751e0 0x7fc2cc077620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.208+0000 7fe7a5ffb640 1 -- 172.21.15.31:0/2001924345 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe7ac0ac7a0 con 0x7fe7b00ae800 2024-04-15T00:21:27.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.208+0000 7fe7a5ffb640 1 --2- 172.21.15.31:0/2001924345 >> [v2:172.21.15.50:6824/4129060906,v1:172.21.15.50:6825/4129060906] conn(0x7fe794075200 0x7fe794077640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.208+0000 7fe7b5264640 1 --2- 172.21.15.31:0/2001924345 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe79406ba90 0x7fe79406df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.208+0000 7fe7a5ffb640 1 -- 172.21.15.31:0/2001924345 --> [v2:172.21.15.50:6824/4129060906,v1:172.21.15.50:6825/4129060906] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe7ac04fe50 con 0x7fe794075200 2024-04-15T00:21:27.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.208+0000 7fe7a5ffb640 1 -- 172.21.15.31:0/2001924345 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe7ac0b3050 con 0x7fe7b00ae800 2024-04-15T00:21:27.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.208+0000 7fac4d852640 1 --2- 172.21.15.31:0/1728034986 >> [v2:172.21.15.50:6808/1589417182,v1:172.21.15.50:6809/1589417182] conn(0x7fac2c07d9e0 0x7fac2c07fe20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.208+0000 7fe7b5a65640 1 --2- 172.21.15.31:0/2001924345 >> [v2:172.21.15.50:6824/4129060906,v1:172.21.15.50:6825/4129060906] conn(0x7fe794075200 0x7fe794077640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.208+0000 7fc2c77fe640 1 -- 172.21.15.31:0/1659016300 <== osd.4 v2:172.21.15.50:6800/1279970071 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc2cc077cf0 con 0x7fc2cc0751e0 2024-04-15T00:21:27.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.209+0000 7fe7b5264640 1 --2- 172.21.15.31:0/2001924345 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe79406ba90 0x7fe79406df50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe7a00112c0 tx=0x7fe7a0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.209+0000 7fac3effd640 1 -- 172.21.15.31:0/1728034986 <== osd.5 v2:172.21.15.50:6808/1589417182 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fac40039e90 con 0x7fac2c07d9e0 2024-04-15T00:21:27.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.209+0000 7fe7b5a65640 1 --2- 172.21.15.31:0/2001924345 >> [v2:172.21.15.50:6824/4129060906,v1:172.21.15.50:6825/4129060906] conn(0x7fe794075200 0x7fe794077640 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.210+0000 7fe7a5ffb640 1 -- 172.21.15.31:0/2001924345 <== osd.7 v2:172.21.15.50:6824/4129060906 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe7ac04fe50 con 0x7fe794075200 2024-04-15T00:21:27.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.236+0000 7fd3717fa640 1 -- 172.21.15.31:0/4143571674 --> [v2:172.21.15.31:6824/3722449780,v1:172.21.15.31:6825/3722449780] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd38c153440 con 0x7fd38c150a10 2024-04-15T00:21:27.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.236+0000 7fd3737fe640 1 -- 172.21.15.31:0/4143571674 <== osd.3 v2:172.21.15.31:6824/3722449780 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd38c153440 con 0x7fd38c150a10 2024-04-15T00:21:27.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.237+0000 7fd3911fe640 1 -- 172.21.15.31:0/4143571674 >> [v2:172.21.15.31:6824/3722449780,v1:172.21.15.31:6825/3722449780] conn(0x7fd38c150a10 msgr2=0x7fd38c1e1cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.237+0000 7fd3911fe640 1 --2- 172.21.15.31:0/4143571674 >> [v2:172.21.15.31:6824/3722449780,v1:172.21.15.31:6825/3722449780] conn(0x7fd38c150a10 0x7fd38c1e1cc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.237+0000 7fd3911fe640 1 -- 172.21.15.31:0/4143571674 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fd37806b9c0 msgr2=0x7fd37806de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.237+0000 7fd3911fe640 1 --2- 172.21.15.31:0/4143571674 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fd37806b9c0 0x7fd37806de80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd37c036000 tx=0x7fd37c03d040 comp rx=0 tx=0).stop 2024-04-15T00:21:27.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.238+0000 7fd3911fe640 1 -- 172.21.15.31:0/4143571674 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd38c0b6080 msgr2=0x7fd38c1529e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.238+0000 7fd3911fe640 1 --2- 172.21.15.31:0/4143571674 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd38c0b6080 0x7fd38c1529e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd38000c400 tx=0x7fd38000c8c0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.238+0000 7fd38b59e640 1 -- 172.21.15.31:0/4143571674 reap_dead start 2024-04-15T00:21:27.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.238+0000 7fd3911fe640 1 -- 172.21.15.31:0/4143571674 shutdown_connections 2024-04-15T00:21:27.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.238+0000 7fd3911fe640 1 -- 172.21.15.31:0/4143571674 >> 172.21.15.31:0/4143571674 conn(0x7fd38c0b5560 msgr2=0x7fd38c0b3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.238+0000 7fd3911fe640 1 -- 172.21.15.31:0/4143571674 shutdown_connections 2024-04-15T00:21:27.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.238+0000 7fd3911fe640 1 -- 172.21.15.31:0/4143571674 wait complete. 2024-04-15T00:21:27.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.240+0000 7fce81ffb640 1 -- 172.21.15.31:0/977230053 --> [v2:172.21.15.31:6816/2355720818,v1:172.21.15.31:6817/2355720818] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fce900c2440 con 0x7fce7c075180 2024-04-15T00:21:27.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.240+0000 7fc16a5ad640 1 -- 172.21.15.31:0/1966349602 --> [v2:172.21.15.31:6800/225061474,v1:172.21.15.31:6801/225061474] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc15c0cf8f0 con 0x7fc148075090 2024-04-15T00:21:27.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.240+0000 7fce83fff640 1 -- 172.21.15.31:0/977230053 <== osd.0 v2:172.21.15.31:6816/2355720818 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fce900c2440 con 0x7fce7c075180 2024-04-15T00:21:27.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.240+0000 7fc159ffb640 1 -- 172.21.15.31:0/1966349602 <== osd.2 v2:172.21.15.31:6800/225061474 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc15c0cf8f0 con 0x7fc148075090 2024-04-15T00:21:27.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.241+0000 7feca4f1e640 1 -- 172.21.15.31:0/1289891001 --> [v2:172.21.15.50:6816/682288274,v1:172.21.15.50:6817/682288274] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7feca004f540 con 0x7fec80075150 2024-04-15T00:21:27.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.241+0000 7fce9cfd4640 1 -- 172.21.15.31:0/977230053 >> [v2:172.21.15.31:6816/2355720818,v1:172.21.15.31:6817/2355720818] conn(0x7fce7c075180 msgr2=0x7fce7c0775c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.241+0000 7fec8effd640 1 -- 172.21.15.31:0/1289891001 <== osd.6 v2:172.21.15.50:6816/682288274 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7feca004f540 con 0x7fec80075150 2024-04-15T00:21:27.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.241+0000 7fce9cfd4640 1 --2- 172.21.15.31:0/977230053 >> [v2:172.21.15.31:6816/2355720818,v1:172.21.15.31:6817/2355720818] conn(0x7fce7c075180 0x7fce7c0775c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.241+0000 7fce9cfd4640 1 -- 172.21.15.31:0/977230053 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fce7c06ba90 msgr2=0x7fce7c06df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.241+0000 7fce9cfd4640 1 --2- 172.21.15.31:0/977230053 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fce7c06ba90 0x7fce7c06df50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fce8c007fd0 tx=0x7fce8c007c20 comp rx=0 tx=0).stop 2024-04-15T00:21:27.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.241+0000 7fce9cfd4640 1 -- 172.21.15.31:0/977230053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce90038380 msgr2=0x7fce90169670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.241+0000 7fce9cfd4640 1 --2- 172.21.15.31:0/977230053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce90038380 0x7fce90169670 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fce84009fd0 tx=0x7fce8400b870 comp rx=0 tx=0).stop 2024-04-15T00:21:27.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.241+0000 7fce97fff640 1 -- 172.21.15.31:0/977230053 reap_dead start 2024-04-15T00:21:27.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.241+0000 7fc1477fe640 1 -- 172.21.15.31:0/1966349602 >> [v2:172.21.15.31:6800/225061474,v1:172.21.15.31:6801/225061474] conn(0x7fc148075090 msgr2=0x7fc1480774d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.241+0000 7fc1477fe640 1 --2- 172.21.15.31:0/1966349602 >> [v2:172.21.15.31:6800/225061474,v1:172.21.15.31:6801/225061474] conn(0x7fc148075090 0x7fc1480774d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.242+0000 7fc1477fe640 1 -- 172.21.15.31:0/1966349602 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc14806b990 msgr2=0x7fc14806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.242+0000 7fc1477fe640 1 --2- 172.21.15.31:0/1966349602 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc14806b990 0x7fc14806de50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc16000a8b0 tx=0x7fc160008040 comp rx=0 tx=0).stop 2024-04-15T00:21:27.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.242+0000 7fec8cff9640 1 -- 172.21.15.31:0/1289891001 >> [v2:172.21.15.50:6816/682288274,v1:172.21.15.50:6817/682288274] conn(0x7fec80075150 msgr2=0x7fec80077590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.242+0000 7fec8cff9640 1 --2- 172.21.15.31:0/1289891001 >> [v2:172.21.15.50:6816/682288274,v1:172.21.15.50:6817/682288274] conn(0x7fec80075150 0x7fec80077590 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.242+0000 7fc1477fe640 1 -- 172.21.15.31:0/1966349602 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc15c039ea0 msgr2=0x7fc15c0380f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.242+0000 7fc1477fe640 1 --2- 172.21.15.31:0/1966349602 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc15c039ea0 0x7fc15c0380f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc16402d740 tx=0x7fc164069eb0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.242+0000 7fce9cfd4640 1 -- 172.21.15.31:0/977230053 shutdown_connections 2024-04-15T00:21:27.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.242+0000 7fc169dac640 1 -- 172.21.15.31:0/1966349602 reap_dead start 2024-04-15T00:21:27.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.242+0000 7fce9cfd4640 1 -- 172.21.15.31:0/977230053 >> 172.21.15.31:0/977230053 conn(0x7fce9003abc0 msgr2=0x7fce900d1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.242+0000 7fc2c57fa640 1 -- 172.21.15.31:0/1659016300 --> [v2:172.21.15.50:6800/1279970071,v1:172.21.15.50:6801/1279970071] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc2b8002dd0 con 0x7fc2cc0751e0 2024-04-15T00:21:27.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.242+0000 7fec8cff9640 1 -- 172.21.15.31:0/1289891001 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fec8006b9e0 msgr2=0x7fec8006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.242+0000 7fec8cff9640 1 --2- 172.21.15.31:0/1289891001 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fec8006b9e0 0x7fec8006dea0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fec98036000 tx=0x7fec98030000 comp rx=0 tx=0).stop 2024-04-15T00:21:27.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.242+0000 7fec8cff9640 1 -- 172.21.15.31:0/1289891001 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feca01e10f0 msgr2=0x7feca01d9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.242+0000 7fec8cff9640 1 --2- 172.21.15.31:0/1289891001 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7feca01e10f0 0x7feca01d9800 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fec9000e5e0 tx=0x7fec9000eaa0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.242+0000 7fec9ed9d640 1 -- 172.21.15.31:0/1289891001 reap_dead start 2024-04-15T00:21:27.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.242+0000 7fe7b74c8640 1 -- 172.21.15.31:0/2001924345 --> [v2:172.21.15.50:6824/4129060906,v1:172.21.15.50:6825/4129060906] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe7b004f540 con 0x7fe794075200 2024-04-15T00:21:27.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.242+0000 7fc1477fe640 1 -- 172.21.15.31:0/1966349602 shutdown_connections 2024-04-15T00:21:27.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.242+0000 7fce9cfd4640 1 -- 172.21.15.31:0/977230053 shutdown_connections 2024-04-15T00:21:27.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.242+0000 7fce9cfd4640 1 -- 172.21.15.31:0/977230053 wait complete. 2024-04-15T00:21:27.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.242+0000 7fec8cff9640 1 -- 172.21.15.31:0/1289891001 shutdown_connections 2024-04-15T00:21:27.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.242+0000 7fec8cff9640 1 -- 172.21.15.31:0/1289891001 >> 172.21.15.31:0/1289891001 conn(0x7feca00b5510 msgr2=0x7feca00b3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.242+0000 7fc1477fe640 1 -- 172.21.15.31:0/1966349602 >> 172.21.15.31:0/1966349602 conn(0x7fc15c00ab30 msgr2=0x7fc15c0cebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.243+0000 7fc1477fe640 1 -- 172.21.15.31:0/1966349602 shutdown_connections 2024-04-15T00:21:27.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.243+0000 7fec8cff9640 1 -- 172.21.15.31:0/1289891001 shutdown_connections 2024-04-15T00:21:27.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.243+0000 7f7c648dd640 1 -- 172.21.15.31:0/2772854060 --> [v2:172.21.15.31:6808/2705297130,v1:172.21.15.31:6809/2705297130] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7c600b8080 con 0x7f7c6006cf10 2024-04-15T00:21:27.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.243+0000 7fc1477fe640 1 -- 172.21.15.31:0/1966349602 wait complete. 2024-04-15T00:21:27.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.243+0000 7fec8cff9640 1 -- 172.21.15.31:0/1289891001 wait complete. 2024-04-15T00:21:27.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.243+0000 7fe7a5ffb640 1 -- 172.21.15.31:0/2001924345 <== osd.7 v2:172.21.15.50:6824/4129060906 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe7b004f540 con 0x7fe794075200 2024-04-15T00:21:27.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.243+0000 7f7c477fe640 1 -- 172.21.15.31:0/2772854060 <== osd.1 v2:172.21.15.31:6808/2705297130 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7c600b8080 con 0x7f7c6006cf10 2024-04-15T00:21:27.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.243+0000 7fac4f055640 1 -- 172.21.15.31:0/1728034986 --> [v2:172.21.15.50:6808/1589417182,v1:172.21.15.50:6809/1589417182] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fac30002dd0 con 0x7fac2c07d9e0 2024-04-15T00:21:27.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.243+0000 7fc2c77fe640 1 -- 172.21.15.31:0/1659016300 <== osd.4 v2:172.21.15.50:6800/1279970071 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc2b8002dd0 con 0x7fc2cc0751e0 2024-04-15T00:21:27.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.244+0000 7f7c648dd640 1 -- 172.21.15.31:0/2772854060 >> [v2:172.21.15.31:6808/2705297130,v1:172.21.15.31:6809/2705297130] conn(0x7f7c6006cf10 msgr2=0x7f7c60148970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.244+0000 7f7c648dd640 1 --2- 172.21.15.31:0/2772854060 >> [v2:172.21.15.31:6808/2705297130,v1:172.21.15.31:6809/2705297130] conn(0x7f7c6006cf10 0x7f7c60148970 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.244+0000 7f7c648dd640 1 -- 172.21.15.31:0/2772854060 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f7c4c06ba60 msgr2=0x7f7c4c06df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.244+0000 7fc2c57fa640 1 -- 172.21.15.31:0/1659016300 >> [v2:172.21.15.50:6800/1279970071,v1:172.21.15.50:6801/1279970071] conn(0x7fc2cc0751e0 msgr2=0x7fc2cc077620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.244+0000 7fc2c57fa640 1 --2- 172.21.15.31:0/1659016300 >> [v2:172.21.15.50:6800/1279970071,v1:172.21.15.50:6801/1279970071] conn(0x7fc2cc0751e0 0x7fc2cc077620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.244+0000 7fc2c57fa640 1 -- 172.21.15.31:0/1659016300 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc2cc06ba60 msgr2=0x7fc2cc06df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.244+0000 7fac3effd640 1 -- 172.21.15.31:0/1728034986 <== osd.5 v2:172.21.15.50:6808/1589417182 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fac30002dd0 con 0x7fac2c07d9e0 2024-04-15T00:21:27.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.244+0000 7fe7b74c8640 1 -- 172.21.15.31:0/2001924345 >> [v2:172.21.15.50:6824/4129060906,v1:172.21.15.50:6825/4129060906] conn(0x7fe794075200 msgr2=0x7fe794077640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.244+0000 7fe7b74c8640 1 --2- 172.21.15.31:0/2001924345 >> [v2:172.21.15.50:6824/4129060906,v1:172.21.15.50:6825/4129060906] conn(0x7fe794075200 0x7fe794077640 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.244+0000 7fc2c57fa640 1 --2- 172.21.15.31:0/1659016300 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc2cc06ba60 0x7fc2cc06df20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc2d80c5030 tx=0x7fc2d4009040 comp rx=0 tx=0).stop 2024-04-15T00:21:27.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.244+0000 7f7c648dd640 1 --2- 172.21.15.31:0/2772854060 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f7c4c06ba60 0x7f7c4c06df20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7c580012e0 tx=0x7f7c58009040 comp rx=0 tx=0).stop 2024-04-15T00:21:27.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.244+0000 7f7c648dd640 1 -- 172.21.15.31:0/2772854060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c6014fbb0 msgr2=0x7f7c60148430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.244+0000 7f7c648dd640 1 --2- 172.21.15.31:0/2772854060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c6014fbb0 0x7f7c60148430 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7c540097d0 tx=0x7f7c540046c0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.244+0000 7f7c5f59e640 1 -- 172.21.15.31:0/2772854060 reap_dead start 2024-04-15T00:21:27.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.244+0000 7f7c648dd640 1 -- 172.21.15.31:0/2772854060 shutdown_connections 2024-04-15T00:21:27.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.244+0000 7f7c648dd640 1 -- 172.21.15.31:0/2772854060 >> 172.21.15.31:0/2772854060 conn(0x7f7c600b8c60 msgr2=0x7f7c600b7970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.244+0000 7f7c648dd640 1 -- 172.21.15.31:0/2772854060 shutdown_connections 2024-04-15T00:21:27.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.244+0000 7f7c648dd640 1 -- 172.21.15.31:0/2772854060 wait complete. 2024-04-15T00:21:27.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.244+0000 7fc2c57fa640 1 -- 172.21.15.31:0/1659016300 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc2d8036b70 msgr2=0x7fc2d8154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.244+0000 7fc2c57fa640 1 --2- 172.21.15.31:0/1659016300 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc2d8036b70 0x7fc2d8154b80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc2d002bfd0 tx=0x7fc2d00046c0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.244+0000 7fc2df59e640 1 -- 172.21.15.31:0/1659016300 reap_dead start 2024-04-15T00:21:27.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.244+0000 7fe7b74c8640 1 -- 172.21.15.31:0/2001924345 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe79406ba90 msgr2=0x7fe79406df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.244+0000 7fe7b74c8640 1 --2- 172.21.15.31:0/2001924345 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe79406ba90 0x7fe79406df50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe7a00112c0 tx=0x7fe7a0009190 comp rx=0 tx=0).stop 2024-04-15T00:21:27.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.244+0000 7fe7b74c8640 1 -- 172.21.15.31:0/2001924345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7b00ae800 msgr2=0x7fe7b00710d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.244+0000 7fe7b74c8640 1 --2- 172.21.15.31:0/2001924345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7b00ae800 0x7fe7b00710d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac033000 tx=0x7fe7ac0046c0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.244+0000 7fe7b5a65640 1 -- 172.21.15.31:0/2001924345 reap_dead start 2024-04-15T00:21:27.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.244+0000 7fe7b74c8640 1 -- 172.21.15.31:0/2001924345 shutdown_connections 2024-04-15T00:21:27.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.244+0000 7fe7b74c8640 1 -- 172.21.15.31:0/2001924345 >> 172.21.15.31:0/2001924345 conn(0x7fe7b00b5510 msgr2=0x7fe7b01d26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.245+0000 7fc2c57fa640 1 -- 172.21.15.31:0/1659016300 shutdown_connections 2024-04-15T00:21:27.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.245+0000 7fc2c57fa640 1 -- 172.21.15.31:0/1659016300 >> 172.21.15.31:0/1659016300 conn(0x7fc2d803a8a0 msgr2=0x7fc2d80c71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.245+0000 7fac4f055640 1 -- 172.21.15.31:0/1728034986 >> [v2:172.21.15.50:6808/1589417182,v1:172.21.15.50:6809/1589417182] conn(0x7fac2c07d9e0 msgr2=0x7fac2c07fe20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.245+0000 7fac4f055640 1 --2- 172.21.15.31:0/1728034986 >> [v2:172.21.15.50:6808/1589417182,v1:172.21.15.50:6809/1589417182] conn(0x7fac2c07d9e0 0x7fac2c07fe20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.245+0000 7fe7b74c8640 1 -- 172.21.15.31:0/2001924345 shutdown_connections 2024-04-15T00:21:27.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.245+0000 7fe7b74c8640 1 -- 172.21.15.31:0/2001924345 wait complete. 2024-04-15T00:21:27.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.245+0000 7fc2c57fa640 1 -- 172.21.15.31:0/1659016300 shutdown_connections 2024-04-15T00:21:27.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.245+0000 7fc2c57fa640 1 -- 172.21.15.31:0/1659016300 wait complete. 2024-04-15T00:21:27.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.245+0000 7fac4f055640 1 -- 172.21.15.31:0/1728034986 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fac2c074270 msgr2=0x7fac2c076730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.246+0000 7fac4f055640 1 --2- 172.21.15.31:0/1728034986 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fac2c074270 0x7fac2c076730 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fac380094a0 tx=0x7fac38008040 comp rx=0 tx=0).stop 2024-04-15T00:21:27.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.246+0000 7fac4f055640 1 -- 172.21.15.31:0/1728034986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac481427a0 msgr2=0x7fac481430d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.246+0000 7fac4f055640 1 --2- 172.21.15.31:0/1728034986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac481427a0 0x7fac481430d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fac4809ae10 tx=0x7fac40001c20 comp rx=0 tx=0).stop 2024-04-15T00:21:27.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.246+0000 7fac4e854640 1 -- 172.21.15.31:0/1728034986 reap_dead start 2024-04-15T00:21:27.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.246+0000 7fac4f055640 1 -- 172.21.15.31:0/1728034986 shutdown_connections 2024-04-15T00:21:27.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.246+0000 7fac4f055640 1 -- 172.21.15.31:0/1728034986 >> 172.21.15.31:0/1728034986 conn(0x7fac4809edc0 msgr2=0x7fac4813f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.248+0000 7fac4f055640 1 -- 172.21.15.31:0/1728034986 shutdown_connections 2024-04-15T00:21:27.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.248+0000 7fac4f055640 1 -- 172.21.15.31:0/1728034986 wait complete. 2024-04-15T00:21:27.303 INFO:teuthology.orchestra.run.smithi031.stdout:60129542154 2024-04-15T00:21:27.303 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-15T00:21:27.304 INFO:teuthology.orchestra.run.smithi031.stdout:60129542154 2024-04-15T00:21:27.304 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-15T00:21:27.305 INFO:teuthology.orchestra.run.smithi031.stdout:60129542154 2024-04-15T00:21:27.305 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-15T00:21:27.306 INFO:teuthology.orchestra.run.smithi031.stdout:55834574858 2024-04-15T00:21:27.306 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-15T00:21:27.307 INFO:teuthology.orchestra.run.smithi031.stdout:55834574858 2024-04-15T00:21:27.307 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-15T00:21:27.308 INFO:teuthology.orchestra.run.smithi031.stdout:55834574858 2024-04-15T00:21:27.308 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-15T00:21:27.309 INFO:teuthology.orchestra.run.smithi031.stdout:55834574857 2024-04-15T00:21:27.309 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-15T00:21:27.310 INFO:teuthology.orchestra.run.smithi031.stdout:55834574857 2024-04-15T00:21:27.310 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-15T00:21:27.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.508+0000 7f0f91548640 1 Processor -- start 2024-04-15T00:21:27.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.509+0000 7f2c61afc640 1 Processor -- start 2024-04-15T00:21:27.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.508+0000 7f0f91548640 1 -- start start 2024-04-15T00:21:27.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.509+0000 7f0f91548640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0f84036b70 0x7f0f84036510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.509+0000 7f0f91548640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0f84036f50 0x7f0f84033720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.509+0000 7f0f91548640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f84029f60 con 0x7f0f84033c60 2024-04-15T00:21:27.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.509+0000 7f0f91548640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f0f84035590 con 0x7f0f84036f50 2024-04-15T00:21:27.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.509+0000 7f0f91548640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f0f84035e30 con 0x7f0f84036b70 2024-04-15T00:21:27.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.509+0000 7f2c61afc640 1 -- start start 2024-04-15T00:21:27.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.509+0000 7f0f8b7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0f84036f50 0x7f0f84033720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.509+0000 7f0f8b7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0f84036f50 0x7f0f84033720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51794/0 (socket says 172.21.15.31:51794) 2024-04-15T00:21:27.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.509+0000 7f0f8b7fe640 1 -- 172.21.15.31:0/366704392 learned_addr learned my addr 172.21.15.31:0/366704392 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:27.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.509+0000 7f0f8bfff640 1 --2- 172.21.15.31:0/366704392 >> v2:172.21.15.50:3300/0 conn(0x7f0f84036b70 0x7f0f84036510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.510+0000 7f0f8affd640 1 -- 172.21.15.31:0/366704392 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1655470728 0 0) 0x7f0f84029f60 con 0x7f0f84033c60 2024-04-15T00:21:27.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.510+0000 7f0f8affd640 1 -- 172.21.15.31:0/366704392 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f7c003520 con 0x7f0f84033c60 2024-04-15T00:21:27.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.510+0000 7fcd1d5ed640 1 Processor -- start 2024-04-15T00:21:27.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.510+0000 7f2c61afc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2c54038380 0x7f2c540d4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.510+0000 7f2c61afc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2c540d4970 0x7f2c540ca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.510+0000 7f2c61afc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c54036f40 con 0x7f2c54036b60 2024-04-15T00:21:27.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.510+0000 7f2c61afc640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f2c540d0b70 con 0x7f2c54038380 2024-04-15T00:21:27.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.510+0000 7f2c61afc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f2c540d0e50 con 0x7f2c540d4970 2024-04-15T00:21:27.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.510+0000 7f2c612fb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2c540d4970 0x7f2c540ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.511+0000 7f1a1bfff640 1 Processor -- start 2024-04-15T00:21:27.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.511+0000 7f1a1bfff640 1 -- start start 2024-04-15T00:21:27.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.511+0000 7f2c60afa640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2c54036b60 0x7f2c540d1370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.31:46692/0 (socket says 172.21.15.31:46692) 2024-04-15T00:21:27.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.511+0000 7f2c60afa640 1 -- 172.21.15.31:0/2882814568 learned_addr learned my addr 172.21.15.31:0/2882814568 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:27.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.510+0000 7fcd1d5ed640 1 -- start start 2024-04-15T00:21:27.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.511+0000 7f2c5bfff640 1 --2- 172.21.15.31:0/2882814568 >> v2:172.21.15.31:3300/0 conn(0x7f2c54038380 0x7f2c540d4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.510+0000 7f0f8affd640 1 -- 172.21.15.31:0/366704392 <== mon.1 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3516361124 0 0) 0x7f0f7c003520 con 0x7f0f84033c60 2024-04-15T00:21:27.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.510+0000 7f0f8affd640 1 -- 172.21.15.31:0/366704392 >> v2:172.21.15.50:3300/0 conn(0x7f0f84036b70 msgr2=0x7f0f84036510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:27.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.510+0000 7f0f8affd640 1 --2- 172.21.15.31:0/366704392 >> v2:172.21.15.50:3300/0 conn(0x7f0f84036b70 0x7f0f84036510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.510+0000 7f0f8affd640 1 -- 172.21.15.31:0/366704392 >> v2:172.21.15.31:3300/0 conn(0x7f0f84036f50 msgr2=0x7f0f84033720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:27.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.510+0000 7f0f8affd640 1 --2- 172.21.15.31:0/366704392 >> v2:172.21.15.31:3300/0 conn(0x7f0f84036f50 0x7f0f84033720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.510+0000 7f0f8affd640 1 -- 172.21.15.31:0/366704392 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f840357e0 con 0x7f0f84033c60 2024-04-15T00:21:27.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.510+0000 7f0f8affd640 1 -- 172.21.15.31:0/366704392 <== mon.1 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 697057150 0 0) 0x7f0f78001670 con 0x7f0f84033c60 2024-04-15T00:21:27.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.510+0000 7f0f8affd640 1 -- 172.21.15.31:0/366704392 >> v1:172.21.15.50:6789/0 conn(0x7f0f84033c60 legacy=0x7f0f840c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.510+0000 7f0f8affd640 1 --2- 172.21.15.31:0/366704392 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f7c0039b0 0x7f0f7c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.510+0000 7f0f8affd640 1 --2- 172.21.15.31:0/366704392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f7c004800 0x7f0f7c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.510+0000 7f0f8affd640 1 --2- 172.21.15.31:0/366704392 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f7c0099b0 0x7f0f7c0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.510+0000 7f0f8affd640 1 -- 172.21.15.31:0/366704392 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0f84035590 con 0x7f0f7c0039b0 2024-04-15T00:21:27.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.510+0000 7f0f8affd640 1 -- 172.21.15.31:0/366704392 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0f84035e30 con 0x7f0f7c004800 2024-04-15T00:21:27.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.511+0000 7f0f8affd640 1 -- 172.21.15.31:0/366704392 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f0f7c009da0 con 0x7f0f7c0099b0 2024-04-15T00:21:27.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.511+0000 7f0f90d47640 1 --2- 172.21.15.31:0/366704392 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f7c0099b0 0x7f0f7c0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.511+0000 7f2c5b7fe640 1 -- 172.21.15.31:0/2882814568 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2330016407 0 0) 0x7f2c54036f40 con 0x7f2c54036b60 2024-04-15T00:21:27.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.511+0000 7f2c5b7fe640 1 -- 172.21.15.31:0/2882814568 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c4c003520 con 0x7f2c54036b60 2024-04-15T00:21:27.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.511+0000 7fb4ba273640 1 Processor -- start 2024-04-15T00:21:27.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.511+0000 7f0f90d47640 1 -- 172.21.15.31:0/366704392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f7c004800 msgr2=0x7f0f7c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:27.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.511+0000 7f0f8b7fe640 1 --2- 172.21.15.31:0/366704392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f7c004800 0x7f0f7c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.511+0000 7fcd1d5ed640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd180b4d90 0x7fcd180b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.511+0000 7fcd1d5ed640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcd180b6030 0x7fcd180ae510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.511+0000 7fcd1d5ed640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcd1806d790 0x7fcd1806bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.511+0000 7fcd1d5ed640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fcd180adca0 con 0x7fcd1806d790 2024-04-15T00:21:27.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.511+0000 7fcd1d5ed640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fcd180b4900 con 0x7fcd180b6030 2024-04-15T00:21:27.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.511+0000 7fcd1d5ed640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fcd180b00b0 con 0x7fcd180b4d90 2024-04-15T00:21:27.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7f0f90d47640 1 --2- 172.21.15.31:0/366704392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f7c004800 0x7f0f7c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7f0f8bfff640 1 --2- 172.21.15.31:0/366704392 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f7c0039b0 0x7f0f7c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7f0f90d47640 1 -- 172.21.15.31:0/366704392 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f7c0039b0 msgr2=0x7f0f7c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:27.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7f0f90d47640 1 --2- 172.21.15.31:0/366704392 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f7c0039b0 0x7f0f7c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7fcd16ffd640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd180b4d90 0x7fcd180b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7f0f90d47640 1 -- 172.21.15.31:0/366704392 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f840357e0 con 0x7f0f7c0099b0 2024-04-15T00:21:27.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7f0f8b7fe640 1 --2- 172.21.15.31:0/366704392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f7c004800 0x7f0f7c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:21:27.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7f1a1bfff640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1a1c0b57a0 0x7f1a1c0afb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7f1a1bfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1a1c06e680 0x7f1a1c06eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7f0f8bfff640 1 --2- 172.21.15.31:0/366704392 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f7c0039b0 0x7f0f7c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:21:27.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7fcd16ffd640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd180b4d90 0x7fcd180b1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.31:42168/0 (socket says 172.21.15.31:42168) 2024-04-15T00:21:27.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7fcd16ffd640 1 -- 172.21.15.31:0/2125404365 learned_addr learned my addr 172.21.15.31:0/2125404365 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:27.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7f1a1affd640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1a1c0b57a0 0x7f1a1c0afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7f4e746b0640 1 Processor -- start 2024-04-15T00:21:27.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7f1a1bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1a1c066f10 0x7f1a1c067330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7f1a1bfff640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f1a1c06d590 con 0x7f1a1c06e680 2024-04-15T00:21:27.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7f1a1bfff640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f1a1c0af6a0 con 0x7f1a1c066f10 2024-04-15T00:21:27.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7f1a1bfff640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f1a1c0b5b80 con 0x7f1a1c0b57a0 2024-04-15T00:21:27.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7f1a1affd640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1a1c0b57a0 0x7f1a1c0afb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.31:42182/0 (socket says 172.21.15.31:42182) 2024-04-15T00:21:27.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7f1a1affd640 1 -- 172.21.15.31:0/801216604 learned_addr learned my addr 172.21.15.31:0/801216604 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:27.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7f1a1b7fe640 1 --2- 172.21.15.31:0/801216604 >> v2:172.21.15.50:3300/0 conn(0x7f1a1c066f10 0x7f1a1c067330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7f1a1a7fc640 1 --2- 172.21.15.31:0/801216604 >> v2:172.21.15.31:3300/0 conn(0x7f1a1c06e680 0x7f1a1c06eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7f1a1affd640 1 -- 172.21.15.31:0/801216604 >> v2:172.21.15.50:3300/0 conn(0x7f1a1c066f10 msgr2=0x7f1a1c067330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:27.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7f1a1affd640 1 --2- 172.21.15.31:0/801216604 >> v2:172.21.15.50:3300/0 conn(0x7f1a1c066f10 0x7f1a1c067330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7f1a1affd640 1 -- 172.21.15.31:0/801216604 >> v2:172.21.15.31:3300/0 conn(0x7f1a1c06e680 msgr2=0x7f1a1c06eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:27.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7f1a1affd640 1 --2- 172.21.15.31:0/801216604 >> v2:172.21.15.31:3300/0 conn(0x7f1a1c06e680 0x7f1a1c06eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7f1a1affd640 1 -- 172.21.15.31:0/801216604 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a1c0b62d0 con 0x7f1a1c0b57a0 2024-04-15T00:21:27.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.513+0000 7f1a1b7fe640 1 --2- 172.21.15.31:0/801216604 >> v2:172.21.15.50:3300/0 conn(0x7f1a1c066f10 0x7f1a1c067330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:27.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.513+0000 7f0f90d47640 1 -- 172.21.15.31:0/366704392 reap_dead start 2024-04-15T00:21:27.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.513+0000 7f200e836640 1 Processor -- start 2024-04-15T00:21:27.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.513+0000 7f200e836640 1 -- start start 2024-04-15T00:21:27.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7f2c5bfff640 1 -- 172.21.15.31:0/2882814568 >> v2:172.21.15.50:3300/0 conn(0x7f2c540d4970 msgr2=0x7f2c540ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:27.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7f2c5bfff640 1 --2- 172.21.15.31:0/2882814568 >> v2:172.21.15.50:3300/0 conn(0x7f2c540d4970 0x7f2c540ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7f2c5bfff640 1 -- 172.21.15.31:0/2882814568 >> v1:172.21.15.50:6789/0 conn(0x7f2c54036b60 legacy=0x7f2c540d1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7f2c5bfff640 1 -- 172.21.15.31:0/2882814568 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c54034e70 con 0x7f2c54038380 2024-04-15T00:21:27.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.513+0000 7f2c612fb640 1 --2- 172.21.15.31:0/2882814568 >> v2:172.21.15.50:3300/0 conn(0x7f2c540d4970 0x7f2c540ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:27.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.513+0000 7f8558f8c640 1 Processor -- start 2024-04-15T00:21:27.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7fb4ba273640 1 -- start start 2024-04-15T00:21:27.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.513+0000 7fb4ba273640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb4ac036b60 0x7fb4ac036500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.513+0000 7fb4ba273640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb4ac0c8580 0x7fb4ac0c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.513+0000 7fb4ba273640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4ac029f50 con 0x7fb4ac036f40 2024-04-15T00:21:27.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.513+0000 7fb4ba273640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fb4ac035580 con 0x7fb4ac036b60 2024-04-15T00:21:27.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.513+0000 7fb4ba273640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fb4ac035e20 con 0x7fb4ac0c8580 2024-04-15T00:21:27.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7f4e746b0640 1 -- start start 2024-04-15T00:21:27.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7f0f90d47640 1 --2- 172.21.15.31:0/366704392 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f7c0099b0 0x7f0f7c0051e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0f7800c260 tx=0x7f0f7c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdb16eaba0efd815 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7fcd16ffd640 1 -- 172.21.15.31:0/2125404365 >> v2:172.21.15.50:3300/0 conn(0x7fcd180b6030 msgr2=0x7fcd180ae510 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-15T00:21:27.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7fcd16ffd640 1 --2- 172.21.15.31:0/2125404365 >> v2:172.21.15.50:3300/0 conn(0x7fcd180b6030 0x7fcd180ae510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7fcd16ffd640 1 -- 172.21.15.31:0/2125404365 >> v2:172.21.15.31:3300/0 conn(0x7fcd1806d790 msgr2=0x7fcd1806bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:27.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7fcd16ffd640 1 --2- 172.21.15.31:0/2125404365 >> v2:172.21.15.31:3300/0 conn(0x7fcd1806d790 0x7fcd1806bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.512+0000 7fcd16ffd640 1 -- 172.21.15.31:0/2125404365 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd180ad9c0 con 0x7fcd180b4d90 2024-04-15T00:21:27.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7fcd16ffd640 1 --2- 172.21.15.31:0/2125404365 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd180b4d90 0x7fcd180b1f40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcd1806b470 tx=0x7fcd0002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=753e356e3954bdf3 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.513+0000 7f8558f8c640 1 -- start start 2024-04-15T00:21:27.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7f1a1affd640 1 --2- 172.21.15.31:0/801216604 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1a1c0b57a0 0x7f1a1c0afb30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c06d850 tx=0x7f1a0c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f783e3f389c94ee9 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7f200e836640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f200806d960 0x7f20080b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7f200e836640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f20080af000 0x7f20080af460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7f200e836640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2008147170 0x7f20081475e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7f200e836640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f20080b06b0 con 0x7f20080af000 2024-04-15T00:21:27.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7f200e836640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f20080ae4a0 con 0x7f2008147170 2024-04-15T00:21:27.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7f200e836640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f20080aeae0 con 0x7f200806d960 2024-04-15T00:21:27.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.513+0000 7fb4b8a70640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb4ac036f40 0x7fb4ac033710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.31:46698/0 (socket says 172.21.15.31:46698) 2024-04-15T00:21:27.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.513+0000 7fb4b9a72640 1 --2- 172.21.15.31:0/1376044693 >> v2:172.21.15.50:3300/0 conn(0x7fb4ac0c8580 0x7fb4ac0c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.513+0000 7fb4b8a70640 1 -- 172.21.15.31:0/1376044693 learned_addr learned my addr 172.21.15.31:0/1376044693 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:27.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7fb4b9271640 1 --2- 172.21.15.31:0/1376044693 >> v2:172.21.15.31:3300/0 conn(0x7fb4ac036b60 0x7fb4ac036500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7fb4b9a72640 1 -- 172.21.15.31:0/1376044693 >> v2:172.21.15.31:3300/0 conn(0x7fb4ac036b60 msgr2=0x7fb4ac036500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:27.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7fb4b9a72640 1 --2- 172.21.15.31:0/1376044693 >> v2:172.21.15.31:3300/0 conn(0x7fb4ac036b60 0x7fb4ac036500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7fb4b9a72640 1 -- 172.21.15.31:0/1376044693 >> v1:172.21.15.50:6789/0 conn(0x7fb4ac036f40 legacy=0x7fb4ac033710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7fb4a7fff640 1 -- 172.21.15.31:0/1376044693 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1923025642 0 0) 0x7fb4ac029f50 con 0x7fb4ac036f40 2024-04-15T00:21:27.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7fb4b9a72640 1 -- 172.21.15.31:0/1376044693 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4ac0357d0 con 0x7fb4ac0c8580 2024-04-15T00:21:27.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7fb4b9271640 1 --2- 172.21.15.31:0/1376044693 >> v2:172.21.15.31:3300/0 conn(0x7fb4ac036b60 0x7fb4ac036500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:21:27.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.513+0000 7f4e746b0640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4e6c14b4c0 0x7f4e6c1450d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.513+0000 7f4e746b0640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e6c072c90 con 0x7f4e6c0b80d0 2024-04-15T00:21:27.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.513+0000 7f4e746b0640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e6c09c0e0 con 0x7f4e6c0b8be0 2024-04-15T00:21:27.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.513+0000 7f4e746b0640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f4e6c0b84b0 con 0x7f4e6c14b4c0 2024-04-15T00:21:27.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7f4e7244c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4e6c0b80d0 0x7f4e6c14adb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:39426/0 (socket says 172.21.15.31:39426) 2024-04-15T00:21:27.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7f4e7244c640 1 -- 172.21.15.31:0/1996356137 learned_addr learned my addr 172.21.15.31:0/1996356137 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:27.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7f4e72c4d640 1 --2- 172.21.15.31:0/1996356137 >> v2:172.21.15.31:3300/0 conn(0x7f4e6c14b4c0 0x7f4e6c1450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7f1a19ffb640 1 -- 172.21.15.31:0/801216604 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c035020 con 0x7f1a1c0b57a0 2024-04-15T00:21:27.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7f200cdd3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2008147170 0x7f20081475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7f200cdd3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2008147170 0x7f20081475e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.31:37682/0 (socket says 172.21.15.31:37682) 2024-04-15T00:21:27.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7f200cdd3640 1 -- 172.21.15.31:0/1237736456 learned_addr learned my addr 172.21.15.31:0/1237736456 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:27.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7f2007fff640 1 --2- 172.21.15.31:0/1237736456 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f200806d960 0x7f20080b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7fcd15ffb640 1 -- 172.21.15.31:0/2125404365 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd00035020 con 0x7fcd180b4d90 2024-04-15T00:21:27.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7fcd15ffb640 1 -- 172.21.15.31:0/2125404365 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd00031830 con 0x7fcd180b4d90 2024-04-15T00:21:27.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7fcd15ffb640 1 -- 172.21.15.31:0/2125404365 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd00031c40 con 0x7fcd180b4d90 2024-04-15T00:21:27.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7f4e7144a640 1 -- 172.21.15.31:0/1996356137 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1466483409 0 0) 0x7f4e6c072c90 con 0x7f4e6c0b80d0 2024-04-15T00:21:27.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7f4e7144a640 1 -- 172.21.15.31:0/1996356137 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e58003520 con 0x7f4e6c0b80d0 2024-04-15T00:21:27.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.515+0000 7f4e72c4d640 1 -- 172.21.15.31:0/1996356137 >> v1:172.21.15.50:6789/0 conn(0x7f4e6c0b8be0 legacy=0x7f4e6c1449c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.515+0000 7f4e72c4d640 1 -- 172.21.15.31:0/1996356137 >> v1:172.21.15.31:6789/0 conn(0x7f4e6c0b80d0 legacy=0x7f4e6c14adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.515+0000 7f4e72c4d640 1 -- 172.21.15.31:0/1996356137 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e6c09c380 con 0x7f4e6c14b4c0 2024-04-15T00:21:27.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.515+0000 7f8558f8c640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f85540712f0 0x7f855414f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.515+0000 7f8558f8c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f855414f650 0x7f8554156480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.515+0000 7f8558f8c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85540bc540 con 0x7f85540bc160 2024-04-15T00:21:27.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.515+0000 7f8558f8c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f8554071770 con 0x7f855414f650 2024-04-15T00:21:27.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.515+0000 7f8558f8c640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f85540bb280 con 0x7f85540712f0 2024-04-15T00:21:27.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7f1a19ffb640 1 -- 172.21.15.31:0/801216604 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a0c031640 con 0x7f1a1c0b57a0 2024-04-15T00:21:27.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7f1a19ffb640 1 -- 172.21.15.31:0/801216604 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c02d040 con 0x7f1a1c0b57a0 2024-04-15T00:21:27.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.515+0000 7f855259c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f85540bc160 0x7f8554145bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.31:46710/0 (socket says 172.21.15.31:46710) 2024-04-15T00:21:27.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.515+0000 7f1a1bfff640 1 -- 172.21.15.31:0/801216604 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1a1c0b57a0 msgr2=0x7f1a1c0afb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.515+0000 7f1a1bfff640 1 --2- 172.21.15.31:0/801216604 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1a1c0b57a0 0x7f1a1c0afb30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c06d850 tx=0x7f1a0c02b8f0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.515+0000 7f2c5bfff640 1 --2- 172.21.15.31:0/2882814568 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c54038380 0x7f2c540d4430 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2c54038020 tx=0x7f2c4802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2dc87458cfa6f3f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.515+0000 7f855259c640 1 -- 172.21.15.31:0/503329366 learned_addr learned my addr 172.21.15.31:0/503329366 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:27.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.515+0000 7f8552d9d640 1 --2- 172.21.15.31:0/503329366 >> v2:172.21.15.31:3300/0 conn(0x7f855414f650 0x7f8554156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.515+0000 7f1a1bfff640 1 -- 172.21.15.31:0/801216604 shutdown_connections 2024-04-15T00:21:27.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.515+0000 7f1a1bfff640 1 --2- 172.21.15.31:0/801216604 >> v2:172.21.15.50:3300/0 conn(0x7f1a1c066f10 0x7f1a1c067330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.515+0000 7f1a1bfff640 1 --2- 172.21.15.31:0/801216604 >> v2:172.21.15.31:3300/0 conn(0x7f1a1c06e680 0x7f1a1c06eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.515+0000 7f1a1bfff640 1 --2- 172.21.15.31:0/801216604 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1a1c0b57a0 0x7f1a1c0afb30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.515+0000 7f1a1bfff640 1 -- 172.21.15.31:0/801216604 >> 172.21.15.31:0/801216604 conn(0x7f1a1c0b6620 msgr2=0x7f1a1c0b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7f2007fff640 1 -- 172.21.15.31:0/1237736456 >> v2:172.21.15.50:3300/0 conn(0x7f2008147170 msgr2=0x7f20081475e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:27.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7f2007fff640 1 --2- 172.21.15.31:0/1237736456 >> v2:172.21.15.50:3300/0 conn(0x7f2008147170 0x7f20081475e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7f2007fff640 1 -- 172.21.15.31:0/1237736456 >> v2:172.21.15.31:3300/0 conn(0x7f20080af000 msgr2=0x7f20080af460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:27.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7f2007fff640 1 --2- 172.21.15.31:0/1237736456 >> v2:172.21.15.31:3300/0 conn(0x7f20080af000 0x7f20080af460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.514+0000 7f2007fff640 1 -- 172.21.15.31:0/1237736456 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20080b5fb0 con 0x7f200806d960 2024-04-15T00:21:27.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.515+0000 7fcd1d5ed640 1 -- 172.21.15.31:0/2125404365 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd180b4d90 msgr2=0x7fcd180b1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.515+0000 7fcd1d5ed640 1 --2- 172.21.15.31:0/2125404365 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd180b4d90 0x7fcd180b1f40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcd1806b470 tx=0x7fcd0002b8d0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.515+0000 7f1a1bfff640 1 -- 172.21.15.31:0/801216604 shutdown_connections 2024-04-15T00:21:27.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.515+0000 7f1a1bfff640 1 -- 172.21.15.31:0/801216604 wait complete. 2024-04-15T00:21:27.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.515+0000 7f855159a640 1 -- 172.21.15.31:0/503329366 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1357015553 0 0) 0x7f85540bc540 con 0x7f85540bc160 2024-04-15T00:21:27.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.515+0000 7f855159a640 1 -- 172.21.15.31:0/503329366 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f853c003520 con 0x7f85540bc160 2024-04-15T00:21:27.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.515+0000 7f8551d9b640 1 --2- 172.21.15.31:0/503329366 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f85540712f0 0x7f855414f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.515+0000 7f0f8affd640 1 -- 172.21.15.31:0/366704392 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f78039070 con 0x7f0f7c0099b0 2024-04-15T00:21:27.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.516+0000 7f0f8affd640 1 -- 172.21.15.31:0/366704392 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f7802ca70 con 0x7f0f7c0099b0 2024-04-15T00:21:27.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.516+0000 7f0f8affd640 1 -- 172.21.15.31:0/366704392 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f78007cf0 con 0x7f0f7c0099b0 2024-04-15T00:21:27.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.516+0000 7fcd1d5ed640 1 -- 172.21.15.31:0/2125404365 shutdown_connections 2024-04-15T00:21:27.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.516+0000 7fcd1d5ed640 1 --2- 172.21.15.31:0/2125404365 >> v2:172.21.15.31:3300/0 conn(0x7fcd1806d790 0x7fcd1806bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.516+0000 7fcd1d5ed640 1 --2- 172.21.15.31:0/2125404365 >> v2:172.21.15.50:3300/0 conn(0x7fcd180b6030 0x7fcd180ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.516+0000 7fcd1d5ed640 1 --2- 172.21.15.31:0/2125404365 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd180b4d90 0x7fcd180b1f40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.516+0000 7fcd1d5ed640 1 -- 172.21.15.31:0/2125404365 >> 172.21.15.31:0/2125404365 conn(0x7fcd180b5510 msgr2=0x7fcd180b5920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.516+0000 7fcd1d5ed640 1 -- 172.21.15.31:0/2125404365 shutdown_connections 2024-04-15T00:21:27.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.516+0000 7f2007fff640 1 --2- 172.21.15.31:0/1237736456 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f200806d960 0x7f20080b5a70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f20080730b0 tx=0x7f200002be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4e93b1524a999d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.516+0000 7fb4b9a72640 1 --2- 172.21.15.31:0/1376044693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4ac0c8580 0x7fb4ac0c8a30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac037930 tx=0x7fb4a8030000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=253df6f37948a663 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.516+0000 7f2c5b7fe640 1 -- 172.21.15.31:0/2882814568 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c48035020 con 0x7f2c54038380 2024-04-15T00:21:27.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.516+0000 7f2c5b7fe640 1 -- 172.21.15.31:0/2882814568 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c48031870 con 0x7f2c54038380 2024-04-15T00:21:27.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.516+0000 7f2c5b7fe640 1 -- 172.21.15.31:0/2882814568 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c48031c80 con 0x7f2c54038380 2024-04-15T00:21:27.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.516+0000 7fb4a7fff640 1 -- 172.21.15.31:0/1376044693 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a80309a0 con 0x7fb4ac0c8580 2024-04-15T00:21:27.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.516+0000 7fb4a7fff640 1 -- 172.21.15.31:0/1376044693 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4a8030b40 con 0x7fb4ac0c8580 2024-04-15T00:21:27.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.516+0000 7fb4a7fff640 1 -- 172.21.15.31:0/1376044693 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a800a530 con 0x7fb4ac0c8580 2024-04-15T00:21:27.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.516+0000 7f8552d9d640 1 -- 172.21.15.31:0/503329366 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f85540712f0 msgr2=0x7f855414f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:27.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.516+0000 7f8552d9d640 1 --2- 172.21.15.31:0/503329366 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f85540712f0 0x7f855414f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.516+0000 7f8552d9d640 1 -- 172.21.15.31:0/503329366 >> v1:172.21.15.50:6789/0 conn(0x7f85540bc160 legacy=0x7f8554145bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.516+0000 7f8552d9d640 1 -- 172.21.15.31:0/503329366 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85540bc930 con 0x7f855414f650 2024-04-15T00:21:27.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.516+0000 7f4e72c4d640 1 --2- 172.21.15.31:0/1996356137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e6c14b4c0 0x7f4e6c1450d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4e680097a0 tx=0x7f4e6802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae44def39e39729 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.516+0000 7f2006ffd640 1 -- 172.21.15.31:0/1237736456 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2000039070 con 0x7f200806d960 2024-04-15T00:21:27.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.516+0000 7f2006ffd640 1 -- 172.21.15.31:0/1237736456 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f200002cbd0 con 0x7f200806d960 2024-04-15T00:21:27.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.516+0000 7fcd1d5ed640 1 -- 172.21.15.31:0/2125404365 wait complete. 2024-04-15T00:21:27.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.517+0000 7f0f91548640 1 -- 172.21.15.31:0/366704392 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f7c0099b0 msgr2=0x7f0f7c0051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.517+0000 7f0f91548640 1 --2- 172.21.15.31:0/366704392 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f7c0099b0 0x7f0f7c0051e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0f7800c260 tx=0x7f0f7c005830 comp rx=0 tx=0).stop 2024-04-15T00:21:27.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.517+0000 7f0f91548640 1 -- 172.21.15.31:0/366704392 shutdown_connections 2024-04-15T00:21:27.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.517+0000 7f0f91548640 1 --2- 172.21.15.31:0/366704392 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f7c0099b0 0x7f0f7c0051e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.517+0000 7f0f91548640 1 -- 172.21.15.31:0/366704392 >> 172.21.15.31:0/366704392 conn(0x7f0f8403a8a0 msgr2=0x7f0f8403acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.517+0000 7f4e7144a640 1 -- 172.21.15.31:0/1996356137 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e680315a0 con 0x7f4e6c14b4c0 2024-04-15T00:21:27.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.517+0000 7f4e7144a640 1 -- 172.21.15.31:0/1996356137 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e68037070 con 0x7f4e6c14b4c0 2024-04-15T00:21:27.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.517+0000 7f4e7144a640 1 -- 172.21.15.31:0/1996356137 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e68031960 con 0x7f4e6c14b4c0 2024-04-15T00:21:27.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.517+0000 7f2c61afc640 1 -- 172.21.15.31:0/2882814568 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c54038380 msgr2=0x7f2c540d4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.517+0000 7f2c61afc640 1 --2- 172.21.15.31:0/2882814568 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c54038380 0x7f2c540d4430 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2c54038020 tx=0x7f2c4802b910 comp rx=0 tx=0).stop 2024-04-15T00:21:27.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.517+0000 7f1a1bfff640 1 Processor -- start 2024-04-15T00:21:27.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.517+0000 7f200e836640 1 -- 172.21.15.31:0/1237736456 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f200806d960 msgr2=0x7f20080b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.517+0000 7f200e836640 1 --2- 172.21.15.31:0/1237736456 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f200806d960 0x7f20080b5a70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f20080730b0 tx=0x7f200002be20 comp rx=0 tx=0).stop 2024-04-15T00:21:27.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.517+0000 7f2c61afc640 1 -- 172.21.15.31:0/2882814568 shutdown_connections 2024-04-15T00:21:27.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.517+0000 7f2c61afc640 1 --2- 172.21.15.31:0/2882814568 >> v2:172.21.15.50:3300/0 conn(0x7f2c540d4970 0x7f2c540ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.517+0000 7f0f91548640 1 -- 172.21.15.31:0/366704392 shutdown_connections 2024-04-15T00:21:27.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.517+0000 7f200e836640 1 -- 172.21.15.31:0/1237736456 shutdown_connections 2024-04-15T00:21:27.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.517+0000 7f200e836640 1 --2- 172.21.15.31:0/1237736456 >> v2:172.21.15.50:3300/0 conn(0x7f2008147170 0x7f20081475e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.517+0000 7f200e836640 1 --2- 172.21.15.31:0/1237736456 >> v2:172.21.15.31:3300/0 conn(0x7f20080af000 0x7f20080af460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.517+0000 7f200e836640 1 --2- 172.21.15.31:0/1237736456 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f200806d960 0x7f20080b5a70 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f20080730b0 tx=0x7f200002be20 comp rx=0 tx=0).stop 2024-04-15T00:21:27.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.517+0000 7f200e836640 1 -- 172.21.15.31:0/1237736456 >> 172.21.15.31:0/1237736456 conn(0x7f200806c470 msgr2=0x7f200806c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.517+0000 7f2c61afc640 1 --2- 172.21.15.31:0/2882814568 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c54038380 0x7f2c540d4430 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.517+0000 7f2c61afc640 1 -- 172.21.15.31:0/2882814568 >> 172.21.15.31:0/2882814568 conn(0x7f2c5403abc0 msgr2=0x7f2c54005ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.517+0000 7fcd1d5ed640 1 Processor -- start 2024-04-15T00:21:27.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.517+0000 7f1a1bfff640 1 -- start start 2024-04-15T00:21:27.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.517+0000 7f200e836640 1 -- 172.21.15.31:0/1237736456 shutdown_connections 2024-04-15T00:21:27.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.518+0000 7f2c61afc640 1 -- 172.21.15.31:0/2882814568 shutdown_connections 2024-04-15T00:21:27.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.518+0000 7f2c61afc640 1 -- 172.21.15.31:0/2882814568 wait complete. 2024-04-15T00:21:27.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.518+0000 7fb4ba273640 1 -- 172.21.15.31:0/1376044693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4ac0c8580 msgr2=0x7fb4ac0c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.518+0000 7fb4ba273640 1 --2- 172.21.15.31:0/1376044693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4ac0c8580 0x7fb4ac0c8a30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac037930 tx=0x7fb4a8030000 comp rx=0 tx=0).stop 2024-04-15T00:21:27.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.518+0000 7f4e746b0640 1 -- 172.21.15.31:0/1996356137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e6c14b4c0 msgr2=0x7f4e6c1450d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.518+0000 7f4e746b0640 1 --2- 172.21.15.31:0/1996356137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e6c14b4c0 0x7f4e6c1450d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4e680097a0 tx=0x7f4e6802b840 comp rx=0 tx=0).stop 2024-04-15T00:21:27.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.517+0000 7f0f91548640 1 -- 172.21.15.31:0/366704392 wait complete. 2024-04-15T00:21:27.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.518+0000 7f8552d9d640 1 --2- 172.21.15.31:0/503329366 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f855414f650 0x7f8554156480 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f854c009d90 tx=0x7f854c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d064ce19529e061f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.518+0000 7fb4ba273640 1 -- 172.21.15.31:0/1376044693 shutdown_connections 2024-04-15T00:21:27.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.518+0000 7fb4ba273640 1 --2- 172.21.15.31:0/1376044693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4ac0c8580 0x7fb4ac0c8a30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.518+0000 7fb4ba273640 1 --2- 172.21.15.31:0/1376044693 >> v2:172.21.15.31:3300/0 conn(0x7fb4ac036b60 0x7fb4ac036500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.518+0000 7fb4ba273640 1 -- 172.21.15.31:0/1376044693 >> 172.21.15.31:0/1376044693 conn(0x7fb4ac03a890 msgr2=0x7fb4ac03aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.518+0000 7f4e746b0640 1 -- 172.21.15.31:0/1996356137 shutdown_connections 2024-04-15T00:21:27.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.518+0000 7f4e746b0640 1 --2- 172.21.15.31:0/1996356137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e6c14b4c0 0x7f4e6c1450d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.518+0000 7f4e746b0640 1 -- 172.21.15.31:0/1996356137 >> 172.21.15.31:0/1996356137 conn(0x7f4e6c0bd020 msgr2=0x7f4e6c0bd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.518+0000 7f855159a640 1 -- 172.21.15.31:0/503329366 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854c039070 con 0x7f855414f650 2024-04-15T00:21:27.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.518+0000 7f4e746b0640 1 -- 172.21.15.31:0/1996356137 shutdown_connections 2024-04-15T00:21:27.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.518+0000 7f855159a640 1 -- 172.21.15.31:0/503329366 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f854c02cbd0 con 0x7f855414f650 2024-04-15T00:21:27.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.518+0000 7f855159a640 1 -- 172.21.15.31:0/503329366 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854c034440 con 0x7f855414f650 2024-04-15T00:21:27.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.518+0000 7f1a1bfff640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1a1c066f10 0x7f1a1c0b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.518+0000 7f1a1bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a1c06e680 0x7f1a1c1e1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.518+0000 7f1a1bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a1c0b57a0 0x7f1a1c1e1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.518+0000 7f1a1bfff640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1a1c06d100 con 0x7f1a1c0b57a0 2024-04-15T00:21:27.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.518+0000 7f1a1bfff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1a1c06cf80 con 0x7f1a1c06e680 2024-04-15T00:21:27.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.518+0000 7f1a1bfff640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f1a1c067870 con 0x7f1a1c066f10 2024-04-15T00:21:27.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.517+0000 7fcd1d5ed640 1 -- start start 2024-04-15T00:21:27.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.519+0000 7fb4ba273640 1 -- 172.21.15.31:0/1376044693 shutdown_connections 2024-04-15T00:21:27.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.519+0000 7f1a1a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a1c06e680 0x7f1a1c1e1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.519+0000 7f0f91548640 1 Processor -- start 2024-04-15T00:21:27.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.519+0000 7f1a1a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a1c06e680 0x7f1a1c1e1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.31:37688/0 (socket says 172.21.15.31:37688) 2024-04-15T00:21:27.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.518+0000 7fcd1d5ed640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd1806d790 0x7fcd18138630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.518+0000 7fcd1d5ed640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd180b4d90 0x7fcd18147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.518+0000 7fcd1d5ed640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd180b6030 0x7fcd18132bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.518+0000 7fcd1d5ed640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fcd180adef0 con 0x7fcd180b6030 2024-04-15T00:21:27.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.518+0000 7fcd1d5ed640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcd180b5220 con 0x7fcd1806d790 2024-04-15T00:21:27.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.518+0000 7fcd1d5ed640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fcd180ae070 con 0x7fcd180b4d90 2024-04-15T00:21:27.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.519+0000 7f1a1a7fc640 1 -- 172.21.15.31:0/3082506063 learned_addr learned my addr 172.21.15.31:0/3082506063 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:27.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.519+0000 7fcd167fc640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd180b4d90 0x7fcd18147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.519+0000 7fcd167fc640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd180b4d90 0x7fcd18147ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.31:42220/0 (socket says 172.21.15.31:42220) 2024-04-15T00:21:27.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.519+0000 7fcd167fc640 1 -- 172.21.15.31:0/3648352368 learned_addr learned my addr 172.21.15.31:0/3648352368 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:27.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.518+0000 7f4e746b0640 1 -- 172.21.15.31:0/1996356137 wait complete. 2024-04-15T00:21:27.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.519+0000 7fcd167fc640 1 -- 172.21.15.31:0/3648352368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd1806d790 msgr2=0x7fcd18138630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-15T00:21:27.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.519+0000 7fcd167fc640 1 --2- 172.21.15.31:0/3648352368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd1806d790 0x7fcd18138630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.519+0000 7f1a1b7fe640 1 --2- 172.21.15.31:0/3082506063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a1c0b57a0 0x7f1a1c1e1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.519+0000 7fcd167fc640 1 -- 172.21.15.31:0/3648352368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd180b6030 msgr2=0x7fcd18132bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.519+0000 7fcd177fe640 1 --2- 172.21.15.31:0/3648352368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd180b6030 0x7fcd18132bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.519+0000 7f0f91548640 1 -- start start 2024-04-15T00:21:27.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.519+0000 7f8558f8c640 1 -- 172.21.15.31:0/503329366 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f855414f650 msgr2=0x7f8554156480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.519+0000 7f1a1a7fc640 1 -- 172.21.15.31:0/3082506063 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1a1c066f10 msgr2=0x7f1a1c0b1b90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-15T00:21:27.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.519+0000 7f1a1a7fc640 1 --2- 172.21.15.31:0/3082506063 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1a1c066f10 0x7f1a1c0b1b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.519+0000 7f1a1a7fc640 1 -- 172.21.15.31:0/3082506063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a1c0b57a0 msgr2=0x7f1a1c1e1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.519+0000 7fcd167fc640 1 --2- 172.21.15.31:0/3648352368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd180b6030 0x7fcd18132bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.519+0000 7fcd167fc640 1 -- 172.21.15.31:0/3648352368 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd18147bd0 con 0x7fcd180b4d90 2024-04-15T00:21:27.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.519+0000 7f1a1a7fc640 1 --2- 172.21.15.31:0/3082506063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a1c0b57a0 0x7f1a1c1e1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.519+0000 7f1a1a7fc640 1 -- 172.21.15.31:0/3082506063 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a1c0b3110 con 0x7f1a1c06e680 2024-04-15T00:21:27.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.520+0000 7fb4ba273640 1 -- 172.21.15.31:0/1376044693 wait complete. 2024-04-15T00:21:27.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.520+0000 7f2c61afc640 1 Processor -- start 2024-04-15T00:21:27.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.520+0000 7fcd177fe640 1 --2- 172.21.15.31:0/3648352368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd180b6030 0x7fcd18132bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:21:27.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.517+0000 7f200e836640 1 -- 172.21.15.31:0/1237736456 wait complete. 2024-04-15T00:21:27.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.519+0000 7f200e836640 1 Processor -- start 2024-04-15T00:21:27.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.519+0000 7f200e836640 1 -- start start 2024-04-15T00:21:27.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.520+0000 7f2c61afc640 1 -- start start 2024-04-15T00:21:27.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.520+0000 7f0f91548640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f840cbb30 0x7f0f84032b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.520+0000 7fcd167fc640 1 --2- 172.21.15.31:0/3648352368 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd180b4d90 0x7fcd18147ff0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcd0800ba10 tx=0x7fcd0800bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.520+0000 7f0f91548640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f840cbf10 0x7f0f84033040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.519+0000 7f8558f8c640 1 --2- 172.21.15.31:0/503329366 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f855414f650 0x7f8554156480 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f854c009d90 tx=0x7f854c02be20 comp rx=0 tx=0).stop 2024-04-15T00:21:27.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.520+0000 7f200e836640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20080af000 0x7f2008071c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.520+0000 7f4e746b0640 1 Processor -- start 2024-04-15T00:21:27.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.520+0000 7f200e836640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2008147170 0x7f200809d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.520+0000 7f200e836640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2008137480 0x7f200812da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.520+0000 7f200e836640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f20080b2ef0 con 0x7f20080af000 2024-04-15T00:21:27.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.520+0000 7f200e836640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f20080b2d70 con 0x7f2008147170 2024-04-15T00:21:27.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.520+0000 7f200e836640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f20080b4fd0 con 0x7f2008137480 2024-04-15T00:21:27.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.520+0000 7f0f91548640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f8415e710 0x7f0f840c4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.520+0000 7fcd0f7fe640 1 -- 172.21.15.31:0/3648352368 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd08019070 con 0x7fcd180b4d90 2024-04-15T00:21:27.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.520+0000 7fcd0f7fe640 1 -- 172.21.15.31:0/3648352368 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd0800cbd0 con 0x7fcd180b4d90 2024-04-15T00:21:27.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.520+0000 7fcd0f7fe640 1 -- 172.21.15.31:0/3648352368 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd08014440 con 0x7fcd180b4d90 2024-04-15T00:21:27.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.520+0000 7f2007fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20080af000 0x7f2008071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.520+0000 7f2007fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20080af000 0x7f2008071c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51878/0 (socket says 172.21.15.31:51878) 2024-04-15T00:21:27.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.520+0000 7f2007fff640 1 -- 172.21.15.31:0/973044098 learned_addr learned my addr 172.21.15.31:0/973044098 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:27.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.520+0000 7f20077fe640 1 --2- 172.21.15.31:0/973044098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2008147170 0x7f200809d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.520+0000 7f0f8b7fe640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f840cbf10 0x7f0f84033040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.520+0000 7fcd1d5ed640 1 -- 172.21.15.31:0/3648352368 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd18134bc0 con 0x7fcd180b4d90 2024-04-15T00:21:27.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.520+0000 7fcd1d5ed640 1 -- 172.21.15.31:0/3648352368 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd18138070 con 0x7fcd180b4d90 2024-04-15T00:21:27.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.520+0000 7f0f8b7fe640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f840cbf10 0x7f0f84033040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.31:42232/0 (socket says 172.21.15.31:42232) 2024-04-15T00:21:27.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7f200cdd3640 1 --2- 172.21.15.31:0/973044098 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2008137480 0x7f200812da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7f2007fff640 1 -- 172.21.15.31:0/973044098 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2008137480 msgr2=0x7f200812da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7f2007fff640 1 --2- 172.21.15.31:0/973044098 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2008137480 0x7f200812da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7f2007fff640 1 -- 172.21.15.31:0/973044098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2008147170 msgr2=0x7f200809d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7f2007fff640 1 --2- 172.21.15.31:0/973044098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2008147170 0x7f200809d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7f2007fff640 1 -- 172.21.15.31:0/973044098 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f200809dc90 con 0x7f20080af000 2024-04-15T00:21:27.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7f200cdd3640 1 --2- 172.21.15.31:0/973044098 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2008137480 0x7f200812da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:21:27.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.520+0000 7f4e746b0640 1 -- start start 2024-04-15T00:21:27.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.520+0000 7f0f8bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f840cbb30 0x7f0f84032b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7f0f8bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f840cbb30 0x7f0f84032b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.31:37702/0 (socket says 172.21.15.31:37702) 2024-04-15T00:21:27.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7f1a1a7fc640 1 --2- 172.21.15.31:0/3082506063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a1c06e680 0x7f1a1c1e1600 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000d830 tx=0x7f1a1000dcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7f0f91548640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0f84029c80 con 0x7f0f8415e710 2024-04-15T00:21:27.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7f8558f8c640 1 -- 172.21.15.31:0/503329366 shutdown_connections 2024-04-15T00:21:27.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7f8558f8c640 1 --2- 172.21.15.31:0/503329366 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f855414f650 0x7f8554156480 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7f8558f8c640 1 --2- 172.21.15.31:0/503329366 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f85540712f0 0x7f855414f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7f8558f8c640 1 -- 172.21.15.31:0/503329366 >> 172.21.15.31:0/503329366 conn(0x7f85540bcf80 msgr2=0x7f85540bd360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7f4e746b0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e6c0b80d0 0x7f4e6c0b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7f4e746b0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e6c0b8be0 0x7f4e6c0b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7f8558f8c640 1 -- 172.21.15.31:0/503329366 shutdown_connections 2024-04-15T00:21:27.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7f2007fff640 1 --2- 172.21.15.31:0/973044098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20080af000 0x7f2008071c30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f200002c3b0 tx=0x7f2000004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7f0f91548640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0f840362c0 con 0x7f0f840cbb30 2024-04-15T00:21:27.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7f4e746b0640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e6c14b4c0 0x7f4e6c1e14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7f4e746b0640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c0726f0 con 0x7f4e6c0b80d0 2024-04-15T00:21:27.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7f2c61afc640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2c54036b60 0x7f2c5403cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7f4e746b0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c072570 con 0x7f4e6c0b8be0 2024-04-15T00:21:27.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7f4e71c4b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e6c0b8be0 0x7f4e6c0b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7f4e71c4b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e6c0b8be0 0x7f4e6c0b27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.31:37720/0 (socket says 172.21.15.31:37720) 2024-04-15T00:21:27.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7f4e71c4b640 1 -- 172.21.15.31:0/3345486768 learned_addr learned my addr 172.21.15.31:0/3345486768 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:27.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7f4e746b0640 1 -- 172.21.15.31:0/3345486768 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f4e6c072870 con 0x7f4e6c14b4c0 2024-04-15T00:21:27.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7f2c61afc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c54038380 0x7f2c540cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7f2c60afa640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2c54036b60 0x7f2c5403cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7f2004ff9640 1 -- 172.21.15.31:0/973044098 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2000044030 con 0x7f20080af000 2024-04-15T00:21:27.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7f2004ff9640 1 -- 172.21.15.31:0/973044098 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f200003f470 con 0x7f20080af000 2024-04-15T00:21:27.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7f2004ff9640 1 -- 172.21.15.31:0/973044098 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2000039040 con 0x7f20080af000 2024-04-15T00:21:27.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7f200e836640 1 -- 172.21.15.31:0/973044098 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f200809d930 con 0x7f20080af000 2024-04-15T00:21:27.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7f200e836640 1 -- 172.21.15.31:0/973044098 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2008072440 con 0x7f20080af000 2024-04-15T00:21:27.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7f2c60afa640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2c54036b60 0x7f2c5403cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.31:42252/0 (socket says 172.21.15.31:42252) 2024-04-15T00:21:27.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7f2c60afa640 1 -- 172.21.15.31:0/1988832514 learned_addr learned my addr 172.21.15.31:0/1988832514 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:27.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7f2c61afc640 1 --2- 172.21.15.31:0/1988832514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c540d4970 0x7f2c540bb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7f2c61afc640 1 -- 172.21.15.31:0/1988832514 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2c540cb030 con 0x7f2c54038380 2024-04-15T00:21:27.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7f2c61afc640 1 -- 172.21.15.31:0/1988832514 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2c540caeb0 con 0x7f2c540d4970 2024-04-15T00:21:27.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7f2c612fb640 1 --2- 172.21.15.31:0/1988832514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c540d4970 0x7f2c540bb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7f2c61afc640 1 -- 172.21.15.31:0/1988832514 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f2c540db2e0 con 0x7f2c54036b60 2024-04-15T00:21:27.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7f2c60afa640 1 -- 172.21.15.31:0/1988832514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c540d4970 msgr2=0x7f2c540bb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7f2c60afa640 1 --2- 172.21.15.31:0/1988832514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c540d4970 0x7f2c540bb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7f2c60afa640 1 -- 172.21.15.31:0/1988832514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c54038380 msgr2=0x7f2c540cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7f2c60afa640 1 --2- 172.21.15.31:0/1988832514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c54038380 0x7f2c540cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7f2c60afa640 1 -- 172.21.15.31:0/1988832514 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c5403d640 con 0x7f2c54036b60 2024-04-15T00:21:27.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7f2c60afa640 1 --2- 172.21.15.31:0/1988832514 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2c54036b60 0x7f2c5403cbc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2c5000c530 tx=0x7f2c5000c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7f2c597fa640 1 -- 172.21.15.31:0/1988832514 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c50018070 con 0x7f2c54036b60 2024-04-15T00:21:27.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7f2c597fa640 1 -- 172.21.15.31:0/1988832514 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c500075a0 con 0x7f2c54036b60 2024-04-15T00:21:27.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7f2c61afc640 1 -- 172.21.15.31:0/1988832514 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c540d2600 con 0x7f2c54036b60 2024-04-15T00:21:27.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7f2c597fa640 1 -- 172.21.15.31:0/1988832514 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c50004a20 con 0x7f2c54036b60 2024-04-15T00:21:27.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7f2c61afc640 1 -- 172.21.15.31:0/1988832514 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c540d39b0 con 0x7f2c54036b60 2024-04-15T00:21:27.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7f0f91548640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f0f84006ef0 con 0x7f0f840cbf10 2024-04-15T00:21:27.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7f0f8b7fe640 1 -- 172.21.15.31:0/3150457016 learned_addr learned my addr 172.21.15.31:0/3150457016 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:27.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7f0f90d47640 1 --2- 172.21.15.31:0/3150457016 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f8415e710 0x7f0f840c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7f0f8b7fe640 1 -- 172.21.15.31:0/3150457016 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f840cbb30 msgr2=0x7f0f84032b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7f0f8b7fe640 1 --2- 172.21.15.31:0/3150457016 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f840cbb30 0x7f0f84032b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7f0f8b7fe640 1 -- 172.21.15.31:0/3150457016 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f8415e710 msgr2=0x7f0f840c4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7f0f8b7fe640 1 --2- 172.21.15.31:0/3150457016 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f8415e710 0x7f0f840c4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7f0f8b7fe640 1 -- 172.21.15.31:0/3150457016 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f8402b5e0 con 0x7f0f840cbf10 2024-04-15T00:21:27.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7f0f8bfff640 1 --2- 172.21.15.31:0/3150457016 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f840cbb30 0x7f0f84032b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:21:27.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7f0f90d47640 1 --2- 172.21.15.31:0/3150457016 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f8415e710 0x7f0f840c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:21:27.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7fcd1d5ed640 1 -- 172.21.15.31:0/3648352368 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd1804f540 con 0x7fcd180b4d90 2024-04-15T00:21:27.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7f8558f8c640 1 -- 172.21.15.31:0/503329366 wait complete. 2024-04-15T00:21:27.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7f8558f8c640 1 Processor -- start 2024-04-15T00:21:27.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7f8558f8c640 1 -- start start 2024-04-15T00:21:27.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7f1a03fff640 1 -- 172.21.15.31:0/3082506063 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1000b6c0 con 0x7f1a1c06e680 2024-04-15T00:21:27.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7f1a03fff640 1 -- 172.21.15.31:0/3082506063 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a10019070 con 0x7f1a1c06e680 2024-04-15T00:21:27.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7f1a03fff640 1 -- 172.21.15.31:0/3082506063 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1000ba80 con 0x7f1a1c06e680 2024-04-15T00:21:27.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7f1a1bfff640 1 -- 172.21.15.31:0/3082506063 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a1c0b3720 con 0x7f1a1c06e680 2024-04-15T00:21:27.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7f1a1bfff640 1 -- 172.21.15.31:0/3082506063 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a1c0b33b0 con 0x7f1a1c06e680 2024-04-15T00:21:27.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7fb4ba273640 1 Processor -- start 2024-04-15T00:21:27.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.521+0000 7fb4ba273640 1 -- start start 2024-04-15T00:21:27.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7fb4ba273640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4ac036b60 0x7fb4ac0ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7fb4ba273640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4ac036f40 0x7fb4ac15d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7fb4ba273640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4ac0c8580 0x7fb4ac15dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7fb4ba273640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ac029c70 con 0x7fb4ac0c8580 2024-04-15T00:21:27.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7fb4ba273640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ac0362b0 con 0x7fb4ac036b60 2024-04-15T00:21:27.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7fb4ba273640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fb4ac033e20 con 0x7fb4ac036f40 2024-04-15T00:21:27.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7fb4b9a72640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4ac0c8580 0x7fb4ac15dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7fb4b9a72640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4ac0c8580 0x7fb4ac15dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51908/0 (socket says 172.21.15.31:51908) 2024-04-15T00:21:27.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7fb4b9a72640 1 -- 172.21.15.31:0/734900294 learned_addr learned my addr 172.21.15.31:0/734900294 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:27.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7fb4b9271640 1 --2- 172.21.15.31:0/734900294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4ac036b60 0x7fb4ac0ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7fb4b8a70640 1 --2- 172.21.15.31:0/734900294 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4ac036f40 0x7fb4ac15d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7fb4b9a72640 1 -- 172.21.15.31:0/734900294 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4ac036f40 msgr2=0x7fb4ac15d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7fb4b9a72640 1 --2- 172.21.15.31:0/734900294 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4ac036f40 0x7fb4ac15d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7fb4b9a72640 1 -- 172.21.15.31:0/734900294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4ac036b60 msgr2=0x7fb4ac0ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7fb4b9a72640 1 --2- 172.21.15.31:0/734900294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4ac036b60 0x7fb4ac0ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7fb4b9a72640 1 -- 172.21.15.31:0/734900294 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4ac0cb3b0 con 0x7fb4ac0c8580 2024-04-15T00:21:27.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7fb4b9a72640 1 --2- 172.21.15.31:0/734900294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4ac0c8580 0x7fb4ac15dac0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8030610 tx=0x7fb4a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.522+0000 7f4e72c4d640 1 --2- 172.21.15.31:0/3345486768 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e6c14b4c0 0x7f4e6c1e14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7f4e7244c640 1 --2- 172.21.15.31:0/3345486768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e6c0b80d0 0x7f4e6c0b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7f4e71c4b640 1 -- 172.21.15.31:0/3345486768 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e6c14b4c0 msgr2=0x7f4e6c1e14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7f4e71c4b640 1 --2- 172.21.15.31:0/3345486768 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e6c14b4c0 0x7f4e6c1e14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7f4e71c4b640 1 -- 172.21.15.31:0/3345486768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e6c0b80d0 msgr2=0x7f4e6c0b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7f4e71c4b640 1 --2- 172.21.15.31:0/3345486768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e6c0b80d0 0x7f4e6c0b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7f4e71c4b640 1 -- 172.21.15.31:0/3345486768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e6c0b1410 con 0x7f4e6c0b8be0 2024-04-15T00:21:27.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.523+0000 7f4e7244c640 1 --2- 172.21.15.31:0/3345486768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e6c0b80d0 0x7f4e6c0b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:27.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.524+0000 7f4e71c4b640 1 --2- 172.21.15.31:0/3345486768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e6c0b8be0 0x7f4e6c0b27f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4e6400c8a0 tx=0x7f4e6400cd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.524+0000 7fb4a5ffb640 1 -- 172.21.15.31:0/734900294 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a8048020 con 0x7fb4ac0c8580 2024-04-15T00:21:27.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.524+0000 7fb4a5ffb640 1 -- 172.21.15.31:0/734900294 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4a8044880 con 0x7fb4ac0c8580 2024-04-15T00:21:27.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.524+0000 7fb4a5ffb640 1 -- 172.21.15.31:0/734900294 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a8044c30 con 0x7fb4ac0c8580 2024-04-15T00:21:27.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.524+0000 7f0f8b7fe640 1 --2- 172.21.15.31:0/3150457016 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f840cbf10 0x7f0f84033040 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c050d20 tx=0x7f0f8c069460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.524+0000 7fcd0f7fe640 1 -- 172.21.15.31:0/3648352368 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fcd080145e0 con 0x7fcd180b4d90 2024-04-15T00:21:27.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.525+0000 7fcd0f7fe640 1 --2- 172.21.15.31:0/3648352368 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fccf806b9c0 0x7fccf806de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.525+0000 7fcd0f7fe640 1 -- 172.21.15.31:0/3648352368 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fcd0808a8d0 con 0x7fcd180b4d90 2024-04-15T00:21:27.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.524+0000 7f8558f8c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85540712f0 0x7f8554147590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.524+0000 7f8558f8c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85540bc160 0x7f85541e1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.524+0000 7f8558f8c640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f855414f650 0x7f85541e2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.524+0000 7f8558f8c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f85540bbbf0 con 0x7f85540bc160 2024-04-15T00:21:27.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.524+0000 7f8558f8c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f85540baf30 con 0x7f85540712f0 2024-04-15T00:21:27.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.524+0000 7f8558f8c640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f85541569c0 con 0x7f855414f650 2024-04-15T00:21:27.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.524+0000 7f8551d9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85540bc160 0x7f85541e1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.524+0000 7f8551d9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85540bc160 0x7f85541e1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51932/0 (socket says 172.21.15.31:51932) 2024-04-15T00:21:27.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.524+0000 7f8551d9b640 1 -- 172.21.15.31:0/2509125118 learned_addr learned my addr 172.21.15.31:0/2509125118 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:27.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.524+0000 7f855259c640 1 --2- 172.21.15.31:0/2509125118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85540712f0 0x7f8554147590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.525+0000 7f8551d9b640 1 -- 172.21.15.31:0/2509125118 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f855414f650 msgr2=0x7f85541e2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.525+0000 7f8552d9d640 1 --2- 172.21.15.31:0/2509125118 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f855414f650 0x7f85541e2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.525+0000 7f8551d9b640 1 --2- 172.21.15.31:0/2509125118 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f855414f650 0x7f85541e2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.525+0000 7f8551d9b640 1 -- 172.21.15.31:0/2509125118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85540712f0 msgr2=0x7f8554147590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.525+0000 7f8551d9b640 1 --2- 172.21.15.31:0/2509125118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85540712f0 0x7f8554147590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.525+0000 7f8551d9b640 1 -- 172.21.15.31:0/2509125118 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85541469f0 con 0x7f85540bc160 2024-04-15T00:21:27.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.525+0000 7f8552d9d640 1 --2- 172.21.15.31:0/2509125118 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f855414f650 0x7f85541e2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:21:27.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.525+0000 7f1a1bfff640 1 -- 172.21.15.31:0/3082506063 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a1c04f540 con 0x7f1a1c06e680 2024-04-15T00:21:27.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.525+0000 7f4e62ffd640 1 -- 172.21.15.31:0/3345486768 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e64003b70 con 0x7f4e6c0b8be0 2024-04-15T00:21:27.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.525+0000 7f4e62ffd640 1 -- 172.21.15.31:0/3345486768 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e64003d30 con 0x7f4e6c0b8be0 2024-04-15T00:21:27.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.525+0000 7f855259c640 1 --2- 172.21.15.31:0/2509125118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85540712f0 0x7f8554147590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:21:27.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.525+0000 7f8551d9b640 1 --2- 172.21.15.31:0/2509125118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85540bc160 0x7f85541e1ef0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f854800e9b0 tx=0x7f854800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.525+0000 7f2c61afc640 1 -- 172.21.15.31:0/1988832514 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c540052c0 con 0x7f2c54036b60 2024-04-15T00:21:27.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.526+0000 7f0f88ff9640 1 -- 172.21.15.31:0/3150457016 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c099070 con 0x7f0f840cbf10 2024-04-15T00:21:27.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.526+0000 7f0f91548640 1 -- 172.21.15.31:0/3150457016 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f840c5780 con 0x7f0f840cbf10 2024-04-15T00:21:27.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.526+0000 7f2c597fa640 1 -- 172.21.15.31:0/1988832514 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f2c50004bc0 con 0x7f2c54036b60 2024-04-15T00:21:27.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.526+0000 7fcd16ffd640 1 --2- 172.21.15.31:0/3648352368 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fccf806b9c0 0x7fccf806de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.526+0000 7f0f91548640 1 -- 172.21.15.31:0/3150457016 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f8415e1f0 con 0x7f0f840cbf10 2024-04-15T00:21:27.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.526+0000 7f8542ffd640 1 -- 172.21.15.31:0/2509125118 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8548017070 con 0x7f85540bc160 2024-04-15T00:21:27.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.526+0000 7f8542ffd640 1 -- 172.21.15.31:0/2509125118 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f854800c9a0 con 0x7f85540bc160 2024-04-15T00:21:27.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.526+0000 7f8542ffd640 1 -- 172.21.15.31:0/2509125118 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854800cd90 con 0x7f85540bc160 2024-04-15T00:21:27.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.526+0000 7f4e746b0640 1 -- 172.21.15.31:0/3345486768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e6c09fdb0 con 0x7f4e6c0b8be0 2024-04-15T00:21:27.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.526+0000 7f4e746b0640 1 -- 172.21.15.31:0/3345486768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e6c071570 con 0x7f4e6c0b8be0 2024-04-15T00:21:27.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.526+0000 7f4e62ffd640 1 -- 172.21.15.31:0/3345486768 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6400aa90 con 0x7f4e6c0b8be0 2024-04-15T00:21:27.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.526+0000 7f8558f8c640 1 -- 172.21.15.31:0/2509125118 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85541e59a0 con 0x7f85540bc160 2024-04-15T00:21:27.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.526+0000 7f200e836640 1 -- 172.21.15.31:0/973044098 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fe8005290 con 0x7f20080af000 2024-04-15T00:21:27.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.526+0000 7f2c597fa640 1 --2- 172.21.15.31:0/1988832514 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f2c4006b9c0 0x7f2c4006de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.526+0000 7f8558f8c640 1 -- 172.21.15.31:0/2509125118 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8554145600 con 0x7f85540bc160 2024-04-15T00:21:27.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.526+0000 7f2c597fa640 1 -- 172.21.15.31:0/1988832514 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2c50089dc0 con 0x7f2c54036b60 2024-04-15T00:21:27.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.526+0000 7f1a03fff640 1 -- 172.21.15.31:0/3082506063 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f1a1001e460 con 0x7f1a1c06e680 2024-04-15T00:21:27.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.527+0000 7f1a03fff640 1 --2- 172.21.15.31:0/3082506063 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f1a0806ba60 0x7f1a0806df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.527+0000 7f1a03fff640 1 -- 172.21.15.31:0/3082506063 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1a1008b0d0 con 0x7f1a1c06e680 2024-04-15T00:21:27.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.527+0000 7f1a1affd640 1 --2- 172.21.15.31:0/3082506063 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f1a0806ba60 0x7f1a0806df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.526+0000 7f2004ff9640 1 -- 172.21.15.31:0/973044098 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f2000047070 con 0x7f20080af000 2024-04-15T00:21:27.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.527+0000 7f2004ff9640 1 --2- 172.21.15.31:0/973044098 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f1ff406ba60 0x7f1ff406df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.527+0000 7f4e746b0640 1 -- 172.21.15.31:0/3345486768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e6c09f730 con 0x7f4e6c0b8be0 2024-04-15T00:21:27.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.527+0000 7f2004ff9640 1 -- 172.21.15.31:0/973044098 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f20000acec0 con 0x7f20080af000 2024-04-15T00:21:27.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.527+0000 7f0f88ff9640 1 -- 172.21.15.31:0/3150457016 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f8c069590 con 0x7f0f840cbf10 2024-04-15T00:21:27.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.527+0000 7f1a1affd640 1 --2- 172.21.15.31:0/3082506063 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f1a0806ba60 0x7f1a0806df20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c036000 tx=0x7f1a0c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.525+0000 7fb4ba273640 1 -- 172.21.15.31:0/734900294 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4ac0cc240 con 0x7fb4ac0c8580 2024-04-15T00:21:27.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.526+0000 7fb4ba273640 1 -- 172.21.15.31:0/734900294 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4ac0c9920 con 0x7fb4ac0c8580 2024-04-15T00:21:27.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.528+0000 7f4e62ffd640 1 -- 172.21.15.31:0/3345486768 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f4e6400ac30 con 0x7f4e6c0b8be0 2024-04-15T00:21:27.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.527+0000 7f0f767fc640 1 -- 172.21.15.31:0/3150457016 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f6c005290 con 0x7f0f840cbf10 2024-04-15T00:21:27.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.528+0000 7f0f88ff9640 1 -- 172.21.15.31:0/3150457016 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c073780 con 0x7f0f840cbf10 2024-04-15T00:21:27.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.528+0000 7f20077fe640 1 --2- 172.21.15.31:0/973044098 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f1ff406ba60 0x7f1ff406df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.528+0000 7f4e62ffd640 1 --2- 172.21.15.31:0/3345486768 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f4e5006ba10 0x7f4e5006ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.528+0000 7f8542ffd640 1 -- 172.21.15.31:0/2509125118 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f854801a070 con 0x7f85540bc160 2024-04-15T00:21:27.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.529+0000 7fb4ba273640 1 -- 172.21.15.31:0/734900294 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4ac0052b0 con 0x7fb4ac0c8580 2024-04-15T00:21:27.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.529+0000 7f2c5bfff640 1 --2- 172.21.15.31:0/1988832514 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f2c4006b9c0 0x7f2c4006de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.529+0000 7f8542ffd640 1 --2- 172.21.15.31:0/2509125118 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f853406b9e0 0x7f853406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.529+0000 7f8542ffd640 1 -- 172.21.15.31:0/2509125118 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f854808aa20 con 0x7f85540bc160 2024-04-15T00:21:27.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.529+0000 7f20077fe640 1 --2- 172.21.15.31:0/973044098 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f1ff406ba60 0x7f1ff406df20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2008068530 tx=0x7f1ffc009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.529+0000 7f2c5bfff640 1 --2- 172.21.15.31:0/1988832514 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f2c4006b9c0 0x7f2c4006de80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2c48036000 tx=0x7f2c48030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.529+0000 7fcd16ffd640 1 --2- 172.21.15.31:0/3648352368 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fccf806b9c0 0x7fccf806de80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcd00036000 tx=0x7fcd00008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.529+0000 7f855259c640 1 --2- 172.21.15.31:0/2509125118 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f853406b9e0 0x7f853406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.529+0000 7f4e7244c640 1 --2- 172.21.15.31:0/3345486768 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f4e5006ba10 0x7f4e5006ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.529+0000 7f8558f8c640 1 -- 172.21.15.31:0/2509125118 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8538005290 con 0x7f85540bc160 2024-04-15T00:21:27.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.530+0000 7f4e7244c640 1 --2- 172.21.15.31:0/3345486768 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f4e5006ba10 0x7f4e5006ded0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c000c00 tx=0x7f4e5c007cf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.530+0000 7f855259c640 1 --2- 172.21.15.31:0/2509125118 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f853406b9e0 0x7f853406dea0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8544000f60 tx=0x7f8544007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.530+0000 7fcd0f7fe640 1 -- 172.21.15.31:0/3648352368 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fcd08059110 con 0x7fcd180b4d90 2024-04-15T00:21:27.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.531+0000 7f4e62ffd640 1 -- 172.21.15.31:0/3345486768 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4e64056cd0 con 0x7f4e6c0b8be0 2024-04-15T00:21:27.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.531+0000 7f1a03fff640 1 -- 172.21.15.31:0/3082506063 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f1a10059a10 con 0x7f1a1c06e680 2024-04-15T00:21:27.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.534+0000 7f2c597fa640 1 -- 172.21.15.31:0/1988832514 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2c50058030 con 0x7f2c54036b60 2024-04-15T00:21:27.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.536+0000 7f4e62ffd640 1 -- 172.21.15.31:0/3345486768 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4e64058c30 con 0x7f4e6c0b8be0 2024-04-15T00:21:27.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.536+0000 7f0f88ff9640 1 -- 172.21.15.31:0/3150457016 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f0f8c09c070 con 0x7f0f840cbf10 2024-04-15T00:21:27.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.536+0000 7f0f88ff9640 1 --2- 172.21.15.31:0/3150457016 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f0f7006ba90 0x7f0f7006df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.537+0000 7f0f88ff9640 1 -- 172.21.15.31:0/3150457016 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0f8c106580 con 0x7f0f840cbf10 2024-04-15T00:21:27.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.536+0000 7f2004ff9640 1 -- 172.21.15.31:0/973044098 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f200004e070 con 0x7f20080af000 2024-04-15T00:21:27.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.537+0000 7f0f8bfff640 1 --2- 172.21.15.31:0/3150457016 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f0f7006ba90 0x7f0f7006df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.537+0000 7f0f8bfff640 1 --2- 172.21.15.31:0/3150457016 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f0f7006ba90 0x7f0f7006df50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0f840be7a0 tx=0x7f0f80008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.539+0000 7fb4a5ffb640 1 -- 172.21.15.31:0/734900294 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fb4a804b020 con 0x7fb4ac0c8580 2024-04-15T00:21:27.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.539+0000 7f0f88ff9640 1 -- 172.21.15.31:0/3150457016 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0f8c0d4870 con 0x7f0f840cbf10 2024-04-15T00:21:27.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.539+0000 7fb4a5ffb640 1 --2- 172.21.15.31:0/734900294 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb49806b9e0 0x7fb49806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:27.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.540+0000 7fb4b9271640 1 --2- 172.21.15.31:0/734900294 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb49806b9e0 0x7fb49806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:27.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.540+0000 7fb4b9271640 1 --2- 172.21.15.31:0/734900294 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb49806b9e0 0x7fb49806dea0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4068910 tx=0x7fb4b4068fe0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:27.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.546+0000 7fb4a5ffb640 1 -- 172.21.15.31:0/734900294 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb4a807e240 con 0x7fb4ac0c8580 2024-04-15T00:21:27.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.546+0000 7f8542ffd640 1 -- 172.21.15.31:0/2509125118 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f85541e59a0 con 0x7f85540bc160 2024-04-15T00:21:27.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.554+0000 7fb4a5ffb640 1 -- 172.21.15.31:0/734900294 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb4a8052030 con 0x7fb4ac0c8580 2024-04-15T00:21:27.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.951+0000 7f1a1bfff640 1 -- 172.21.15.31:0/3082506063 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f1a1c070a20 con 0x7f1a1c06e680 2024-04-15T00:21:27.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.952+0000 7f1a03fff640 1 -- 172.21.15.31:0/3082506063 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1a10059310 con 0x7f1a1c06e680 2024-04-15T00:21:27.959 INFO:teuthology.orchestra.run.smithi031.stdout:55834574857 2024-04-15T00:21:27.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.955+0000 7f1a01ffb640 1 -- 172.21.15.31:0/3082506063 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f1a0806ba60 msgr2=0x7f1a0806df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.955+0000 7f1a01ffb640 1 --2- 172.21.15.31:0/3082506063 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f1a0806ba60 0x7f1a0806df20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c036000 tx=0x7f1a0c008030 comp rx=0 tx=0).stop 2024-04-15T00:21:27.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.955+0000 7f1a01ffb640 1 -- 172.21.15.31:0/3082506063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a1c06e680 msgr2=0x7f1a1c1e1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.955+0000 7f1a01ffb640 1 --2- 172.21.15.31:0/3082506063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a1c06e680 0x7f1a1c1e1600 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000d830 tx=0x7f1a1000dcf0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.955+0000 7f1a01ffb640 1 -- 172.21.15.31:0/3082506063 shutdown_connections 2024-04-15T00:21:27.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.955+0000 7f1a01ffb640 1 --2- 172.21.15.31:0/3082506063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a1c0b57a0 0x7f1a1c1e1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.955+0000 7f1a01ffb640 1 --2- 172.21.15.31:0/3082506063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a1c06e680 0x7f1a1c1e1600 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.955+0000 7f1a01ffb640 1 --2- 172.21.15.31:0/3082506063 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f1a0806ba60 0x7f1a0806df20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.955+0000 7f1a01ffb640 1 --2- 172.21.15.31:0/3082506063 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1a1c066f10 0x7f1a1c0b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.955+0000 7f1a01ffb640 1 -- 172.21.15.31:0/3082506063 >> 172.21.15.31:0/3082506063 conn(0x7f1a1c0b6620 msgr2=0x7f1a1c1d06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.956+0000 7f1a01ffb640 1 -- 172.21.15.31:0/3082506063 shutdown_connections 2024-04-15T00:21:27.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.956+0000 7f1a01ffb640 1 -- 172.21.15.31:0/3082506063 wait complete. 2024-04-15T00:21:27.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.956+0000 7f2c61afc640 1 -- 172.21.15.31:0/1988832514 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f2c540353c0 con 0x7f2c54036b60 2024-04-15T00:21:27.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.957+0000 7f2c597fa640 1 -- 172.21.15.31:0/1988832514 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2c5005c0d0 con 0x7f2c54036b60 2024-04-15T00:21:27.964 INFO:teuthology.orchestra.run.smithi031.stdout:60129542152 2024-04-15T00:21:27.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.960+0000 7f2c46ffd640 1 -- 172.21.15.31:0/1988832514 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f2c4006b9c0 msgr2=0x7f2c4006de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.961+0000 7f2c46ffd640 1 --2- 172.21.15.31:0/1988832514 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f2c4006b9c0 0x7f2c4006de80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2c48036000 tx=0x7f2c48030000 comp rx=0 tx=0).stop 2024-04-15T00:21:27.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.961+0000 7f2c46ffd640 1 -- 172.21.15.31:0/1988832514 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2c54036b60 msgr2=0x7f2c5403cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.961+0000 7f2c46ffd640 1 --2- 172.21.15.31:0/1988832514 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2c54036b60 0x7f2c5403cbc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2c5000c530 tx=0x7f2c5000c9f0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.961+0000 7f2c46ffd640 1 -- 172.21.15.31:0/1988832514 shutdown_connections 2024-04-15T00:21:27.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.961+0000 7f2c46ffd640 1 --2- 172.21.15.31:0/1988832514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c540d4970 0x7f2c540bb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.961+0000 7f2c46ffd640 1 --2- 172.21.15.31:0/1988832514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c54038380 0x7f2c540cfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.961+0000 7f2c46ffd640 1 --2- 172.21.15.31:0/1988832514 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f2c4006b9c0 0x7f2c4006de80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.961+0000 7f2c46ffd640 1 --2- 172.21.15.31:0/1988832514 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2c54036b60 0x7f2c5403cbc0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.961+0000 7f2c46ffd640 1 -- 172.21.15.31:0/1988832514 >> 172.21.15.31:0/1988832514 conn(0x7f2c5403abc0 msgr2=0x7f2c540c9680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.962+0000 7f2c46ffd640 1 -- 172.21.15.31:0/1988832514 shutdown_connections 2024-04-15T00:21:27.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.962+0000 7f2c46ffd640 1 -- 172.21.15.31:0/1988832514 wait complete. 2024-04-15T00:21:27.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.962+0000 7f0f767fc640 1 -- 172.21.15.31:0/3150457016 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f0f6c005850 con 0x7f0f840cbf10 2024-04-15T00:21:27.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.963+0000 7f0f88ff9640 1 -- 172.21.15.31:0/3150457016 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0f8c0d8910 con 0x7f0f840cbf10 2024-04-15T00:21:27.970 INFO:teuthology.orchestra.run.smithi031.stdout:60129542152 2024-04-15T00:21:27.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.964+0000 7fcd1d5ed640 1 -- 172.21.15.31:0/3648352368 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fcd180b6c20 con 0x7fcd180b4d90 2024-04-15T00:21:27.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.964+0000 7fcd0f7fe640 1 -- 172.21.15.31:0/3648352368 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcd08058a10 con 0x7fcd180b4d90 2024-04-15T00:21:27.973 INFO:teuthology.orchestra.run.smithi031.stdout:60129542152 2024-04-15T00:21:27.973 INFO:teuthology.orchestra.run.smithi031.stdout:55834574857 2024-04-15T00:21:27.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.965+0000 7f200e836640 1 -- 172.21.15.31:0/973044098 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f1fe8005580 con 0x7f20080af000 2024-04-15T00:21:27.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.965+0000 7f2004ff9640 1 -- 172.21.15.31:0/973044098 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f200004e070 con 0x7f20080af000 2024-04-15T00:21:27.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.965+0000 7f4e746b0640 1 -- 172.21.15.31:0/3345486768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f4e6c04f600 con 0x7f4e6c0b8be0 2024-04-15T00:21:27.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.966+0000 7f4e62ffd640 1 -- 172.21.15.31:0/3345486768 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4e6405ccd0 con 0x7f4e6c0b8be0 2024-04-15T00:21:27.974 INFO:teuthology.orchestra.run.smithi031.stdout:55834574856 2024-04-15T00:21:27.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.967+0000 7f0f767fc640 1 -- 172.21.15.31:0/3150457016 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f0f7006ba90 msgr2=0x7f0f7006df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.967+0000 7f0f767fc640 1 --2- 172.21.15.31:0/3150457016 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f0f7006ba90 0x7f0f7006df50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0f840be7a0 tx=0x7f0f80008040 comp rx=0 tx=0).stop 2024-04-15T00:21:27.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.967+0000 7f0f767fc640 1 -- 172.21.15.31:0/3150457016 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f840cbf10 msgr2=0x7f0f84033040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.967+0000 7f0f767fc640 1 --2- 172.21.15.31:0/3150457016 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f840cbf10 0x7f0f84033040 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c050d20 tx=0x7f0f8c069460 comp rx=0 tx=0).stop 2024-04-15T00:21:27.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.967+0000 7f0f767fc640 1 -- 172.21.15.31:0/3150457016 shutdown_connections 2024-04-15T00:21:27.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.967+0000 7f0f767fc640 1 --2- 172.21.15.31:0/3150457016 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f8415e710 0x7f0f840c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.968+0000 7fcd1d5ed640 1 -- 172.21.15.31:0/3648352368 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fccf806b9c0 msgr2=0x7fccf806de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.968+0000 7fcd1d5ed640 1 --2- 172.21.15.31:0/3648352368 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fccf806b9c0 0x7fccf806de80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcd00036000 tx=0x7fcd00008030 comp rx=0 tx=0).stop 2024-04-15T00:21:27.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.968+0000 7fcd1d5ed640 1 -- 172.21.15.31:0/3648352368 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd180b4d90 msgr2=0x7fcd18147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.968+0000 7fcd1d5ed640 1 --2- 172.21.15.31:0/3648352368 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd180b4d90 0x7fcd18147ff0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcd0800ba10 tx=0x7fcd0800bed0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.967+0000 7f0f767fc640 1 --2- 172.21.15.31:0/3150457016 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f0f7006ba90 0x7f0f7006df50 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0f840be7a0 tx=0x7f0f80008040 comp rx=0 tx=0).stop 2024-04-15T00:21:27.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.968+0000 7fcd1d5ed640 1 -- 172.21.15.31:0/3648352368 shutdown_connections 2024-04-15T00:21:27.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.968+0000 7fcd1d5ed640 1 --2- 172.21.15.31:0/3648352368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd180b6030 0x7fcd18132bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.968+0000 7fcd1d5ed640 1 --2- 172.21.15.31:0/3648352368 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fccf806b9c0 0x7fccf806de80 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcd00036000 tx=0x7fcd00008030 comp rx=0 tx=0).stop 2024-04-15T00:21:27.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.968+0000 7fcd1d5ed640 1 --2- 172.21.15.31:0/3648352368 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcd180b4d90 0x7fcd18147ff0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.968+0000 7fcd1d5ed640 1 --2- 172.21.15.31:0/3648352368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd1806d790 0x7fcd18138630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.968+0000 7fcd1d5ed640 1 -- 172.21.15.31:0/3648352368 >> 172.21.15.31:0/3648352368 conn(0x7fcd180b5510 msgr2=0x7fcd180b7420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.967+0000 7f0f767fc640 1 --2- 172.21.15.31:0/3150457016 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f0f840cbf10 0x7f0f84033040 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c050d20 tx=0x7f0f8c069460 comp rx=0 tx=0).stop 2024-04-15T00:21:27.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.967+0000 7f0f767fc640 1 --2- 172.21.15.31:0/3150457016 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f840cbb30 0x7f0f84032b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.967+0000 7f0f767fc640 1 -- 172.21.15.31:0/3150457016 >> 172.21.15.31:0/3150457016 conn(0x7f0f8403a8a0 msgr2=0x7f0f840c1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.968+0000 7f0f767fc640 1 -- 172.21.15.31:0/3150457016 shutdown_connections 2024-04-15T00:21:27.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.968+0000 7f0f767fc640 1 -- 172.21.15.31:0/3150457016 wait complete. 2024-04-15T00:21:27.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.968+0000 7fcd1d5ed640 1 -- 172.21.15.31:0/3648352368 shutdown_connections 2024-04-15T00:21:27.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.968+0000 7fcd1d5ed640 1 -- 172.21.15.31:0/3648352368 wait complete. 2024-04-15T00:21:27.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.969+0000 7f200e836640 1 -- 172.21.15.31:0/973044098 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f1ff406ba60 msgr2=0x7f1ff406df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.969+0000 7f200e836640 1 --2- 172.21.15.31:0/973044098 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f1ff406ba60 0x7f1ff406df20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2008068530 tx=0x7f1ffc009110 comp rx=0 tx=0).stop 2024-04-15T00:21:27.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.969+0000 7f200e836640 1 -- 172.21.15.31:0/973044098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20080af000 msgr2=0x7f2008071c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.969+0000 7f200e836640 1 --2- 172.21.15.31:0/973044098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20080af000 0x7f2008071c30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f200002c3b0 tx=0x7f2000004a40 comp rx=0 tx=0).stop 2024-04-15T00:21:27.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.970+0000 7f200e836640 1 -- 172.21.15.31:0/973044098 shutdown_connections 2024-04-15T00:21:27.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.970+0000 7f200e836640 1 --2- 172.21.15.31:0/973044098 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f1ff406ba60 0x7f1ff406df20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.970+0000 7f200e836640 1 --2- 172.21.15.31:0/973044098 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2008137480 0x7f200812da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.970+0000 7f200e836640 1 --2- 172.21.15.31:0/973044098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2008147170 0x7f200809d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.970+0000 7f200e836640 1 --2- 172.21.15.31:0/973044098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20080af000 0x7f2008071c30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.970+0000 7f200e836640 1 -- 172.21.15.31:0/973044098 >> 172.21.15.31:0/973044098 conn(0x7f200806c470 msgr2=0x7f20080b3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.970+0000 7f8558f8c640 1 -- 172.21.15.31:0/2509125118 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f8538005850 con 0x7f85540bc160 2024-04-15T00:21:27.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.971+0000 7f200e836640 1 -- 172.21.15.31:0/973044098 shutdown_connections 2024-04-15T00:21:27.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.971+0000 7f200e836640 1 -- 172.21.15.31:0/973044098 wait complete. 2024-04-15T00:21:27.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.971+0000 7f4e746b0640 1 -- 172.21.15.31:0/3345486768 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f4e5006ba10 msgr2=0x7f4e5006ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.971+0000 7f4e746b0640 1 --2- 172.21.15.31:0/3345486768 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f4e5006ba10 0x7f4e5006ded0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c000c00 tx=0x7f4e5c007cf0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.971+0000 7f4e746b0640 1 -- 172.21.15.31:0/3345486768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e6c0b8be0 msgr2=0x7f4e6c0b27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.971+0000 7f4e746b0640 1 --2- 172.21.15.31:0/3345486768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e6c0b8be0 0x7f4e6c0b27f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4e6400c8a0 tx=0x7f4e6400cd60 comp rx=0 tx=0).stop 2024-04-15T00:21:27.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.971+0000 7f8542ffd640 1 -- 172.21.15.31:0/2509125118 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8548058e10 con 0x7f85540bc160 2024-04-15T00:21:27.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.971+0000 7f4e746b0640 1 -- 172.21.15.31:0/3345486768 shutdown_connections 2024-04-15T00:21:27.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.971+0000 7f4e746b0640 1 --2- 172.21.15.31:0/3345486768 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f4e5006ba10 0x7f4e5006ded0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.971+0000 7f4e746b0640 1 --2- 172.21.15.31:0/3345486768 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4e6c14b4c0 0x7f4e6c1e14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.971+0000 7f4e746b0640 1 --2- 172.21.15.31:0/3345486768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e6c0b8be0 0x7f4e6c0b27f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.971+0000 7f4e746b0640 1 --2- 172.21.15.31:0/3345486768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e6c0b80d0 0x7f4e6c0b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.971+0000 7f4e746b0640 1 -- 172.21.15.31:0/3345486768 >> 172.21.15.31:0/3345486768 conn(0x7f4e6c0bd020 msgr2=0x7f4e6c1493e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.971+0000 7f4e746b0640 1 -- 172.21.15.31:0/3345486768 shutdown_connections 2024-04-15T00:21:27.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.971+0000 7f4e746b0640 1 -- 172.21.15.31:0/3345486768 wait complete. 2024-04-15T00:21:27.983 INFO:teuthology.orchestra.run.smithi031.stdout:55834574857 2024-04-15T00:21:27.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.6 2024-04-15T00:21:27.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.975+0000 7f8558f8c640 1 -- 172.21.15.31:0/2509125118 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f853406b9e0 msgr2=0x7f853406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.975+0000 7f8558f8c640 1 --2- 172.21.15.31:0/2509125118 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f853406b9e0 0x7f853406dea0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8544000f60 tx=0x7f8544007d30 comp rx=0 tx=0).stop 2024-04-15T00:21:27.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.975+0000 7f8558f8c640 1 -- 172.21.15.31:0/2509125118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85540bc160 msgr2=0x7f85541e1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.975+0000 7f8558f8c640 1 --2- 172.21.15.31:0/2509125118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85540bc160 0x7f85541e1ef0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f854800e9b0 tx=0x7f854800ee70 comp rx=0 tx=0).stop 2024-04-15T00:21:27.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.976+0000 7f8558f8c640 1 -- 172.21.15.31:0/2509125118 shutdown_connections 2024-04-15T00:21:27.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.976+0000 7f8558f8c640 1 --2- 172.21.15.31:0/2509125118 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f853406b9e0 0x7f853406dea0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.976+0000 7f8558f8c640 1 --2- 172.21.15.31:0/2509125118 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f855414f650 0x7f85541e2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.976+0000 7f8558f8c640 1 --2- 172.21.15.31:0/2509125118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85540bc160 0x7f85541e1ef0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.976+0000 7f8558f8c640 1 --2- 172.21.15.31:0/2509125118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85540712f0 0x7f8554147590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.976+0000 7f8558f8c640 1 -- 172.21.15.31:0/2509125118 >> 172.21.15.31:0/2509125118 conn(0x7f85540bcf80 msgr2=0x7f85540b8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.976+0000 7f8558f8c640 1 -- 172.21.15.31:0/2509125118 shutdown_connections 2024-04-15T00:21:27.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.976+0000 7f8558f8c640 1 -- 172.21.15.31:0/2509125118 wait complete. 2024-04-15T00:21:27.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.980+0000 7fb4ba273640 1 -- 172.21.15.31:0/734900294 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb4ac0c80d0 con 0x7fb4ac0c8580 2024-04-15T00:21:27.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.981+0000 7fb4a5ffb640 1 -- 172.21.15.31:0/734900294 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb4a80808a0 con 0x7fb4ac0c8580 2024-04-15T00:21:27.989 INFO:teuthology.orchestra.run.smithi031.stdout:55834574856 2024-04-15T00:21:27.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542152 for osd.0 2024-04-15T00:21:27.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.985+0000 7fb4ba273640 1 -- 172.21.15.31:0/734900294 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb49806b9e0 msgr2=0x7fb49806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.985+0000 7fb4ba273640 1 --2- 172.21.15.31:0/734900294 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb49806b9e0 0x7fb49806dea0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4068910 tx=0x7fb4b4068fe0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.985+0000 7fb4ba273640 1 -- 172.21.15.31:0/734900294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4ac0c8580 msgr2=0x7fb4ac15dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:27.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.985+0000 7fb4ba273640 1 --2- 172.21.15.31:0/734900294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4ac0c8580 0x7fb4ac15dac0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8030610 tx=0x7fb4a80046c0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.985+0000 7fb4ba273640 1 -- 172.21.15.31:0/734900294 shutdown_connections 2024-04-15T00:21:27.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.985+0000 7fb4ba273640 1 --2- 172.21.15.31:0/734900294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4ac0c8580 0x7fb4ac15dac0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.985+0000 7fb4ba273640 1 --2- 172.21.15.31:0/734900294 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb49806b9e0 0x7fb49806dea0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.985+0000 7fb4ba273640 1 --2- 172.21.15.31:0/734900294 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4ac036f40 0x7fb4ac15d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.985+0000 7fb4ba273640 1 --2- 172.21.15.31:0/734900294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4ac036b60 0x7fb4ac0ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:27.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.985+0000 7fb4ba273640 1 -- 172.21.15.31:0/734900294 >> 172.21.15.31:0/734900294 conn(0x7fb4ac03a890 msgr2=0x7fb4ac0054c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:27.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.985+0000 7fb4ba273640 1 -- 172.21.15.31:0/734900294 shutdown_connections 2024-04-15T00:21:27.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:27.985+0000 7fb4ba273640 1 -- 172.21.15.31:0/734900294 wait complete. 2024-04-15T00:21:27.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542152 for osd.3 2024-04-15T00:21:27.998 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542152 for osd.2 2024-04-15T00:21:27.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2024-04-15T00:21:28.000 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.1 2024-04-15T00:21:28.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2024-04-15T00:21:28.006 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2024-04-15T00:21:28.984 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-15T00:21:28.991 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-15T00:21:28.998 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-15T00:21:28.999 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-15T00:21:29.000 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-15T00:21:29.000 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-15T00:21:29.003 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-15T00:21:29.007 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-15T00:21:29.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.143+0000 7f313359e640 1 Processor -- start 2024-04-15T00:21:29.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.143+0000 7f313359e640 1 -- start start 2024-04-15T00:21:29.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.144+0000 7f313359e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f312c0e43f0 0x7f312c0f6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.144+0000 7f313359e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f312c036330 con 0x7f312c0e3f90 2024-04-15T00:21:29.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.144+0000 7f313359e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f312c036f80 con 0x7f312c036ba0 2024-04-15T00:21:29.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.144+0000 7f313359e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f312c0ea590 con 0x7f312c0e43f0 2024-04-15T00:21:29.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.145+0000 7f3132d9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f312c0e43f0 0x7f312c0f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.145+0000 7f3132d9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f312c0e43f0 0x7f312c0f6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51940/0 (socket says 172.21.15.31:51940) 2024-04-15T00:21:29.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.145+0000 7f3132d9d640 1 -- 172.21.15.31:0/2953801911 learned_addr learned my addr 172.21.15.31:0/2953801911 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:29.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.145+0000 7f3132d9d640 1 -- 172.21.15.31:0/2953801911 >> v1:172.21.15.50:6789/0 conn(0x7f312c036ba0 legacy=0x7f312c0eaa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:29.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.145+0000 7f3132d9d640 1 -- 172.21.15.31:0/2953801911 >> v1:172.21.15.31:6789/0 conn(0x7f312c0e3f90 legacy=0x7f312c0f2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.146+0000 7f3132d9d640 1 -- 172.21.15.31:0/2953801911 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f312c037b70 con 0x7f312c0e43f0 2024-04-15T00:21:29.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.147+0000 7f3132d9d640 1 --2- 172.21.15.31:0/2953801911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f312c0e43f0 0x7f312c0f6250 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f312c0ea710 tx=0x7f3134069eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6b41ee19c0866f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:29.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.147+0000 7f313159a640 1 -- 172.21.15.31:0/2953801911 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313409f710 con 0x7f312c0e43f0 2024-04-15T00:21:29.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.148+0000 7f313159a640 1 -- 172.21.15.31:0/2953801911 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f313409f8d0 con 0x7f312c0e43f0 2024-04-15T00:21:29.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.149+0000 7f313359e640 1 -- 172.21.15.31:0/2953801911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f312c0e43f0 msgr2=0x7f312c0f6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.149+0000 7f313359e640 1 --2- 172.21.15.31:0/2953801911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f312c0e43f0 0x7f312c0f6250 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f312c0ea710 tx=0x7f3134069eb0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.149+0000 7f313359e640 1 -- 172.21.15.31:0/2953801911 shutdown_connections 2024-04-15T00:21:29.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.149+0000 7f313359e640 1 --2- 172.21.15.31:0/2953801911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f312c0e43f0 0x7f312c0f6250 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.149+0000 7f313359e640 1 -- 172.21.15.31:0/2953801911 >> 172.21.15.31:0/2953801911 conn(0x7f312c03a8a0 msgr2=0x7f312c03acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:29.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.149+0000 7f313359e640 1 -- 172.21.15.31:0/2953801911 shutdown_connections 2024-04-15T00:21:29.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.149+0000 7f313359e640 1 -- 172.21.15.31:0/2953801911 wait complete. 2024-04-15T00:21:29.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.151+0000 7f313359e640 1 Processor -- start 2024-04-15T00:21:29.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.151+0000 7f313359e640 1 -- start start 2024-04-15T00:21:29.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.152+0000 7f313359e640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f312c036ba0 0x7f312c02b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.152+0000 7f313359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f312c0e3f90 0x7f312c02c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.152+0000 7f313359e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f312c0e43f0 0x7f312c0e7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.152+0000 7f313359e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f312c038380 con 0x7f312c0e43f0 2024-04-15T00:21:29.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.152+0000 7f313359e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f312c0eb130 con 0x7f312c0e3f90 2024-04-15T00:21:29.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.152+0000 7f313359e640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f312c037510 con 0x7f312c036ba0 2024-04-15T00:21:29.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.153+0000 7f3132d9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f312c0e43f0 0x7f312c0e7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.153+0000 7f3132d9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f312c0e43f0 0x7f312c0e7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51950/0 (socket says 172.21.15.31:51950) 2024-04-15T00:21:29.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.153+0000 7f3132d9d640 1 -- 172.21.15.31:0/2946825613 learned_addr learned my addr 172.21.15.31:0/2946825613 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:29.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.153+0000 7f313259c640 1 --2- 172.21.15.31:0/2946825613 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f312c036ba0 0x7f312c02b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.153+0000 7f3131d9b640 1 --2- 172.21.15.31:0/2946825613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f312c0e3f90 0x7f312c02c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.153+0000 7f3132d9d640 1 -- 172.21.15.31:0/2946825613 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f312c036ba0 msgr2=0x7f312c02b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.153+0000 7f3132d9d640 1 --2- 172.21.15.31:0/2946825613 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f312c036ba0 0x7f312c02b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.153+0000 7f3132d9d640 1 -- 172.21.15.31:0/2946825613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f312c0e3f90 msgr2=0x7f312c02c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.153+0000 7f3132d9d640 1 --2- 172.21.15.31:0/2946825613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f312c0e3f90 0x7f312c02c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.153+0000 7f3132d9d640 1 -- 172.21.15.31:0/2946825613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f312c0e25c0 con 0x7f312c0e43f0 2024-04-15T00:21:29.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.154+0000 7f3132d9d640 1 --2- 172.21.15.31:0/2946825613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f312c0e43f0 0x7f312c0e7250 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3134050a90 tx=0x7f31340750c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:29.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.155+0000 7f3122ffd640 1 -- 172.21.15.31:0/2946825613 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31340ae020 con 0x7f312c0e43f0 2024-04-15T00:21:29.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.155+0000 7f313359e640 1 -- 172.21.15.31:0/2946825613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f312c02e100 con 0x7f312c0e43f0 2024-04-15T00:21:29.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.155+0000 7f313359e640 1 -- 172.21.15.31:0/2946825613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f312c0e7790 con 0x7f312c0e43f0 2024-04-15T00:21:29.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.156+0000 7f3122ffd640 1 -- 172.21.15.31:0/2946825613 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31340aa650 con 0x7f312c0e43f0 2024-04-15T00:21:29.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.157+0000 7f3122ffd640 1 -- 172.21.15.31:0/2946825613 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313409f730 con 0x7f312c0e43f0 2024-04-15T00:21:29.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.158+0000 7f3122ffd640 1 -- 172.21.15.31:0/2946825613 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f31340b1020 con 0x7f312c0e43f0 2024-04-15T00:21:29.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.158+0000 7f3122ffd640 1 --2- 172.21.15.31:0/2946825613 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f311406ba60 0x7f311406df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.159+0000 7f313259c640 1 --2- 172.21.15.31:0/2946825613 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f311406ba60 0x7f311406df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.159+0000 7f313259c640 1 --2- 172.21.15.31:0/2946825613 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f311406ba60 0x7f311406df20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3128004fb0 tx=0x7f3128007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:29.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.160+0000 7f3122ffd640 1 -- 172.21.15.31:0/2946825613 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3134117d50 con 0x7f312c0e43f0 2024-04-15T00:21:29.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.160+0000 7f313359e640 1 -- 172.21.15.31:0/2946825613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3118005290 con 0x7f312c0e43f0 2024-04-15T00:21:29.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.170+0000 7f3122ffd640 1 -- 172.21.15.31:0/2946825613 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f31340b8030 con 0x7f312c0e43f0 2024-04-15T00:21:29.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.198+0000 7fe07c091640 1 Processor -- start 2024-04-15T00:21:29.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.198+0000 7fe07c091640 1 -- start start 2024-04-15T00:21:29.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.199+0000 7fd9baf7b640 1 Processor -- start 2024-04-15T00:21:29.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.199+0000 7fe07c091640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe074067180 0x7fe0740b0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.199+0000 7fe07c091640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe0740af930 0x7fe07406b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.199+0000 7fe07c091640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe074067560 con 0x7fe0740b4c20 2024-04-15T00:21:29.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.199+0000 7fe07c091640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fe0740b50b0 con 0x7fe074067180 2024-04-15T00:21:29.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.199+0000 7fe07c091640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe0740afdc0 con 0x7fe0740af930 2024-04-15T00:21:29.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.200+0000 7fe079e2d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe074067180 0x7fe0740b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.200+0000 7fe079e2d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe074067180 0x7fe0740b0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51956/0 (socket says 172.21.15.31:51956) 2024-04-15T00:21:29.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.200+0000 7fe079e2d640 1 -- 172.21.15.31:0/406735140 learned_addr learned my addr 172.21.15.31:0/406735140 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:29.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.200+0000 7fe07a62e640 1 --2- 172.21.15.31:0/406735140 >> v2:172.21.15.50:3300/0 conn(0x7fe0740af930 0x7fe07406b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.199+0000 7fd9baf7b640 1 -- start start 2024-04-15T00:21:29.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.200+0000 7fd9baf7b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd9b40b5760 0x7fd9b4144280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.200+0000 7fd9baf7b640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd9b40af220 0x7fd9b413e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.201+0000 7fd9baf7b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9b40b5b40 con 0x7fd9b40aed50 2024-04-15T00:21:29.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.201+0000 7fd9baf7b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fd9b40af890 con 0x7fd9b40b5760 2024-04-15T00:21:29.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.201+0000 7fd9baf7b640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fd9b40afb70 con 0x7fd9b40af220 2024-04-15T00:21:29.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.201+0000 7fd9b9518640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd9b40af220 0x7fd9b413e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.201+0000 7fd9b9518640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd9b40af220 0x7fd9b413e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.31:42308/0 (socket says 172.21.15.31:42308) 2024-04-15T00:21:29.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.201+0000 7fd9b9518640 1 -- 172.21.15.31:0/3501188610 learned_addr learned my addr 172.21.15.31:0/3501188610 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:29.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.201+0000 7fd9b8d17640 1 --2- 172.21.15.31:0/3501188610 >> v2:172.21.15.50:3300/0 conn(0x7fd9b40b5760 0x7fd9b4144280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.201+0000 7fd9b9518640 1 -- 172.21.15.31:0/3501188610 >> v2:172.21.15.50:3300/0 conn(0x7fd9b40b5760 msgr2=0x7fd9b4144280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:29.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.200+0000 7fe079e2d640 1 -- 172.21.15.31:0/406735140 >> v2:172.21.15.50:3300/0 conn(0x7fe0740af930 msgr2=0x7fe07406b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:29.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.200+0000 7fe079e2d640 1 --2- 172.21.15.31:0/406735140 >> v2:172.21.15.50:3300/0 conn(0x7fe0740af930 0x7fe07406b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.200+0000 7fe079e2d640 1 -- 172.21.15.31:0/406735140 >> v1:172.21.15.31:6789/0 conn(0x7fe0740b4c20 legacy=0x7fe07406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.201+0000 7fccd3fff640 1 Processor -- start 2024-04-15T00:21:29.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.201+0000 7f2ca49cb640 1 Processor -- start 2024-04-15T00:21:29.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.201+0000 7fd9b9518640 1 --2- 172.21.15.31:0/3501188610 >> v2:172.21.15.50:3300/0 conn(0x7fd9b40b5760 0x7fd9b4144280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.201+0000 7fd9b9518640 1 -- 172.21.15.31:0/3501188610 >> v1:172.21.15.31:6789/0 conn(0x7fd9b40aed50 legacy=0x7fd9b413deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.201+0000 7fd9b9518640 1 -- 172.21.15.31:0/3501188610 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9b406ed30 con 0x7fd9b40af220 2024-04-15T00:21:29.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.201+0000 7fd9b8d17640 1 --2- 172.21.15.31:0/3501188610 >> v2:172.21.15.50:3300/0 conn(0x7fd9b40b5760 0x7fd9b4144280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:21:29.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.200+0000 7fe079e2d640 1 -- 172.21.15.31:0/406735140 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe07409f250 con 0x7fe074067180 2024-04-15T00:21:29.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.201+0000 7fccd3fff640 1 -- start start 2024-04-15T00:21:29.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.202+0000 7fd9b9518640 1 --2- 172.21.15.31:0/3501188610 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd9b40af220 0x7fd9b413e5c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac009e80 tx=0x7fd9ac02bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e554c940ad8919b server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:29.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.203+0000 7fd9b37fe640 1 -- 172.21.15.31:0/3501188610 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac02ca80 con 0x7fd9b40af220 2024-04-15T00:21:29.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.203+0000 7fd9b37fe640 1 -- 172.21.15.31:0/3501188610 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9ac02cc20 con 0x7fd9b40af220 2024-04-15T00:21:29.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.201+0000 7f5a8a62f640 1 Processor -- start 2024-04-15T00:21:29.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.202+0000 7f5a8a62f640 1 -- start start 2024-04-15T00:21:29.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.203+0000 7f5a8a62f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5a7c037160 0x7f5a7c036350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.203+0000 7f5a8a62f640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5a7c033700 0x7f5a7c033b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.203+0000 7f5a8a62f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a7c02a030 con 0x7f5a7c0357e0 2024-04-15T00:21:29.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.203+0000 7f5a8a62f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f5a7c034cd0 con 0x7f5a7c037160 2024-04-15T00:21:29.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.203+0000 7f5a8a62f640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f5a7c035bc0 con 0x7f5a7c033700 2024-04-15T00:21:29.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.203+0000 7f2acb27c640 1 Processor -- start 2024-04-15T00:21:29.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.202+0000 7fccd3fff640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcccc0369c0 0x7fcccc0cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.202+0000 7fccd3fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcccc035a90 0x7fcccc033600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.203+0000 7fccd2ffd640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcccc0369c0 0x7fcccc0cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.203+0000 7fccd2ffd640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcccc0369c0 0x7fcccc0cc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.31:42324/0 (socket says 172.21.15.31:42324) 2024-04-15T00:21:29.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.203+0000 7fccd2ffd640 1 -- 172.21.15.31:0/1379105365 learned_addr learned my addr 172.21.15.31:0/1379105365 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:29.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.203+0000 7fccd3fff640 1 -- 172.21.15.31:0/1379105365 --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcccc0cca00 con 0x7fcccc034590 2024-04-15T00:21:29.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.203+0000 7fccd3fff640 1 -- 172.21.15.31:0/1379105365 --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fcccc035600 con 0x7fcccc035a90 2024-04-15T00:21:29.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.203+0000 7fccd3fff640 1 -- 172.21.15.31:0/1379105365 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fcccc037b70 con 0x7fcccc0369c0 2024-04-15T00:21:29.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.203+0000 7fccd27fc640 1 --2- 172.21.15.31:0/1379105365 >> v2:172.21.15.31:3300/0 conn(0x7fcccc035a90 0x7fcccc033600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.201+0000 7f2ca49cb640 1 -- start start 2024-04-15T00:21:29.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.203+0000 7f2ca49cb640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2c98038a30 0x7f2c980c2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.203+0000 7f2ca49cb640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2c98037b10 0x7f2c980c3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.203+0000 7f2ca49cb640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c980380c0 con 0x7f2c98037060 2024-04-15T00:21:29.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.203+0000 7f2ca49cb640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f2c980ca230 con 0x7f2c98038a30 2024-04-15T00:21:29.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.203+0000 7f2c9ffff640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2c98037b10 0x7f2c980c3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.203+0000 7f2c9effd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2c98038a30 0x7f2c980c2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.203+0000 7f2c9ffff640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2c98037b10 0x7f2c980c3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.31:42348/0 (socket says 172.21.15.31:42348) 2024-04-15T00:21:29.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.203+0000 7f2c9effd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2c98038a30 0x7f2c980c2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51972/0 (socket says 172.21.15.31:51972) 2024-04-15T00:21:29.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.203+0000 7f2c9ffff640 1 -- 172.21.15.31:0/625221770 learned_addr learned my addr 172.21.15.31:0/625221770 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:29.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.203+0000 7f2c9f7fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f2c98037060 0x7f2c980c9b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:39446/0 (socket says 172.21.15.31:39446) 2024-04-15T00:21:29.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.203+0000 7f2ca49cb640 1 -- 172.21.15.31:0/625221770 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f2c980c9320 con 0x7f2c98037b10 2024-04-15T00:21:29.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.204+0000 7fd9b37fe640 1 -- 172.21.15.31:0/3501188610 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac0343f0 con 0x7fd9b40af220 2024-04-15T00:21:29.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.204+0000 7f5a8b891640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5a7c033700 0x7f5a7c033b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.204+0000 7f5a8962d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5a7c0357e0 0x7f5a7c0cbb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.31:46728/0 (socket says 172.21.15.31:46728) 2024-04-15T00:21:29.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.204+0000 7fd9baf7b640 1 -- 172.21.15.31:0/3501188610 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd9b40af220 msgr2=0x7fd9b413e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.204+0000 7fd9baf7b640 1 --2- 172.21.15.31:0/3501188610 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd9b40af220 0x7fd9b413e5c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac009e80 tx=0x7fd9ac02bee0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.204+0000 7f5a8962d640 1 -- 172.21.15.31:0/1740748166 learned_addr learned my addr 172.21.15.31:0/1740748166 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:29.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.203+0000 7f2acb27c640 1 -- start start 2024-04-15T00:21:29.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.204+0000 7f2c9ffff640 1 -- 172.21.15.31:0/625221770 >> v2:172.21.15.31:3300/0 conn(0x7f2c98038a30 msgr2=0x7f2c980c2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:29.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.204+0000 7f2c9ffff640 1 --2- 172.21.15.31:0/625221770 >> v2:172.21.15.31:3300/0 conn(0x7f2c98038a30 0x7f2c980c2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.204+0000 7f2c9ffff640 1 -- 172.21.15.31:0/625221770 >> v1:172.21.15.31:6789/0 conn(0x7f2c98037060 legacy=0x7f2c980c9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.204+0000 7fe079e2d640 1 --2- 172.21.15.31:0/406735140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe074067180 0x7fe0740b0590 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe074073080 tx=0x7fe06c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67cb6b87190f964 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:29.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.204+0000 7f2acb27c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2ac413d690 0x7f2ac4143e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.204+0000 7f2acb27c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2ac40b3240 0x7f2ac40b8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.204+0000 7f2acb27c640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ac41433d0 con 0x7f2ac41469c0 2024-04-15T00:21:29.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.204+0000 7f2acb27c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f2ac41439c0 con 0x7f2ac413d690 2024-04-15T00:21:29.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.204+0000 7f2acb27c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f2ac4144390 con 0x7f2ac40b3240 2024-04-15T00:21:29.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.204+0000 7f2c9ffff640 1 -- 172.21.15.31:0/625221770 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c980c9600 con 0x7f2c98037b10 2024-04-15T00:21:29.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.204+0000 7f2ac9a79640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2ac40b3240 0x7f2ac40b8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.204+0000 7f5a88e2c640 1 --2- 172.21.15.31:0/1740748166 >> v2:172.21.15.50:3300/0 conn(0x7f5a7c037160 0x7f5a7c036350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.204+0000 7f2ac9a79640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2ac40b3240 0x7f2ac40b8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.31:37788/0 (socket says 172.21.15.31:37788) 2024-04-15T00:21:29.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.204+0000 7fccd2ffd640 1 -- 172.21.15.31:0/1379105365 >> v2:172.21.15.31:3300/0 conn(0x7fcccc035a90 msgr2=0x7fcccc033600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:29.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.204+0000 7fccd2ffd640 1 --2- 172.21.15.31:0/1379105365 >> v2:172.21.15.31:3300/0 conn(0x7fcccc035a90 0x7fcccc033600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.204+0000 7fccd2ffd640 1 -- 172.21.15.31:0/1379105365 >> v1:172.21.15.31:6789/0 conn(0x7fcccc034590 legacy=0x7fcccc0cfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.204+0000 7fccd2ffd640 1 -- 172.21.15.31:0/1379105365 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcccc02dfb0 con 0x7fcccc0369c0 2024-04-15T00:21:29.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.205+0000 7f5a7bfff640 1 -- 172.21.15.31:0/1740748166 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3263483378 0 0) 0x7f5a7c02a030 con 0x7f5a7c0357e0 2024-04-15T00:21:29.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.204+0000 7f2ac9a79640 1 -- 172.21.15.31:0/2681459086 learned_addr learned my addr 172.21.15.31:0/2681459086 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:29.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.205+0000 7f5a7bfff640 1 -- 172.21.15.31:0/1740748166 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a70003520 con 0x7f5a7c0357e0 2024-04-15T00:21:29.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.204+0000 7f2aca27a640 1 --2- 172.21.15.31:0/2681459086 >> v2:172.21.15.31:3300/0 conn(0x7f2ac413d690 0x7f2ac4143e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.205+0000 7fd9baf7b640 1 -- 172.21.15.31:0/3501188610 shutdown_connections 2024-04-15T00:21:29.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.205+0000 7fd9baf7b640 1 --2- 172.21.15.31:0/3501188610 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd9b40af220 0x7fd9b413e5c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.205+0000 7fd9baf7b640 1 --2- 172.21.15.31:0/3501188610 >> v2:172.21.15.50:3300/0 conn(0x7fd9b40b5760 0x7fd9b4144280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.205+0000 7fd9baf7b640 1 -- 172.21.15.31:0/3501188610 >> 172.21.15.31:0/3501188610 conn(0x7fd9b406b200 msgr2=0x7fd9b406b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:29.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.205+0000 7fe078e2b640 1 -- 172.21.15.31:0/406735140 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06c02ca80 con 0x7fe074067180 2024-04-15T00:21:29.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.205+0000 7fd9baf7b640 1 -- 172.21.15.31:0/3501188610 shutdown_connections 2024-04-15T00:21:29.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.205+0000 7fe078e2b640 1 -- 172.21.15.31:0/406735140 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe06c02cc20 con 0x7fe074067180 2024-04-15T00:21:29.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.205+0000 7f2c9ffff640 1 --2- 172.21.15.31:0/625221770 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2c98037b10 0x7f2c980c3450 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0064800 tx=0x7f2ca0068fe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56efdc75df277be2 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:29.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.205+0000 7fccd2ffd640 1 --2- 172.21.15.31:0/1379105365 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcccc0369c0 0x7fcccc0cc4c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fccd407ace0 tx=0x7fccd4069eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f307a9192bce852 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:29.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.205+0000 7f2ac9278640 1 -- 172.21.15.31:0/2681459086 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3164873689 0 0) 0x7f2abc001490 con 0x7f2ac41469c0 2024-04-15T00:21:29.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.205+0000 7f2c9e7fc640 1 -- 172.21.15.31:0/625221770 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca00a9d00 con 0x7f2c98037b10 2024-04-15T00:21:29.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.205+0000 7f2ac9278640 1 -- 172.21.15.31:0/2681459086 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ab0003520 con 0x7f2ac41469c0 2024-04-15T00:21:29.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.205+0000 7fccd1ffb640 1 -- 172.21.15.31:0/1379105365 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd40b4070 con 0x7fcccc0369c0 2024-04-15T00:21:29.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.205+0000 7fccd1ffb640 1 -- 172.21.15.31:0/1379105365 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccd40af660 con 0x7fcccc0369c0 2024-04-15T00:21:29.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.205+0000 7fccd1ffb640 1 -- 172.21.15.31:0/1379105365 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd40afb10 con 0x7fcccc0369c0 2024-04-15T00:21:29.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.205+0000 7f2c9e7fc640 1 -- 172.21.15.31:0/625221770 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca006f490 con 0x7f2c98037b10 2024-04-15T00:21:29.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.205+0000 7f2c9e7fc640 1 -- 172.21.15.31:0/625221770 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca006f900 con 0x7f2c98037b10 2024-04-15T00:21:29.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.205+0000 7f2aca27a640 1 -- 172.21.15.31:0/2681459086 >> v2:172.21.15.50:3300/0 conn(0x7f2ac40b3240 msgr2=0x7f2ac40b8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:29.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.205+0000 7f2aca27a640 1 --2- 172.21.15.31:0/2681459086 >> v2:172.21.15.50:3300/0 conn(0x7f2ac40b3240 0x7f2ac40b8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.205+0000 7f2aca27a640 1 -- 172.21.15.31:0/2681459086 >> v1:172.21.15.31:6789/0 conn(0x7f2ac41469c0 legacy=0x7f2ac4146dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.205+0000 7f2aca27a640 1 -- 172.21.15.31:0/2681459086 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ac4143650 con 0x7f2ac413d690 2024-04-15T00:21:29.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.205+0000 7f5a88e2c640 1 -- 172.21.15.31:0/1740748166 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5a7c033700 msgr2=0x7f5a7c033b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:29.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.205+0000 7f5a88e2c640 1 --2- 172.21.15.31:0/1740748166 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5a7c033700 0x7f5a7c033b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.205+0000 7f5a88e2c640 1 -- 172.21.15.31:0/1740748166 >> v1:172.21.15.50:6789/0 conn(0x7f5a7c0357e0 legacy=0x7f5a7c0cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.205+0000 7f5a88e2c640 1 -- 172.21.15.31:0/1740748166 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7c034710 con 0x7f5a7c037160 2024-04-15T00:21:29.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.206+0000 7fe07c091640 1 -- 172.21.15.31:0/406735140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe074067180 msgr2=0x7fe0740b0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.206+0000 7fe07c091640 1 --2- 172.21.15.31:0/406735140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe074067180 0x7fe0740b0590 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe074073080 tx=0x7fe06c02bee0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.206+0000 7fd9baf7b640 1 -- 172.21.15.31:0/3501188610 wait complete. 2024-04-15T00:21:29.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.206+0000 7f5a88e2c640 1 --2- 172.21.15.31:0/1740748166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a7c037160 0x7f5a7c036350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5a84000b60 tx=0x7f5a84064f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5386fd8db8c65153 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:29.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.206+0000 7fccd3fff640 1 -- 172.21.15.31:0/1379105365 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcccc0369c0 msgr2=0x7fcccc0cc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.206+0000 7fccd3fff640 1 --2- 172.21.15.31:0/1379105365 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcccc0369c0 0x7fcccc0cc4c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fccd407ace0 tx=0x7fccd4069eb0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.206+0000 7f5a7bfff640 1 -- 172.21.15.31:0/1740748166 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a840ac7d0 con 0x7f5a7c037160 2024-04-15T00:21:29.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.206+0000 7f5a7bfff640 1 -- 172.21.15.31:0/1740748166 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a840ac970 con 0x7f5a7c037160 2024-04-15T00:21:29.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.206+0000 7f5a7bfff640 1 -- 172.21.15.31:0/1740748166 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a840acda0 con 0x7f5a7c037160 2024-04-15T00:21:29.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.206+0000 7f2ca49cb640 1 -- 172.21.15.31:0/625221770 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2c98037b10 msgr2=0x7f2c980c3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.206+0000 7f2ca49cb640 1 --2- 172.21.15.31:0/625221770 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2c98037b10 0x7f2c980c3450 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0064800 tx=0x7f2ca0068fe0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.207+0000 7fe07c091640 1 -- 172.21.15.31:0/406735140 shutdown_connections 2024-04-15T00:21:29.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.207+0000 7fe07c091640 1 --2- 172.21.15.31:0/406735140 >> v2:172.21.15.50:3300/0 conn(0x7fe0740af930 0x7fe07406b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.207+0000 7fe07c091640 1 --2- 172.21.15.31:0/406735140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe074067180 0x7fe0740b0590 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.207+0000 7fe07c091640 1 -- 172.21.15.31:0/406735140 >> 172.21.15.31:0/406735140 conn(0x7fe0740b6640 msgr2=0x7fe0740b6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:29.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.207+0000 7f2aca27a640 1 --2- 172.21.15.31:0/2681459086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ac413d690 0x7f2ac4143e50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4147a60 tx=0x7f2ab402daf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7657f241b6658eb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:29.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.207+0000 7ff9527c7640 1 Processor -- start 2024-04-15T00:21:29.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.207+0000 7fccd3fff640 1 -- 172.21.15.31:0/1379105365 shutdown_connections 2024-04-15T00:21:29.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.207+0000 7fccd3fff640 1 --2- 172.21.15.31:0/1379105365 >> v2:172.21.15.31:3300/0 conn(0x7fcccc035a90 0x7fcccc033600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.207+0000 7fccd3fff640 1 --2- 172.21.15.31:0/1379105365 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcccc0369c0 0x7fcccc0cc4c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.207+0000 7fccd3fff640 1 -- 172.21.15.31:0/1379105365 >> 172.21.15.31:0/1379105365 conn(0x7fcccc03a8a0 msgr2=0x7fcccc03acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:29.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.207+0000 7f2ca49cb640 1 -- 172.21.15.31:0/625221770 shutdown_connections 2024-04-15T00:21:29.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.207+0000 7f2ca49cb640 1 --2- 172.21.15.31:0/625221770 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2c98037b10 0x7f2c980c3450 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.207+0000 7f2ca49cb640 1 --2- 172.21.15.31:0/625221770 >> v2:172.21.15.31:3300/0 conn(0x7f2c98038a30 0x7f2c980c2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.207+0000 7f2ca49cb640 1 -- 172.21.15.31:0/625221770 >> 172.21.15.31:0/625221770 conn(0x7f2c98008720 msgr2=0x7f2c9803eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:29.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.207+0000 7f2ca49cb640 1 -- 172.21.15.31:0/625221770 shutdown_connections 2024-04-15T00:21:29.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.207+0000 7f2ca49cb640 1 -- 172.21.15.31:0/625221770 wait complete. 2024-04-15T00:21:29.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.207+0000 7ff9527c7640 1 -- start start 2024-04-15T00:21:29.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.207+0000 7f2ac9278640 1 -- 172.21.15.31:0/2681459086 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4035070 con 0x7f2ac413d690 2024-04-15T00:21:29.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.207+0000 7f2ac9278640 1 -- 172.21.15.31:0/2681459086 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ab4008df0 con 0x7f2ac413d690 2024-04-15T00:21:29.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.207+0000 7f2ac9278640 1 -- 172.21.15.31:0/2681459086 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab400a2f0 con 0x7f2ac413d690 2024-04-15T00:21:29.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.207+0000 7fe07c091640 1 -- 172.21.15.31:0/406735140 shutdown_connections 2024-04-15T00:21:29.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.207+0000 7f5a8a62f640 1 -- 172.21.15.31:0/1740748166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a7c037160 msgr2=0x7f5a7c036350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.207+0000 7f5a8a62f640 1 --2- 172.21.15.31:0/1740748166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a7c037160 0x7f5a7c036350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5a84000b60 tx=0x7f5a84064f70 comp rx=0 tx=0).stop 2024-04-15T00:21:29.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.208+0000 7f5a8a62f640 1 -- 172.21.15.31:0/1740748166 shutdown_connections 2024-04-15T00:21:29.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.208+0000 7f5a8a62f640 1 --2- 172.21.15.31:0/1740748166 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5a7c033700 0x7f5a7c033b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.208+0000 7f5a8a62f640 1 --2- 172.21.15.31:0/1740748166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a7c037160 0x7f5a7c036350 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.208+0000 7f5a8a62f640 1 -- 172.21.15.31:0/1740748166 >> 172.21.15.31:0/1740748166 conn(0x7f5a7c03a830 msgr2=0x7f5a7c03ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:29.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.208+0000 7fd9baf7b640 1 Processor -- start 2024-04-15T00:21:29.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.208+0000 7f5a8a62f640 1 -- 172.21.15.31:0/1740748166 shutdown_connections 2024-04-15T00:21:29.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.208+0000 7f5a8a62f640 1 -- 172.21.15.31:0/1740748166 wait complete. 2024-04-15T00:21:29.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.208+0000 7ff9527c7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff94c072660 0x7ff94c072aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.208+0000 7ff9527c7640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff94c14da70 0x7ff94c14fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.208+0000 7ff9527c7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff94c13f940 con 0x7ff94c0b2360 2024-04-15T00:21:29.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.208+0000 7ff9527c7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7ff94c0afbb0 con 0x7ff94c072660 2024-04-15T00:21:29.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.208+0000 7ff9527c7640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7ff94c0b2740 con 0x7ff94c14da70 2024-04-15T00:21:29.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.207+0000 7fe07c091640 1 -- 172.21.15.31:0/406735140 wait complete. 2024-04-15T00:21:29.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.208+0000 7ff9517c5640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff94c0b2360 0x7ff94c1451c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.31:46736/0 (socket says 172.21.15.31:46736) 2024-04-15T00:21:29.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.208+0000 7ff9517c5640 1 -- 172.21.15.31:0/1164198040 learned_addr learned my addr 172.21.15.31:0/1164198040 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:29.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.208+0000 7ff950fc4640 1 --2- 172.21.15.31:0/1164198040 >> v2:172.21.15.50:3300/0 conn(0x7ff94c072660 0x7ff94c072aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.208+0000 7ff951fc6640 1 --2- 172.21.15.31:0/1164198040 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff94c14da70 0x7ff94c14fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.208+0000 7fd9baf7b640 1 -- start start 2024-04-15T00:21:29.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.208+0000 7ff943fff640 1 -- 172.21.15.31:0/1164198040 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1658691647 0 0) 0x7ff94c13f940 con 0x7ff94c0b2360 2024-04-15T00:21:29.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.208+0000 7ff943fff640 1 -- 172.21.15.31:0/1164198040 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff938003520 con 0x7ff94c0b2360 2024-04-15T00:21:29.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.209+0000 7ff950fc4640 1 -- 172.21.15.31:0/1164198040 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff94c14da70 msgr2=0x7ff94c14fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:29.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.209+0000 7ff950fc4640 1 --2- 172.21.15.31:0/1164198040 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff94c14da70 0x7ff94c14fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.209+0000 7ff950fc4640 1 -- 172.21.15.31:0/1164198040 >> v1:172.21.15.50:6789/0 conn(0x7ff94c0b2360 legacy=0x7ff94c1451c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.209+0000 7f2ca49cb640 1 Processor -- start 2024-04-15T00:21:29.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.209+0000 7f2acb27c640 1 -- 172.21.15.31:0/2681459086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ac413d690 msgr2=0x7f2ac4143e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.209+0000 7f2acb27c640 1 --2- 172.21.15.31:0/2681459086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ac413d690 0x7f2ac4143e50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4147a60 tx=0x7f2ab402daf0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.209+0000 7ff950fc4640 1 -- 172.21.15.31:0/1164198040 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff94c1458d0 con 0x7ff94c072660 2024-04-15T00:21:29.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.209+0000 7fccd3fff640 1 -- 172.21.15.31:0/1379105365 shutdown_connections 2024-04-15T00:21:29.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.209+0000 7fccd3fff640 1 -- 172.21.15.31:0/1379105365 wait complete. 2024-04-15T00:21:29.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.209+0000 7fd9baf7b640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd9b40aed50 0x7fd9b4072780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.209+0000 7f2ca49cb640 1 -- start start 2024-04-15T00:21:29.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.209+0000 7fe07c091640 1 Processor -- start 2024-04-15T00:21:29.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.209+0000 7f5a8a62f640 1 Processor -- start 2024-04-15T00:21:29.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.209+0000 7fd9baf7b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9b40af220 0x7fd9b41ded80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.209+0000 7fd9baf7b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9b40b5760 0x7fd9b41df2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.209+0000 7fd9baf7b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b4144940 con 0x7fd9b40b5760 2024-04-15T00:21:29.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.209+0000 7fd9baf7b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b41447c0 con 0x7fd9b40af220 2024-04-15T00:21:29.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.209+0000 7fd9baf7b640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fd9b414eb80 con 0x7fd9b40aed50 2024-04-15T00:21:29.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.209+0000 7f5a8a62f640 1 -- start start 2024-04-15T00:21:29.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.209+0000 7fe07c091640 1 -- start start 2024-04-15T00:21:29.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.210+0000 7fd9b3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9b40af220 0x7fd9b41ded80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.210+0000 7fd9b3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9b40af220 0x7fd9b41ded80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.31:37804/0 (socket says 172.21.15.31:37804) 2024-04-15T00:21:29.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.210+0000 7ff950fc4640 1 --2- 172.21.15.31:0/1164198040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff94c072660 0x7ff94c072aa0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff9480097a0 tx=0x7ff94802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9db84ab8e5ae7e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:29.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.210+0000 7fd9b9518640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9b40b5760 0x7fd9b41df2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.210+0000 7fd9b3fff640 1 -- 172.21.15.31:0/983149298 learned_addr learned my addr 172.21.15.31:0/983149298 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:29.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.210+0000 7fd9b9518640 1 -- 172.21.15.31:0/983149298 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd9b40aed50 msgr2=0x7fd9b4072780 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-15T00:21:29.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.210+0000 7fd9b9518640 1 --2- 172.21.15.31:0/983149298 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd9b40aed50 0x7fd9b4072780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.210+0000 7ff943fff640 1 -- 172.21.15.31:0/1164198040 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff948035020 con 0x7ff94c072660 2024-04-15T00:21:29.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.210+0000 7ff943fff640 1 -- 172.21.15.31:0/1164198040 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff948031810 con 0x7ff94c072660 2024-04-15T00:21:29.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.210+0000 7f2ca49cb640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2c98037060 0x7f2c980cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.210+0000 7fd9b9518640 1 -- 172.21.15.31:0/983149298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9b40af220 msgr2=0x7fd9b41ded80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.210+0000 7fd9b9518640 1 --2- 172.21.15.31:0/983149298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9b40af220 0x7fd9b41ded80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.210+0000 7f2ca49cb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c98037b10 0x7f2c980ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.210+0000 7fd9b9518640 1 -- 172.21.15.31:0/983149298 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9b4140760 con 0x7fd9b40b5760 2024-04-15T00:21:29.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.210+0000 7fe07c091640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe074067180 0x7fe074144a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.210+0000 7f5a8a62f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a7c033700 0x7f5a7c0c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.210+0000 7f5a8a62f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a7c0357e0 0x7f5a7c1663b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.210+0000 7f5a8a62f640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5a7c037160 0x7f5a7c0d3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.210+0000 7f5a8a62f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c037ea0 con 0x7f5a7c0357e0 2024-04-15T00:21:29.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.210+0000 7f5a8a62f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c036890 con 0x7f5a7c033700 2024-04-15T00:21:29.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.210+0000 7f5a8962d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a7c033700 0x7f5a7c0c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.210+0000 7f5a8962d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a7c033700 0x7f5a7c0c3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.31:37818/0 (socket says 172.21.15.31:37818) 2024-04-15T00:21:29.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.210+0000 7f5a8962d640 1 -- 172.21.15.31:0/2737590610 learned_addr learned my addr 172.21.15.31:0/2737590610 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:29.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.210+0000 7f5a8a62f640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f5a7c038020 con 0x7f5a7c037160 2024-04-15T00:21:29.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.210+0000 7f2c9f7fe640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2c98037060 0x7f2c980cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7fd9b9518640 1 --2- 172.21.15.31:0/983149298 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9b40b5760 0x7fd9b41df2c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac032000 tx=0x7fd9ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:29.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7f5a8b891640 1 --2- 172.21.15.31:0/2737590610 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5a7c037160 0x7f5a7c0d3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7f2c9f7fe640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2c98037060 0x7f2c980cacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.31:42370/0 (socket says 172.21.15.31:42370) 2024-04-15T00:21:29.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7fe07c091640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0740af930 0x7fe0741d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7f2c9effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c98037b10 0x7f2c980ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7ff943fff640 1 -- 172.21.15.31:0/1164198040 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff948031be0 con 0x7ff94c072660 2024-04-15T00:21:29.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7fe079e2d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe074067180 0x7fe074144a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7fe07c091640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe0740b4c20 0x7fe0741dd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7fccd3fff640 1 Processor -- start 2024-04-15T00:21:29.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7fe079e2d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe074067180 0x7fe074144a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52014/0 (socket says 172.21.15.31:52014) 2024-04-15T00:21:29.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7f5a88e2c640 1 --2- 172.21.15.31:0/2737590610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a7c0357e0 0x7f5a7c1663b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7fe079e2d640 1 -- 172.21.15.31:0/4189021780 learned_addr learned my addr 172.21.15.31:0/4189021780 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:29.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7fe07c091640 1 -- 172.21.15.31:0/4189021780 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe0740b5a60 con 0x7fe074067180 2024-04-15T00:21:29.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7fe07c091640 1 -- 172.21.15.31:0/4189021780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe0740af1d0 con 0x7fe0740af930 2024-04-15T00:21:29.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7fe07c091640 1 -- 172.21.15.31:0/4189021780 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fe0740b5be0 con 0x7fe0740b4c20 2024-04-15T00:21:29.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7fccd3fff640 1 -- start start 2024-04-15T00:21:29.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7f5a8b891640 1 -- 172.21.15.31:0/2737590610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a7c033700 msgr2=0x7f5a7c0c3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7f5a8b891640 1 --2- 172.21.15.31:0/2737590610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a7c033700 0x7f5a7c0c3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7f5a8b891640 1 -- 172.21.15.31:0/2737590610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a7c0357e0 msgr2=0x7f5a7c1663b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7f5a8b891640 1 --2- 172.21.15.31:0/2737590610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a7c0357e0 0x7f5a7c1663b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7f5a8b891640 1 -- 172.21.15.31:0/2737590610 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7c0c58b0 con 0x7f5a7c037160 2024-04-15T00:21:29.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7f2c9effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c98037b10 0x7f2c980ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.31:37820/0 (socket says 172.21.15.31:37820) 2024-04-15T00:21:29.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.210+0000 7f2ca49cb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c98038a30 0x7f2c980bc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7f2c9effd640 1 -- 172.21.15.31:0/2499136381 learned_addr learned my addr 172.21.15.31:0/2499136381 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:29.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7ff9527c7640 1 -- 172.21.15.31:0/1164198040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff94c072660 msgr2=0x7ff94c072aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7ff9527c7640 1 --2- 172.21.15.31:0/1164198040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff94c072660 0x7ff94c072aa0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff9480097a0 tx=0x7ff94802b8b0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7fe07a62e640 1 --2- 172.21.15.31:0/4189021780 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe0740b4c20 0x7fe0741dd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7fe07962c640 1 --2- 172.21.15.31:0/4189021780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0740af930 0x7fe0741d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7ff9527c7640 1 -- 172.21.15.31:0/1164198040 shutdown_connections 2024-04-15T00:21:29.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7ff9527c7640 1 --2- 172.21.15.31:0/1164198040 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff94c14da70 0x7ff94c14fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7ff9527c7640 1 --2- 172.21.15.31:0/1164198040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff94c072660 0x7ff94c072aa0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7ff9527c7640 1 -- 172.21.15.31:0/1164198040 >> 172.21.15.31:0/1164198040 conn(0x7ff94c0b8bc0 msgr2=0x7ff94c0b8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:29.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7f2ca49cb640 1 -- 172.21.15.31:0/2499136381 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2c98039480 con 0x7f2c98038a30 2024-04-15T00:21:29.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7ff9527c7640 1 -- 172.21.15.31:0/1164198040 shutdown_connections 2024-04-15T00:21:29.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7ff9527c7640 1 -- 172.21.15.31:0/1164198040 wait complete. 2024-04-15T00:21:29.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.211+0000 7f2c9ffff640 1 --2- 172.21.15.31:0/2499136381 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c98038a30 0x7f2c980bc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.212+0000 7f5a8b891640 1 --2- 172.21.15.31:0/2737590610 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5a7c037160 0x7f5a7c0d3e60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5a8000e7f0 tx=0x7f5a8000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:29.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.212+0000 7f2ca49cb640 1 -- 172.21.15.31:0/2499136381 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2c98035f00 con 0x7f2c98037b10 2024-04-15T00:21:29.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.212+0000 7f2ca49cb640 1 -- 172.21.15.31:0/2499136381 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f2c98006af0 con 0x7f2c98037060 2024-04-15T00:21:29.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.212+0000 7fd9b17fa640 1 -- 172.21.15.31:0/983149298 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac043020 con 0x7fd9b40b5760 2024-04-15T00:21:29.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.212+0000 7fd9b17fa640 1 -- 172.21.15.31:0/983149298 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9ac03e450 con 0x7fd9b40b5760 2024-04-15T00:21:29.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.212+0000 7fe079e2d640 1 -- 172.21.15.31:0/4189021780 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe0740b4c20 msgr2=0x7fe0741dd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.212+0000 7fe079e2d640 1 --2- 172.21.15.31:0/4189021780 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe0740b4c20 0x7fe0741dd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.212+0000 7fe079e2d640 1 -- 172.21.15.31:0/4189021780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0740af930 msgr2=0x7fe0741d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.212+0000 7fd9b17fa640 1 -- 172.21.15.31:0/983149298 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac03e800 con 0x7fd9b40b5760 2024-04-15T00:21:29.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.212+0000 7fe079e2d640 1 --2- 172.21.15.31:0/4189021780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0740af930 0x7fe0741d09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.212+0000 7fe079e2d640 1 -- 172.21.15.31:0/4189021780 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe074145a30 con 0x7fe074067180 2024-04-15T00:21:29.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.212+0000 7fd9baf7b640 1 -- 172.21.15.31:0/983149298 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9b40b3a00 con 0x7fd9b40b5760 2024-04-15T00:21:29.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.212+0000 7f5a79ffb640 1 -- 172.21.15.31:0/2737590610 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a80017070 con 0x7f5a7c037160 2024-04-15T00:21:29.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.212+0000 7f5a79ffb640 1 -- 172.21.15.31:0/2737590610 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a8000c730 con 0x7f5a7c037160 2024-04-15T00:21:29.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.212+0000 7f2c9effd640 1 -- 172.21.15.31:0/2499136381 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2c98037060 msgr2=0x7f2c980cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.212+0000 7f2c9effd640 1 --2- 172.21.15.31:0/2499136381 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2c98037060 0x7f2c980cacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.212+0000 7f2c9effd640 1 -- 172.21.15.31:0/2499136381 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c98038a30 msgr2=0x7f2c980bc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.212+0000 7f2c9effd640 1 --2- 172.21.15.31:0/2499136381 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c98038a30 0x7f2c980bc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.212+0000 7f5a8a62f640 1 -- 172.21.15.31:0/2737590610 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a7c0c3030 con 0x7f5a7c037160 2024-04-15T00:21:29.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.212+0000 7f2c9effd640 1 -- 172.21.15.31:0/2499136381 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c980cc5f0 con 0x7f2c98037b10 2024-04-15T00:21:29.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.212+0000 7fd9baf7b640 1 -- 172.21.15.31:0/983149298 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9b40b2ef0 con 0x7fd9b40b5760 2024-04-15T00:21:29.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.212+0000 7f5a79ffb640 1 -- 172.21.15.31:0/2737590610 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a8000cb20 con 0x7f5a7c037160 2024-04-15T00:21:29.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.212+0000 7f2c9f7fe640 1 --2- 172.21.15.31:0/2499136381 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2c98037060 0x7f2c980cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:29.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.213+0000 7f2c9ffff640 1 --2- 172.21.15.31:0/2499136381 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c98038a30 0x7f2c980bc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:29.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.212+0000 7f5a8a62f640 1 -- 172.21.15.31:0/2737590610 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a7c0c5b20 con 0x7f5a7c037160 2024-04-15T00:21:29.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.213+0000 7f2c9effd640 1 --2- 172.21.15.31:0/2499136381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c98037b10 0x7f2c980ccff0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c00e840 tx=0x7f2c8c00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:29.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.212+0000 7fccd3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcccc034590 0x7fcccc0cf660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.212+0000 7fccd3fff640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcccc035a90 0x7fcccc164fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.212+0000 7fccd3fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcccc0369c0 0x7fcccc0bd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.212+0000 7fccd37fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcccc0369c0 0x7fcccc0bd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.213+0000 7ff9527c7640 1 Processor -- start 2024-04-15T00:21:29.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.212+0000 7fccd37fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcccc0369c0 0x7fcccc0bd3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52042/0 (socket says 172.21.15.31:52042) 2024-04-15T00:21:29.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.212+0000 7fccd37fe640 1 -- 172.21.15.31:0/2851093929 learned_addr learned my addr 172.21.15.31:0/2851093929 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:29.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.213+0000 7fccd3fff640 1 -- 172.21.15.31:0/2851093929 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc036da0 con 0x7fcccc0369c0 2024-04-15T00:21:29.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.213+0000 7fccd3fff640 1 -- 172.21.15.31:0/2851093929 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc0366e0 con 0x7fcccc034590 2024-04-15T00:21:29.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.213+0000 7fccd3fff640 1 -- 172.21.15.31:0/2851093929 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fcccc036f20 con 0x7fcccc035a90 2024-04-15T00:21:29.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.213+0000 7f2c8bfff640 1 -- 172.21.15.31:0/2499136381 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c017070 con 0x7f2c98037b10 2024-04-15T00:21:29.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.213+0000 7f2acb27c640 1 -- 172.21.15.31:0/2681459086 shutdown_connections 2024-04-15T00:21:29.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.213+0000 7f2acb27c640 1 --2- 172.21.15.31:0/2681459086 >> v2:172.21.15.50:3300/0 conn(0x7f2ac40b3240 0x7f2ac40b8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.213+0000 7f2acb27c640 1 --2- 172.21.15.31:0/2681459086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ac413d690 0x7f2ac4143e50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.213+0000 7f2acb27c640 1 -- 172.21.15.31:0/2681459086 >> 172.21.15.31:0/2681459086 conn(0x7f2ac406bf00 msgr2=0x7f2ac406c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:29.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.213+0000 7f2c8bfff640 1 -- 172.21.15.31:0/2499136381 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c8c00c940 con 0x7f2c98037b10 2024-04-15T00:21:29.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.213+0000 7f2ca49cb640 1 -- 172.21.15.31:0/2499136381 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c980cc860 con 0x7f2c98037b10 2024-04-15T00:21:29.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.213+0000 7ff9527c7640 1 -- start start 2024-04-15T00:21:29.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.214+0000 7f2ca49cb640 1 -- 172.21.15.31:0/2499136381 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c980c5d90 con 0x7f2c98037b10 2024-04-15T00:21:29.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.214+0000 7f2c8bfff640 1 -- 172.21.15.31:0/2499136381 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c00ccf0 con 0x7f2c98037b10 2024-04-15T00:21:29.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.214+0000 7fe079e2d640 1 --2- 172.21.15.31:0/4189021780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe074067180 0x7fe074144a30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe06c009e50 tx=0x7fe06c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:29.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.214+0000 7fd9baf7b640 1 -- 172.21.15.31:0/983149298 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9b409fc60 con 0x7fd9b40b5760 2024-04-15T00:21:29.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.214+0000 7f5a8a62f640 1 -- 172.21.15.31:0/2737590610 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a7c0cb060 con 0x7f5a7c037160 2024-04-15T00:21:29.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.214+0000 7ff9527c7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff94c072660 0x7ff94c138030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.214+0000 7ff9527c7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff94c0b2360 0x7ff94c139d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.214+0000 7ff9527c7640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff94c14da70 0x7ff94c135ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.214+0000 7ff9527c7640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff94c0add40 con 0x7ff94c072660 2024-04-15T00:21:29.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.214+0000 7ff9527c7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff94c0af880 con 0x7ff94c0b2360 2024-04-15T00:21:29.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.214+0000 7ff9527c7640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7ff94c0b3c90 con 0x7ff94c14da70 2024-04-15T00:21:29.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.214+0000 7ff950fc4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff94c0b2360 0x7ff94c139d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.214+0000 7ff950fc4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff94c0b2360 0x7ff94c139d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.31:37852/0 (socket says 172.21.15.31:37852) 2024-04-15T00:21:29.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.215+0000 7ff950fc4640 1 -- 172.21.15.31:0/1769073256 learned_addr learned my addr 172.21.15.31:0/1769073256 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:29.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.214+0000 7fccd2ffd640 1 --2- 172.21.15.31:0/2851093929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcccc034590 0x7fcccc0cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.214+0000 7fccd27fc640 1 --2- 172.21.15.31:0/2851093929 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcccc035a90 0x7fcccc164fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.215+0000 7f2acb27c640 1 -- 172.21.15.31:0/2681459086 shutdown_connections 2024-04-15T00:21:29.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.215+0000 7ff951fc6640 1 --2- 172.21.15.31:0/1769073256 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff94c14da70 0x7ff94c135ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.215+0000 7f2acb27c640 1 -- 172.21.15.31:0/2681459086 wait complete. 2024-04-15T00:21:29.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.215+0000 7fe06a7fc640 1 -- 172.21.15.31:0/4189021780 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06c043070 con 0x7fe074067180 2024-04-15T00:21:29.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.215+0000 7fe07c091640 1 -- 172.21.15.31:0/4189021780 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0741d1790 con 0x7fe074067180 2024-04-15T00:21:29.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.215+0000 7fe07c091640 1 -- 172.21.15.31:0/4189021780 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe074147520 con 0x7fe074067180 2024-04-15T00:21:29.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.215+0000 7ff950fc4640 1 -- 172.21.15.31:0/1769073256 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff94c14da70 msgr2=0x7ff94c135ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.215+0000 7ff950fc4640 1 --2- 172.21.15.31:0/1769073256 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff94c14da70 0x7ff94c135ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.215+0000 7ff950fc4640 1 -- 172.21.15.31:0/1769073256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff94c072660 msgr2=0x7ff94c138030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.215+0000 7ff950fc4640 1 --2- 172.21.15.31:0/1769073256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff94c072660 0x7ff94c138030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.215+0000 7ff950fc4640 1 -- 172.21.15.31:0/1769073256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff94c06f450 con 0x7ff94c0b2360 2024-04-15T00:21:29.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.214+0000 7fccd37fe640 1 -- 172.21.15.31:0/2851093929 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcccc035a90 msgr2=0x7fcccc164fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.214+0000 7fccd37fe640 1 --2- 172.21.15.31:0/2851093929 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcccc035a90 0x7fcccc164fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.214+0000 7fccd37fe640 1 -- 172.21.15.31:0/2851093929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcccc034590 msgr2=0x7fcccc0cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.214+0000 7fccd37fe640 1 --2- 172.21.15.31:0/2851093929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcccc034590 0x7fcccc0cf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.214+0000 7fccd37fe640 1 -- 172.21.15.31:0/2851093929 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcccc0bcc10 con 0x7fcccc0369c0 2024-04-15T00:21:29.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.215+0000 7fccd37fe640 1 --2- 172.21.15.31:0/2851093929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcccc0369c0 0x7fcccc0bd3a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fccc400c3f0 tx=0x7fccc400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:29.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.216+0000 7f2c8bfff640 1 -- 172.21.15.31:0/2499136381 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f2c8c01a070 con 0x7f2c98037b10 2024-04-15T00:21:29.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.216+0000 7ff950fc4640 1 --2- 172.21.15.31:0/1769073256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff94c0b2360 0x7ff94c139d40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff94803a8f0 tx=0x7ff9480046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:29.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.215+0000 7fd9b17fa640 1 -- 172.21.15.31:0/983149298 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fd9ac046020 con 0x7fd9b40b5760 2024-04-15T00:21:29.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.216+0000 7fccbb7fe640 1 -- 172.21.15.31:0/2851093929 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc40052d0 con 0x7fcccc0369c0 2024-04-15T00:21:29.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.216+0000 7fd9b17fa640 1 --2- 172.21.15.31:0/983149298 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fd9a006ba60 0x7fd9a006df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.216+0000 7fd9b17fa640 1 -- 172.21.15.31:0/983149298 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd9ac0ad250 con 0x7fd9b40b5760 2024-04-15T00:21:29.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.217+0000 7fd9b8d17640 1 --2- 172.21.15.31:0/983149298 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fd9a006ba60 0x7fd9a006df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.216+0000 7fe06a7fc640 1 -- 172.21.15.31:0/4189021780 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe06c03f850 con 0x7fe074067180 2024-04-15T00:21:29.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.217+0000 7fe06a7fc640 1 -- 172.21.15.31:0/4189021780 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06c03fc00 con 0x7fe074067180 2024-04-15T00:21:29.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.217+0000 7fe057fff640 1 -- 172.21.15.31:0/4189021780 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0740b5580 con 0x7fe074067180 2024-04-15T00:21:29.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.217+0000 7f5a79ffb640 1 -- 172.21.15.31:0/2737590610 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f5a8001a070 con 0x7f5a7c037160 2024-04-15T00:21:29.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.216+0000 7f2acb27c640 1 Processor -- start 2024-04-15T00:21:29.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.216+0000 7f2acb27c640 1 -- start start 2024-04-15T00:21:29.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.217+0000 7f2acb27c640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2ac40b3240 0x7f2ac40b7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.217+0000 7f2acb27c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ac413d690 0x7f2ac41ecdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.216+0000 7ff941ffb640 1 -- 172.21.15.31:0/1769073256 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff948035040 con 0x7ff94c0b2360 2024-04-15T00:21:29.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.216+0000 7ff941ffb640 1 -- 172.21.15.31:0/1769073256 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff94803acd0 con 0x7ff94c0b2360 2024-04-15T00:21:29.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.216+0000 7ff941ffb640 1 -- 172.21.15.31:0/1769073256 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff948044650 con 0x7ff94c0b2360 2024-04-15T00:21:29.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.216+0000 7ff9527c7640 1 -- 172.21.15.31:0/1769073256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff94c13e8a0 con 0x7ff94c0b2360 2024-04-15T00:21:29.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.217+0000 7ff9527c7640 1 -- 172.21.15.31:0/1769073256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff94c13afe0 con 0x7ff94c0b2360 2024-04-15T00:21:29.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.216+0000 7fccbb7fe640 1 -- 172.21.15.31:0/2851093929 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccc4005470 con 0x7fcccc0369c0 2024-04-15T00:21:29.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.216+0000 7fccd3fff640 1 -- 172.21.15.31:0/2851093929 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcccc0bda80 con 0x7fcccc0369c0 2024-04-15T00:21:29.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.216+0000 7f2c8bfff640 1 --2- 172.21.15.31:0/2499136381 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f2c8406ba60 0x7f2c8406df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.217+0000 7f2c8bfff640 1 -- 172.21.15.31:0/2499136381 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2c8c08a960 con 0x7f2c98037b10 2024-04-15T00:21:29.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.217+0000 7f2ca49cb640 1 -- 172.21.15.31:0/2499136381 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c80005290 con 0x7f2c98037b10 2024-04-15T00:21:29.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.218+0000 7f2acb27c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ac41469c0 0x7f2ac406f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.218+0000 7f2aca27a640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2ac40b3240 0x7f2ac40b7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.218+0000 7f2aca27a640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2ac40b3240 0x7f2ac40b7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.31:42420/0 (socket says 172.21.15.31:42420) 2024-04-15T00:21:29.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.218+0000 7fd9b8d17640 1 --2- 172.21.15.31:0/983149298 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fd9a006ba60 0x7fd9a006df20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd9a400a810 tx=0x7fd9a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:29.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.218+0000 7f5a79ffb640 1 --2- 172.21.15.31:0/2737590610 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f5a6806ba60 0x7f5a6806df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.218+0000 7f2aca27a640 1 -- 172.21.15.31:0/206582302 learned_addr learned my addr 172.21.15.31:0/206582302 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:29.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.218+0000 7f2acb27c640 1 -- 172.21.15.31:0/206582302 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac40b2c00 con 0x7f2ac413d690 2024-04-15T00:21:29.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.218+0000 7f2acb27c640 1 -- 172.21.15.31:0/206582302 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac40b4cc0 con 0x7f2ac41469c0 2024-04-15T00:21:29.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.218+0000 7f2acb27c640 1 -- 172.21.15.31:0/206582302 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f2ac40b2d80 con 0x7f2ac40b3240 2024-04-15T00:21:29.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.218+0000 7f2ac9a79640 1 --2- 172.21.15.31:0/206582302 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ac413d690 0x7f2ac41ecdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.218+0000 7f2acaa7b640 1 --2- 172.21.15.31:0/206582302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ac41469c0 0x7f2ac406f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.218+0000 7f2c9f7fe640 1 --2- 172.21.15.31:0/2499136381 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f2c8406ba60 0x7f2c8406df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.218+0000 7f5a79ffb640 1 -- 172.21.15.31:0/2737590610 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5a8008a4d0 con 0x7f5a7c037160 2024-04-15T00:21:29.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.218+0000 7ff9527c7640 1 -- 172.21.15.31:0/1769073256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff94c06b200 con 0x7ff94c0b2360 2024-04-15T00:21:29.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.218+0000 7fccbb7fe640 1 -- 172.21.15.31:0/2851093929 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc4007240 con 0x7fcccc0369c0 2024-04-15T00:21:29.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.218+0000 7fccd3fff640 1 -- 172.21.15.31:0/2851093929 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcccc0c5770 con 0x7fcccc0369c0 2024-04-15T00:21:29.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.219+0000 7f5a8962d640 1 --2- 172.21.15.31:0/2737590610 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f5a6806ba60 0x7f5a6806df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.218+0000 7f2aca27a640 1 -- 172.21.15.31:0/206582302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ac41469c0 msgr2=0x7f2ac406f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.218+0000 7f2aca27a640 1 --2- 172.21.15.31:0/206582302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ac41469c0 0x7f2ac406f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.218+0000 7f2aca27a640 1 -- 172.21.15.31:0/206582302 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ac413d690 msgr2=0x7f2ac41ecdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.218+0000 7f2aca27a640 1 --2- 172.21.15.31:0/206582302 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ac413d690 0x7f2ac41ecdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.218+0000 7f2aca27a640 1 -- 172.21.15.31:0/206582302 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ac4071cd0 con 0x7f2ac40b3240 2024-04-15T00:21:29.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.218+0000 7f2acaa7b640 1 --2- 172.21.15.31:0/206582302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ac41469c0 0x7f2ac406f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:21:29.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.219+0000 7f2aca27a640 1 --2- 172.21.15.31:0/206582302 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2ac40b3240 0x7f2ac40b7a40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4000c00 tx=0x7f2ab40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:29.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.219+0000 7fccd3fff640 1 -- 172.21.15.31:0/2851093929 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcccc0c5970 con 0x7fcccc0369c0 2024-04-15T00:21:29.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.219+0000 7f2c9f7fe640 1 --2- 172.21.15.31:0/2499136381 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f2c8406ba60 0x7f2c8406df20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2c94007fd0 tx=0x7f2c94007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:29.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.219+0000 7f5a8962d640 1 --2- 172.21.15.31:0/2737590610 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f5a6806ba60 0x7f5a6806df20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5a74001200 tx=0x7f5a74007d70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:29.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.221+0000 7f2abaffd640 1 -- 172.21.15.31:0/206582302 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4035040 con 0x7f2ac40b3240 2024-04-15T00:21:29.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.221+0000 7f2acb27c640 1 -- 172.21.15.31:0/206582302 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ac413efd0 con 0x7f2ac40b3240 2024-04-15T00:21:29.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.221+0000 7f2acb27c640 1 -- 172.21.15.31:0/206582302 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ac40b85e0 con 0x7f2ac40b3240 2024-04-15T00:21:29.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.221+0000 7f5a79ffb640 1 -- 172.21.15.31:0/2737590610 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f5a800587c0 con 0x7f5a7c037160 2024-04-15T00:21:29.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.221+0000 7f2abaffd640 1 -- 172.21.15.31:0/206582302 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ab402f8b0 con 0x7f2ac40b3240 2024-04-15T00:21:29.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.221+0000 7f2abaffd640 1 -- 172.21.15.31:0/206582302 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab402fca0 con 0x7f2ac40b3240 2024-04-15T00:21:29.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.222+0000 7fd9b17fa640 1 -- 172.21.15.31:0/983149298 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd9ac04d030 con 0x7fd9b40b5760 2024-04-15T00:21:29.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.223+0000 7f2abaffd640 1 -- 172.21.15.31:0/206582302 <== mon.2 v2:172.21.15.50:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f2ab4038070 con 0x7f2ac40b3240 2024-04-15T00:21:29.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.223+0000 7f2acb27c640 1 -- 172.21.15.31:0/206582302 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aac005290 con 0x7f2ac40b3240 2024-04-15T00:21:29.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.223+0000 7f2abaffd640 1 --2- 172.21.15.31:0/206582302 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f2aa806b990 0x7f2aa806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.223+0000 7f2abaffd640 1 -- 172.21.15.31:0/206582302 <== mon.2 v2:172.21.15.50:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2ab40ac330 con 0x7f2ac40b3240 2024-04-15T00:21:29.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.223+0000 7f2ac9a79640 1 --2- 172.21.15.31:0/206582302 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f2aa806b990 0x7f2aa806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.224+0000 7f2ac9a79640 1 --2- 172.21.15.31:0/206582302 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f2aa806b990 0x7f2aa806de50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2ac40afd90 tx=0x7f2ac0009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:29.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.224+0000 7f2c8bfff640 1 -- 172.21.15.31:0/2499136381 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2c8c0592a0 con 0x7f2c98037b10 2024-04-15T00:21:29.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.224+0000 7fe06a7fc640 1 -- 172.21.15.31:0/4189021780 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fe06c03d410 con 0x7fe074067180 2024-04-15T00:21:29.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.225+0000 7fccbb7fe640 1 -- 172.21.15.31:0/2851093929 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fccc40073e0 con 0x7fcccc0369c0 2024-04-15T00:21:29.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.225+0000 7fe06a7fc640 1 --2- 172.21.15.31:0/4189021780 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe05806ba90 0x7fe05806df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.225+0000 7fe06a7fc640 1 -- 172.21.15.31:0/4189021780 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe06c0ad4c0 con 0x7fe074067180 2024-04-15T00:21:29.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.225+0000 7fccbb7fe640 1 --2- 172.21.15.31:0/2851093929 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fccc006ba60 0x7fccc006df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.225+0000 7ff941ffb640 1 -- 172.21.15.31:0/1769073256 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7ff948038020 con 0x7ff94c0b2360 2024-04-15T00:21:29.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.226+0000 7fccbb7fe640 1 -- 172.21.15.31:0/2851093929 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fccc408a400 con 0x7fcccc0369c0 2024-04-15T00:21:29.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.226+0000 7fccd2ffd640 1 --2- 172.21.15.31:0/2851093929 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fccc006ba60 0x7fccc006df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.226+0000 7ff941ffb640 1 --2- 172.21.15.31:0/1769073256 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7ff93006b9e0 0x7ff93006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.226+0000 7ff941ffb640 1 -- 172.21.15.31:0/1769073256 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff9480acd90 con 0x7ff94c0b2360 2024-04-15T00:21:29.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.226+0000 7ff9517c5640 1 --2- 172.21.15.31:0/1769073256 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7ff93006b9e0 0x7ff93006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.227+0000 7fe07962c640 1 --2- 172.21.15.31:0/4189021780 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe05806ba90 0x7fe05806df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.226+0000 7fccd2ffd640 1 --2- 172.21.15.31:0/2851093929 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fccc006ba60 0x7fccc006df20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcccc035780 tx=0x7fccd40ab000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:29.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.227+0000 7ff9517c5640 1 --2- 172.21.15.31:0/1769073256 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7ff93006b9e0 0x7ff93006dea0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff9440012e0 tx=0x7ff944001650 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:29.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.227+0000 7fe07962c640 1 --2- 172.21.15.31:0/4189021780 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe05806ba90 0x7fe05806df50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe074147170 tx=0x7fe070009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:29.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.228+0000 7f2abaffd640 1 -- 172.21.15.31:0/206582302 <== mon.2 v2:172.21.15.50:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2ab404a060 con 0x7f2ac40b3240 2024-04-15T00:21:29.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.228+0000 7ff941ffb640 1 -- 172.21.15.31:0/1769073256 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff948031e20 con 0x7ff94c0b2360 2024-04-15T00:21:29.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.230+0000 7fe06a7fc640 1 -- 172.21.15.31:0/4189021780 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe06c07b7b0 con 0x7fe074067180 2024-04-15T00:21:29.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.239+0000 7fccbb7fe640 1 -- 172.21.15.31:0/2851093929 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fccc4058d40 con 0x7fcccc0369c0 2024-04-15T00:21:29.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.581+0000 7f313359e640 1 -- 172.21.15.31:0/2946825613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f3118005580 con 0x7f312c0e43f0 2024-04-15T00:21:29.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.582+0000 7f3122ffd640 1 -- 172.21.15.31:0/2946825613 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f31340e6610 con 0x7f312c0e43f0 2024-04-15T00:21:29.589 INFO:teuthology.orchestra.run.smithi031.stdout:55834574858 2024-04-15T00:21:29.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.586+0000 7f3120ff9640 1 -- 172.21.15.31:0/2946825613 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f311406ba60 msgr2=0x7f311406df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.586+0000 7f3120ff9640 1 --2- 172.21.15.31:0/2946825613 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f311406ba60 0x7f311406df20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3128004fb0 tx=0x7f3128007e30 comp rx=0 tx=0).stop 2024-04-15T00:21:29.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.586+0000 7f3120ff9640 1 -- 172.21.15.31:0/2946825613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f312c0e43f0 msgr2=0x7f312c0e7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.586+0000 7f3120ff9640 1 --2- 172.21.15.31:0/2946825613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f312c0e43f0 0x7f312c0e7250 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3134050a90 tx=0x7f31340750c0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.586+0000 7f3120ff9640 1 -- 172.21.15.31:0/2946825613 shutdown_connections 2024-04-15T00:21:29.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.586+0000 7f3120ff9640 1 --2- 172.21.15.31:0/2946825613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f312c0e43f0 0x7f312c0e7250 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.586+0000 7f3120ff9640 1 --2- 172.21.15.31:0/2946825613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f312c0e3f90 0x7f312c02c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.587+0000 7f3120ff9640 1 --2- 172.21.15.31:0/2946825613 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f311406ba60 0x7f311406df20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.587+0000 7f3120ff9640 1 --2- 172.21.15.31:0/2946825613 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f312c036ba0 0x7f312c02b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.587+0000 7f3120ff9640 1 -- 172.21.15.31:0/2946825613 >> 172.21.15.31:0/2946825613 conn(0x7f312c03a8a0 msgr2=0x7f312c006570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:29.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.587+0000 7f3120ff9640 1 -- 172.21.15.31:0/2946825613 shutdown_connections 2024-04-15T00:21:29.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.587+0000 7f3120ff9640 1 -- 172.21.15.31:0/2946825613 wait complete. 2024-04-15T00:21:29.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2024-04-15T00:21:29.611 DEBUG:teuthology.parallel:result is None 2024-04-15T00:21:29.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.625+0000 7fccd3fff640 1 -- 172.21.15.31:0/2851093929 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fcccc0052c0 con 0x7fcccc0369c0 2024-04-15T00:21:29.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.625+0000 7fccbb7fe640 1 -- 172.21.15.31:0/2851093929 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fccc4058640 con 0x7fcccc0369c0 2024-04-15T00:21:29.633 INFO:teuthology.orchestra.run.smithi031.stdout:55834574858 2024-04-15T00:21:29.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.628+0000 7fccd3fff640 1 -- 172.21.15.31:0/2851093929 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fccc006ba60 msgr2=0x7fccc006df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.628+0000 7fccd3fff640 1 --2- 172.21.15.31:0/2851093929 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fccc006ba60 0x7fccc006df20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcccc035780 tx=0x7fccd40ab000 comp rx=0 tx=0).stop 2024-04-15T00:21:29.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.628+0000 7fccd3fff640 1 -- 172.21.15.31:0/2851093929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcccc0369c0 msgr2=0x7fcccc0bd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.628+0000 7fccd3fff640 1 --2- 172.21.15.31:0/2851093929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcccc0369c0 0x7fcccc0bd3a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fccc400c3f0 tx=0x7fccc400c8b0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.628+0000 7fccd3fff640 1 -- 172.21.15.31:0/2851093929 shutdown_connections 2024-04-15T00:21:29.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.628+0000 7fccd3fff640 1 --2- 172.21.15.31:0/2851093929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcccc0369c0 0x7fcccc0bd3a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.628+0000 7fccd3fff640 1 --2- 172.21.15.31:0/2851093929 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fccc006ba60 0x7fccc006df20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.628+0000 7fccd3fff640 1 --2- 172.21.15.31:0/2851093929 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcccc035a90 0x7fcccc164fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.628+0000 7fccd3fff640 1 --2- 172.21.15.31:0/2851093929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcccc034590 0x7fcccc0cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.628+0000 7fccd3fff640 1 -- 172.21.15.31:0/2851093929 >> 172.21.15.31:0/2851093929 conn(0x7fcccc03a8a0 msgr2=0x7fcccc039210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:29.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.628+0000 7fccd3fff640 1 -- 172.21.15.31:0/2851093929 shutdown_connections 2024-04-15T00:21:29.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.628+0000 7fccd3fff640 1 -- 172.21.15.31:0/2851093929 wait complete. 2024-04-15T00:21:29.647 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2024-04-15T00:21:29.647 DEBUG:teuthology.parallel:result is None 2024-04-15T00:21:29.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.643+0000 7f5a8a62f640 1 -- 172.21.15.31:0/2737590610 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f5a7c0c5e00 con 0x7f5a7c037160 2024-04-15T00:21:29.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.644+0000 7f5a79ffb640 1 -- 172.21.15.31:0/2737590610 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5a8005c860 con 0x7f5a7c037160 2024-04-15T00:21:29.651 INFO:teuthology.orchestra.run.smithi031.stdout:60129542154 2024-04-15T00:21:29.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.647+0000 7f5a8a62f640 1 -- 172.21.15.31:0/2737590610 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f5a6806ba60 msgr2=0x7f5a6806df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.647+0000 7f5a8a62f640 1 --2- 172.21.15.31:0/2737590610 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f5a6806ba60 0x7f5a6806df20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5a74001200 tx=0x7f5a74007d70 comp rx=0 tx=0).stop 2024-04-15T00:21:29.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.647+0000 7f5a8a62f640 1 -- 172.21.15.31:0/2737590610 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5a7c037160 msgr2=0x7f5a7c0d3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.647+0000 7f5a8a62f640 1 --2- 172.21.15.31:0/2737590610 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5a7c037160 0x7f5a7c0d3e60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5a8000e7f0 tx=0x7f5a8000ecb0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.647+0000 7f5a8a62f640 1 -- 172.21.15.31:0/2737590610 shutdown_connections 2024-04-15T00:21:29.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.647+0000 7f5a8a62f640 1 --2- 172.21.15.31:0/2737590610 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f5a6806ba60 0x7f5a6806df20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.647+0000 7f5a8a62f640 1 --2- 172.21.15.31:0/2737590610 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5a7c037160 0x7f5a7c0d3e60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.647+0000 7f5a8a62f640 1 --2- 172.21.15.31:0/2737590610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a7c0357e0 0x7f5a7c1663b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.647+0000 7f5a8a62f640 1 --2- 172.21.15.31:0/2737590610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a7c033700 0x7f5a7c0c3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.648+0000 7f5a8a62f640 1 -- 172.21.15.31:0/2737590610 >> 172.21.15.31:0/2737590610 conn(0x7f5a7c03a830 msgr2=0x7f5a7c038fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:29.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.648+0000 7f5a8a62f640 1 -- 172.21.15.31:0/2737590610 shutdown_connections 2024-04-15T00:21:29.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.648+0000 7f5a8a62f640 1 -- 172.21.15.31:0/2737590610 wait complete. 2024-04-15T00:21:29.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.652+0000 7f2ca49cb640 1 -- 172.21.15.31:0/2499136381 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f2c80005580 con 0x7f2c98037b10 2024-04-15T00:21:29.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.652+0000 7f2c8bfff640 1 -- 172.21.15.31:0/2499136381 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2c8c058ba0 con 0x7f2c98037b10 2024-04-15T00:21:29.660 INFO:teuthology.orchestra.run.smithi031.stdout:55834574857 2024-04-15T00:21:29.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.653+0000 7f2acb27c640 1 -- 172.21.15.31:0/206582302 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f2aac005850 con 0x7f2ac40b3240 2024-04-15T00:21:29.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.656+0000 7f2abaffd640 1 -- 172.21.15.31:0/206582302 <== mon.2 v2:172.21.15.50:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2ab407a640 con 0x7f2ac40b3240 2024-04-15T00:21:29.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.656+0000 7f2ca49cb640 1 -- 172.21.15.31:0/2499136381 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f2c8406ba60 msgr2=0x7f2c8406df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.656+0000 7f2ca49cb640 1 --2- 172.21.15.31:0/2499136381 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f2c8406ba60 0x7f2c8406df20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2c94007fd0 tx=0x7f2c94007d40 comp rx=0 tx=0).stop 2024-04-15T00:21:29.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.656+0000 7f2ca49cb640 1 -- 172.21.15.31:0/2499136381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c98037b10 msgr2=0x7f2c980ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.656+0000 7f2ca49cb640 1 --2- 172.21.15.31:0/2499136381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c98037b10 0x7f2c980ccff0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c00e840 tx=0x7f2c8c00ed00 comp rx=0 tx=0).stop 2024-04-15T00:21:29.664 INFO:teuthology.orchestra.run.smithi031.stdout:55834574857 2024-04-15T00:21:29.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.656+0000 7f2ca49cb640 1 -- 172.21.15.31:0/2499136381 shutdown_connections 2024-04-15T00:21:29.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.656+0000 7f2ca49cb640 1 --2- 172.21.15.31:0/2499136381 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c98038a30 0x7f2c980bc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.656+0000 7f2ca49cb640 1 --2- 172.21.15.31:0/2499136381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c98037b10 0x7f2c980ccff0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.656+0000 7f2ca49cb640 1 --2- 172.21.15.31:0/2499136381 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f2c8406ba60 0x7f2c8406df20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.656+0000 7f2ca49cb640 1 --2- 172.21.15.31:0/2499136381 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2c98037060 0x7f2c980cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.656+0000 7f2ca49cb640 1 -- 172.21.15.31:0/2499136381 >> 172.21.15.31:0/2499136381 conn(0x7f2c98008720 msgr2=0x7f2c980c7ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:29.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.656+0000 7f2ca49cb640 1 -- 172.21.15.31:0/2499136381 shutdown_connections 2024-04-15T00:21:29.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.656+0000 7f2ca49cb640 1 -- 172.21.15.31:0/2499136381 wait complete. 2024-04-15T00:21:29.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.656+0000 7fd9baf7b640 1 -- 172.21.15.31:0/983149298 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fd9b404f620 con 0x7fd9b40b5760 2024-04-15T00:21:29.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.657+0000 7ff9527c7640 1 -- 172.21.15.31:0/1769073256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff94c04f540 con 0x7ff94c0b2360 2024-04-15T00:21:29.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.657+0000 7fd9b17fa640 1 -- 172.21.15.31:0/983149298 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd9ac07bc50 con 0x7fd9b40b5760 2024-04-15T00:21:29.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.657+0000 7fe057fff640 1 -- 172.21.15.31:0/4189021780 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fe07409f7c0 con 0x7fe074067180 2024-04-15T00:21:29.666 INFO:teuthology.orchestra.run.smithi031.stdout:60129542154 2024-04-15T00:21:29.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.657+0000 7fe06a7fc640 1 -- 172.21.15.31:0/4189021780 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe06c07f850 con 0x7fe074067180 2024-04-15T00:21:29.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.657+0000 7ff941ffb640 1 -- 172.21.15.31:0/1769073256 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff94807b6c0 con 0x7ff94c0b2360 2024-04-15T00:21:29.667 INFO:teuthology.orchestra.run.smithi031.stdout:60129542154 2024-04-15T00:21:29.667 INFO:teuthology.orchestra.run.smithi031.stdout:55834574858 2024-04-15T00:21:29.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.659+0000 7f2acb27c640 1 -- 172.21.15.31:0/206582302 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f2aa806b990 msgr2=0x7f2aa806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.659+0000 7f2acb27c640 1 --2- 172.21.15.31:0/206582302 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f2aa806b990 0x7f2aa806de50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2ac40afd90 tx=0x7f2ac0009240 comp rx=0 tx=0).stop 2024-04-15T00:21:29.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.659+0000 7f2acb27c640 1 -- 172.21.15.31:0/206582302 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2ac40b3240 msgr2=0x7f2ac40b7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.659+0000 7f2acb27c640 1 --2- 172.21.15.31:0/206582302 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2ac40b3240 0x7f2ac40b7a40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4000c00 tx=0x7f2ab40046c0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.660+0000 7fd9baf7b640 1 -- 172.21.15.31:0/983149298 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fd9a006ba60 msgr2=0x7fd9a006df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.660+0000 7fd9baf7b640 1 --2- 172.21.15.31:0/983149298 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fd9a006ba60 0x7fd9a006df20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd9a400a810 tx=0x7fd9a4008040 comp rx=0 tx=0).stop 2024-04-15T00:21:29.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.660+0000 7fd9baf7b640 1 -- 172.21.15.31:0/983149298 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9b40b5760 msgr2=0x7fd9b41df2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.660+0000 7fd9baf7b640 1 --2- 172.21.15.31:0/983149298 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9b40b5760 0x7fd9b41df2c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac032000 tx=0x7fd9ac004a40 comp rx=0 tx=0).stop 2024-04-15T00:21:29.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.660+0000 7f2acb27c640 1 -- 172.21.15.31:0/206582302 shutdown_connections 2024-04-15T00:21:29.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.660+0000 7f2acb27c640 1 --2- 172.21.15.31:0/206582302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ac41469c0 0x7f2ac406f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.660+0000 7f2acb27c640 1 --2- 172.21.15.31:0/206582302 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ac413d690 0x7f2ac41ecdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.660+0000 7f2acb27c640 1 --2- 172.21.15.31:0/206582302 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f2aa806b990 0x7f2aa806de50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.660+0000 7f2acb27c640 1 --2- 172.21.15.31:0/206582302 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2ac40b3240 0x7f2ac40b7a40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.660+0000 7f2acb27c640 1 -- 172.21.15.31:0/206582302 >> 172.21.15.31:0/206582302 conn(0x7f2ac406bf00 msgr2=0x7f2ac413cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:29.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.660+0000 7f2acb27c640 1 -- 172.21.15.31:0/206582302 shutdown_connections 2024-04-15T00:21:29.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.660+0000 7f2acb27c640 1 -- 172.21.15.31:0/206582302 wait complete. 2024-04-15T00:21:29.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.660+0000 7fd9baf7b640 1 -- 172.21.15.31:0/983149298 shutdown_connections 2024-04-15T00:21:29.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.660+0000 7fd9baf7b640 1 --2- 172.21.15.31:0/983149298 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9b40b5760 0x7fd9b41df2c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.660+0000 7fd9baf7b640 1 --2- 172.21.15.31:0/983149298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9b40af220 0x7fd9b41ded80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.660+0000 7fd9baf7b640 1 --2- 172.21.15.31:0/983149298 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fd9a006ba60 0x7fd9a006df20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.660+0000 7fd9baf7b640 1 --2- 172.21.15.31:0/983149298 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fd9b40aed50 0x7fd9b4072780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.660+0000 7fd9baf7b640 1 -- 172.21.15.31:0/983149298 >> 172.21.15.31:0/983149298 conn(0x7fd9b406b200 msgr2=0x7fd9b4142b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:29.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.660+0000 7fd9baf7b640 1 -- 172.21.15.31:0/983149298 shutdown_connections 2024-04-15T00:21:29.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.660+0000 7fd9baf7b640 1 -- 172.21.15.31:0/983149298 wait complete. 2024-04-15T00:21:29.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.661+0000 7fe057fff640 1 -- 172.21.15.31:0/4189021780 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe05806ba90 msgr2=0x7fe05806df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.661+0000 7fe057fff640 1 --2- 172.21.15.31:0/4189021780 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe05806ba90 0x7fe05806df50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe074147170 tx=0x7fe070009040 comp rx=0 tx=0).stop 2024-04-15T00:21:29.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.661+0000 7fe057fff640 1 -- 172.21.15.31:0/4189021780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe074067180 msgr2=0x7fe074144a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.661+0000 7fe057fff640 1 --2- 172.21.15.31:0/4189021780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe074067180 0x7fe074144a30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe06c009e50 tx=0x7fe06c004a40 comp rx=0 tx=0).stop 2024-04-15T00:21:29.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.661+0000 7ff9527c7640 1 -- 172.21.15.31:0/1769073256 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7ff93006b9e0 msgr2=0x7ff93006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.661+0000 7ff9527c7640 1 --2- 172.21.15.31:0/1769073256 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7ff93006b9e0 0x7ff93006dea0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff9440012e0 tx=0x7ff944001650 comp rx=0 tx=0).stop 2024-04-15T00:21:29.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.661+0000 7ff9527c7640 1 -- 172.21.15.31:0/1769073256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff94c0b2360 msgr2=0x7ff94c139d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.661+0000 7ff9527c7640 1 --2- 172.21.15.31:0/1769073256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff94c0b2360 0x7ff94c139d40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff94803a8f0 tx=0x7ff9480046c0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.661+0000 7fe057fff640 1 -- 172.21.15.31:0/4189021780 shutdown_connections 2024-04-15T00:21:29.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.661+0000 7fe057fff640 1 --2- 172.21.15.31:0/4189021780 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe05806ba90 0x7fe05806df50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.661+0000 7fe057fff640 1 --2- 172.21.15.31:0/4189021780 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe0740b4c20 0x7fe0741dd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.661+0000 7fe057fff640 1 --2- 172.21.15.31:0/4189021780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0740af930 0x7fe0741d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.661+0000 7fe057fff640 1 --2- 172.21.15.31:0/4189021780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe074067180 0x7fe074144a30 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.661+0000 7fe057fff640 1 -- 172.21.15.31:0/4189021780 >> 172.21.15.31:0/4189021780 conn(0x7fe0740b6640 msgr2=0x7fe07406d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:29.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.661+0000 7fe057fff640 1 -- 172.21.15.31:0/4189021780 shutdown_connections 2024-04-15T00:21:29.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.661+0000 7ff9527c7640 1 -- 172.21.15.31:0/1769073256 shutdown_connections 2024-04-15T00:21:29.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.661+0000 7ff9527c7640 1 --2- 172.21.15.31:0/1769073256 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7ff93006b9e0 0x7ff93006dea0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.661+0000 7ff9527c7640 1 --2- 172.21.15.31:0/1769073256 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff94c14da70 0x7ff94c135ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.661+0000 7ff9527c7640 1 --2- 172.21.15.31:0/1769073256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff94c0b2360 0x7ff94c139d40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.661+0000 7ff9527c7640 1 --2- 172.21.15.31:0/1769073256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff94c072660 0x7ff94c138030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.661+0000 7ff9527c7640 1 -- 172.21.15.31:0/1769073256 >> 172.21.15.31:0/1769073256 conn(0x7ff94c0b8bc0 msgr2=0x7ff94c0b0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:29.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.661+0000 7fe057fff640 1 -- 172.21.15.31:0/4189021780 wait complete. 2024-04-15T00:21:29.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.661+0000 7ff9527c7640 1 -- 172.21.15.31:0/1769073256 shutdown_connections 2024-04-15T00:21:29.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.661+0000 7ff9527c7640 1 -- 172.21.15.31:0/1769073256 wait complete. 2024-04-15T00:21:29.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.2 2024-04-15T00:21:29.675 DEBUG:teuthology.parallel:result is None 2024-04-15T00:21:29.680 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2024-04-15T00:21:29.680 DEBUG:teuthology.parallel:result is None 2024-04-15T00:21:29.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2024-04-15T00:21:29.684 DEBUG:teuthology.parallel:result is None 2024-04-15T00:21:29.684 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.3 2024-04-15T00:21:29.684 DEBUG:teuthology.parallel:result is None 2024-04-15T00:21:29.688 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2024-04-15T00:21:29.688 DEBUG:teuthology.parallel:result is None 2024-04-15T00:21:29.688 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.0 2024-04-15T00:21:29.689 DEBUG:teuthology.parallel:result is None 2024-04-15T00:21:29.689 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-15T00:21:29.689 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T00:21:29.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.822+0000 7fc02c1ed640 1 Processor -- start 2024-04-15T00:21:29.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.822+0000 7fc02c1ed640 1 -- start start 2024-04-15T00:21:29.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.823+0000 7fc02c1ed640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc0240b8be0 0x7fc024072570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.823+0000 7fc02c1ed640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc024072c90 con 0x7fc0240b80d0 2024-04-15T00:21:29.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.823+0000 7fc02c1ed640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc02409c0e0 con 0x7fc02414b4c0 2024-04-15T00:21:29.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.823+0000 7fc02c1ed640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc0240b84b0 con 0x7fc0240b8be0 2024-04-15T00:21:29.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.823+0000 7fc029f89640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc0240b80d0 0x7fc02414adb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:39462/0 (socket says 172.21.15.31:39462) 2024-04-15T00:21:29.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.823+0000 7fc029f89640 1 -- 172.21.15.31:0/201946429 learned_addr learned my addr 172.21.15.31:0/201946429 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:29.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.823+0000 7fc028f87640 1 -- 172.21.15.31:0/201946429 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2732726680 0 0) 0x7fc024072c90 con 0x7fc0240b80d0 2024-04-15T00:21:29.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.823+0000 7fc028f87640 1 -- 172.21.15.31:0/201946429 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc00c003520 con 0x7fc0240b80d0 2024-04-15T00:21:29.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.823+0000 7fc029788640 1 --2- 172.21.15.31:0/201946429 >> v2:172.21.15.50:3300/0 conn(0x7fc0240b8be0 0x7fc024072570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.824+0000 7fc028f87640 1 -- 172.21.15.31:0/201946429 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1751164854 0 0) 0x7fc00c003520 con 0x7fc0240b80d0 2024-04-15T00:21:29.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.824+0000 7fc028f87640 1 -- 172.21.15.31:0/201946429 >> v2:172.21.15.50:3300/0 conn(0x7fc0240b8be0 msgr2=0x7fc024072570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:29.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.824+0000 7fc028f87640 1 --2- 172.21.15.31:0/201946429 >> v2:172.21.15.50:3300/0 conn(0x7fc0240b8be0 0x7fc024072570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.824+0000 7fc028f87640 1 -- 172.21.15.31:0/201946429 >> v1:172.21.15.50:6789/0 conn(0x7fc02414b4c0 legacy=0x7fc0241449c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.824+0000 7fc028f87640 1 -- 172.21.15.31:0/201946429 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc02409c380 con 0x7fc0240b80d0 2024-04-15T00:21:29.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.824+0000 7fc028f87640 1 -- 172.21.15.31:0/201946429 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 697057150 0 0) 0x7fc01c001670 con 0x7fc0240b80d0 2024-04-15T00:21:29.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.824+0000 7fc028f87640 1 -- 172.21.15.31:0/201946429 >> v1:172.21.15.31:6789/0 conn(0x7fc0240b80d0 legacy=0x7fc02414adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.824+0000 7fc028f87640 1 --2- 172.21.15.31:0/201946429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc00c0039b0 0x7fc00c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.824+0000 7fc028f87640 1 --2- 172.21.15.31:0/201946429 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc00c004800 0x7fc00c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.824+0000 7fc028f87640 1 --2- 172.21.15.31:0/201946429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc00c0052e0 0x7fc00c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.824+0000 7fc028f87640 1 -- 172.21.15.31:0/201946429 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc0240b84b0 con 0x7fc00c0039b0 2024-04-15T00:21:29.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.824+0000 7fc028f87640 1 -- 172.21.15.31:0/201946429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c00c1b0 con 0x7fc00c0052e0 2024-04-15T00:21:29.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.824+0000 7fc028f87640 1 -- 172.21.15.31:0/201946429 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fc00c00c3b0 con 0x7fc00c004800 2024-04-15T00:21:29.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.824+0000 7fc029f89640 1 --2- 172.21.15.31:0/201946429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc00c0039b0 0x7fc00c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.824+0000 7fc02a78a640 1 --2- 172.21.15.31:0/201946429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc00c0052e0 0x7fc00c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.824+0000 7fc029788640 1 --2- 172.21.15.31:0/201946429 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc00c004800 0x7fc00c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.824+0000 7fc029f89640 1 -- 172.21.15.31:0/201946429 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc00c004800 msgr2=0x7fc00c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:29.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.824+0000 7fc029f89640 1 --2- 172.21.15.31:0/201946429 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc00c004800 0x7fc00c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.824+0000 7fc029f89640 1 -- 172.21.15.31:0/201946429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc00c0052e0 msgr2=0x7fc00c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:29.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.824+0000 7fc029f89640 1 --2- 172.21.15.31:0/201946429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc00c0052e0 0x7fc00c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.824+0000 7fc02a78a640 1 -- 172.21.15.31:0/201946429 reap_dead start 2024-04-15T00:21:29.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.824+0000 7fc029f89640 1 -- 172.21.15.31:0/201946429 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc00c003520 con 0x7fc00c0039b0 2024-04-15T00:21:29.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.824+0000 7fc029788640 1 --2- 172.21.15.31:0/201946429 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc00c004800 0x7fc00c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:29.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.825+0000 7fc029f89640 1 --2- 172.21.15.31:0/201946429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc00c0039b0 0x7fc00c003dd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc01c00c210 tx=0x7fc00c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9509d5851dcc52 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:29.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.825+0000 7fc028f87640 1 -- 172.21.15.31:0/201946429 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01c007d10 con 0x7fc00c0039b0 2024-04-15T00:21:29.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.825+0000 7fc028f87640 1 -- 172.21.15.31:0/201946429 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc01c030070 con 0x7fc00c0039b0 2024-04-15T00:21:29.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.825+0000 7fc028f87640 1 -- 172.21.15.31:0/201946429 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01c005d70 con 0x7fc00c0039b0 2024-04-15T00:21:29.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.826+0000 7fc02c1ed640 1 -- 172.21.15.31:0/201946429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc00c0039b0 msgr2=0x7fc00c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.826+0000 7fc02c1ed640 1 --2- 172.21.15.31:0/201946429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc00c0039b0 0x7fc00c003dd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc01c00c210 tx=0x7fc00c005830 comp rx=0 tx=0).stop 2024-04-15T00:21:29.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.826+0000 7fc02c1ed640 1 -- 172.21.15.31:0/201946429 shutdown_connections 2024-04-15T00:21:29.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.826+0000 7fc02c1ed640 1 --2- 172.21.15.31:0/201946429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc00c0039b0 0x7fc00c003dd0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.826+0000 7fc02c1ed640 1 -- 172.21.15.31:0/201946429 >> 172.21.15.31:0/201946429 conn(0x7fc0240bd020 msgr2=0x7fc0240bd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:29.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.826+0000 7fc02c1ed640 1 -- 172.21.15.31:0/201946429 shutdown_connections 2024-04-15T00:21:29.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.826+0000 7fc02c1ed640 1 -- 172.21.15.31:0/201946429 wait complete. 2024-04-15T00:21:29.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.827+0000 7fc02c1ed640 1 Processor -- start 2024-04-15T00:21:29.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.827+0000 7fc02c1ed640 1 -- start start 2024-04-15T00:21:29.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.827+0000 7fc02c1ed640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc00c0039b0 0x7fc02409ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.827+0000 7fc02c1ed640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc02414a880 0x7fc0241e07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.827+0000 7fc02c1ed640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0241435f0 0x7fc024143a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.827+0000 7fc02c1ed640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc0240726f0 con 0x7fc00c0039b0 2024-04-15T00:21:29.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.827+0000 7fc02c1ed640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc024072570 con 0x7fc0241435f0 2024-04-15T00:21:29.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.827+0000 7fc02c1ed640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fc024072870 con 0x7fc02414a880 2024-04-15T00:21:29.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.827+0000 7fc029f89640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc00c0039b0 0x7fc02409ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.827+0000 7fc029f89640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc00c0039b0 0x7fc02409ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52088/0 (socket says 172.21.15.31:52088) 2024-04-15T00:21:29.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.827+0000 7fc029f89640 1 -- 172.21.15.31:0/619930514 learned_addr learned my addr 172.21.15.31:0/619930514 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:29.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.828+0000 7fc02a78a640 1 --2- 172.21.15.31:0/619930514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0241435f0 0x7fc024143a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.828+0000 7fc029f89640 1 -- 172.21.15.31:0/619930514 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc02414a880 msgr2=0x7fc0241e07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.828+0000 7fc029788640 1 --2- 172.21.15.31:0/619930514 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc02414a880 0x7fc0241e07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.828+0000 7fc029f89640 1 --2- 172.21.15.31:0/619930514 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc02414a880 0x7fc0241e07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.828+0000 7fc029f89640 1 -- 172.21.15.31:0/619930514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0241435f0 msgr2=0x7fc024143a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:29.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.828+0000 7fc029f89640 1 --2- 172.21.15.31:0/619930514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0241435f0 0x7fc024143a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:29.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.828+0000 7fc029f89640 1 -- 172.21.15.31:0/619930514 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0240b61b0 con 0x7fc00c0039b0 2024-04-15T00:21:29.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.828+0000 7fc029f89640 1 --2- 172.21.15.31:0/619930514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc00c0039b0 0x7fc02409ac70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc01c00c210 tx=0x7fc01c02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:29.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.828+0000 7fc0227fc640 1 -- 172.21.15.31:0/619930514 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01c045070 con 0x7fc00c0039b0 2024-04-15T00:21:29.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.828+0000 7fc0227fc640 1 -- 172.21.15.31:0/619930514 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc01c004bf0 con 0x7fc00c0039b0 2024-04-15T00:21:29.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.828+0000 7fc02c1ed640 1 -- 172.21.15.31:0/619930514 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc02409b680 con 0x7fc00c0039b0 2024-04-15T00:21:29.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.828+0000 7fc0227fc640 1 -- 172.21.15.31:0/619930514 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01c007d10 con 0x7fc00c0039b0 2024-04-15T00:21:29.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.828+0000 7fc02c1ed640 1 -- 172.21.15.31:0/619930514 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc02414ad50 con 0x7fc00c0039b0 2024-04-15T00:21:29.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.829+0000 7fc02c1ed640 1 -- 172.21.15.31:0/619930514 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0240b6f60 con 0x7fc00c0039b0 2024-04-15T00:21:29.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.829+0000 7fc0227fc640 1 -- 172.21.15.31:0/619930514 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc01c007070 con 0x7fc00c0039b0 2024-04-15T00:21:29.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.830+0000 7fc0227fc640 1 --2- 172.21.15.31:0/619930514 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc01006b990 0x7fc01006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:29.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.830+0000 7fc0227fc640 1 -- 172.21.15.31:0/619930514 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc01c0ab980 con 0x7fc00c0039b0 2024-04-15T00:21:29.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.830+0000 7fc029788640 1 --2- 172.21.15.31:0/619930514 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc01006b990 0x7fc01006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:29.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.830+0000 7fc029788640 1 --2- 172.21.15.31:0/619930514 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc01006b990 0x7fc01006de50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc0240bcc00 tx=0x7fc018008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:29.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:29.834+0000 7fc0227fc640 1 -- 172.21.15.31:0/619930514 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc0240b6f60 con 0x7fc00c0039b0 2024-04-15T00:21:30.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.011+0000 7fc02c1ed640 1 -- 172.21.15.31:0/619930514 --> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc0241e0cf0 con 0x7fc01006b990 2024-04-15T00:21:30.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.019+0000 7fc0227fc640 1 -- 172.21.15.31:0/619930514 <== mgr.4107 v2:172.21.15.31:6832/915470279 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7fc0241e0cf0 con 0x7fc01006b990 2024-04-15T00:21:30.030 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:21:30.032 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-15T00:21:30.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.022+0000 7fc02c1ed640 1 -- 172.21.15.31:0/619930514 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc01006b990 msgr2=0x7fc01006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:30.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.022+0000 7fc02c1ed640 1 --2- 172.21.15.31:0/619930514 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc01006b990 0x7fc01006de50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc0240bcc00 tx=0x7fc018008040 comp rx=0 tx=0).stop 2024-04-15T00:21:30.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.022+0000 7fc02c1ed640 1 -- 172.21.15.31:0/619930514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc00c0039b0 msgr2=0x7fc02409ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:30.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.022+0000 7fc02c1ed640 1 --2- 172.21.15.31:0/619930514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc00c0039b0 0x7fc02409ac70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc01c00c210 tx=0x7fc01c02e070 comp rx=0 tx=0).stop 2024-04-15T00:21:30.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.022+0000 7fc02c1ed640 1 -- 172.21.15.31:0/619930514 shutdown_connections 2024-04-15T00:21:30.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.022+0000 7fc02c1ed640 1 --2- 172.21.15.31:0/619930514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0241435f0 0x7fc024143a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:30.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.022+0000 7fc02c1ed640 1 --2- 172.21.15.31:0/619930514 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc01006b990 0x7fc01006de50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:30.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.022+0000 7fc02c1ed640 1 --2- 172.21.15.31:0/619930514 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc02414a880 0x7fc0241e07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:30.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.022+0000 7fc02c1ed640 1 --2- 172.21.15.31:0/619930514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc00c0039b0 0x7fc02409ac70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:30.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.022+0000 7fc02c1ed640 1 -- 172.21.15.31:0/619930514 >> 172.21.15.31:0/619930514 conn(0x7fc0240bd020 msgr2=0x7fc024146f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:30.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.022+0000 7fc02c1ed640 1 -- 172.21.15.31:0/619930514 shutdown_connections 2024-04-15T00:21:30.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.022+0000 7fc02c1ed640 1 -- 172.21.15.31:0/619930514 wait complete. 2024-04-15T00:21:30.041 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-04-15T00:21:28.395574+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231920,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742800,"statfs":{"total":773094113280,"available":772856627200,"internally_reserved":0,"allocated":3350528,"data_stored":2022712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002432"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619325+0000","last_change":"2024-04-15T00:21:07.577313+0000","last_active":"2024-04-15T00:21:15.619325+0000","last_peered":"2024-04-15T00:21:15.619325+0000","last_clean":"2024-04-15T00:21:15.619325+0000","last_became_active":"2024-04-15T00:21:07.576921+0000","last_became_peered":"2024-04-15T00:21:07.576921+0000","last_unstale":"2024-04-15T00:21:15.619325+0000","last_undegraded":"2024-04-15T00:21:15.619325+0000","last_fullsized":"2024-04-15T00:21:15.619325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:41:31.846500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603048+0000","last_change":"2024-04-15T00:21:08.579912+0000","last_active":"2024-04-15T00:21:13.603048+0000","last_peered":"2024-04-15T00:21:13.603048+0000","last_clean":"2024-04-15T00:21:13.603048+0000","last_became_active":"2024-04-15T00:21:08.579545+0000","last_became_peered":"2024-04-15T00:21:08.579545+0000","last_unstale":"2024-04-15T00:21:13.603048+0000","last_undegraded":"2024-04-15T00:21:13.603048+0000","last_fullsized":"2024-04-15T00:21:13.603048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602258+0000","last_change":"2024-04-15T00:21:12.634366+0000","last_active":"2024-04-15T00:21:13.602258+0000","last_peered":"2024-04-15T00:21:13.602258+0000","last_clean":"2024-04-15T00:21:13.602258+0000","last_became_active":"2024-04-15T00:21:12.633323+0000","last_became_peered":"2024-04-15T00:21:12.633323+0000","last_unstale":"2024-04-15T00:21:13.602258+0000","last_undegraded":"2024-04-15T00:21:13.602258+0000","last_fullsized":"2024-04-15T00:21:13.602258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:26:21.575108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603161+0000","last_change":"2024-04-15T00:21:07.569057+0000","last_active":"2024-04-15T00:21:13.603161+0000","last_peered":"2024-04-15T00:21:13.603161+0000","last_clean":"2024-04-15T00:21:13.603161+0000","last_became_active":"2024-04-15T00:21:07.568724+0000","last_became_peered":"2024-04-15T00:21:07.568724+0000","last_unstale":"2024-04-15T00:21:13.603161+0000","last_undegraded":"2024-04-15T00:21:13.603161+0000","last_fullsized":"2024-04-15T00:21:13.603161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:21:35.113136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.621077+0000","last_change":"2024-04-15T00:21:08.598196+0000","last_active":"2024-04-15T00:21:15.621077+0000","last_peered":"2024-04-15T00:21:15.621077+0000","last_clean":"2024-04-15T00:21:15.621077+0000","last_became_active":"2024-04-15T00:21:08.597625+0000","last_became_peered":"2024-04-15T00:21:08.597625+0000","last_unstale":"2024-04-15T00:21:15.621077+0000","last_undegraded":"2024-04-15T00:21:15.621077+0000","last_fullsized":"2024-04-15T00:21:15.621077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602202+0000","last_change":"2024-04-15T00:21:12.624625+0000","last_active":"2024-04-15T00:21:13.602202+0000","last_peered":"2024-04-15T00:21:13.602202+0000","last_clean":"2024-04-15T00:21:13.602202+0000","last_became_active":"2024-04-15T00:21:12.624222+0000","last_became_peered":"2024-04-15T00:21:12.624222+0000","last_unstale":"2024-04-15T00:21:13.602202+0000","last_undegraded":"2024-04-15T00:21:13.602202+0000","last_fullsized":"2024-04-15T00:21:13.602202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:28.534842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.536054+0000","last_change":"2024-04-15T00:21:07.576936+0000","last_active":"2024-04-15T00:21:15.536054+0000","last_peered":"2024-04-15T00:21:15.536054+0000","last_clean":"2024-04-15T00:21:15.536054+0000","last_became_active":"2024-04-15T00:21:07.576674+0000","last_became_peered":"2024-04-15T00:21:07.576674+0000","last_unstale":"2024-04-15T00:21:15.536054+0000","last_undegraded":"2024-04-15T00:21:15.536054+0000","last_fullsized":"2024-04-15T00:21:15.536054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603516+0000","last_change":"2024-04-15T00:21:08.587098+0000","last_active":"2024-04-15T00:21:13.603516+0000","last_peered":"2024-04-15T00:21:13.603516+0000","last_clean":"2024-04-15T00:21:13.603516+0000","last_became_active":"2024-04-15T00:21:08.586825+0000","last_became_peered":"2024-04-15T00:21:08.586825+0000","last_unstale":"2024-04-15T00:21:13.603516+0000","last_undegraded":"2024-04-15T00:21:13.603516+0000","last_fullsized":"2024-04-15T00:21:13.603516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:30.470116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.604467+0000","last_change":"2024-04-15T00:21:12.619903+0000","last_active":"2024-04-15T00:21:13.604467+0000","last_peered":"2024-04-15T00:21:13.604467+0000","last_clean":"2024-04-15T00:21:13.604467+0000","last_became_active":"2024-04-15T00:21:12.619259+0000","last_became_peered":"2024-04-15T00:21:12.619259+0000","last_unstale":"2024-04-15T00:21:13.604467+0000","last_undegraded":"2024-04-15T00:21:13.604467+0000","last_fullsized":"2024-04-15T00:21:13.604467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:31.463828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535551+0000","last_change":"2024-04-15T00:21:07.579089+0000","last_active":"2024-04-15T00:21:15.535551+0000","last_peered":"2024-04-15T00:21:15.535551+0000","last_clean":"2024-04-15T00:21:15.535551+0000","last_became_active":"2024-04-15T00:21:07.578733+0000","last_became_peered":"2024-04-15T00:21:07.578733+0000","last_unstale":"2024-04-15T00:21:15.535551+0000","last_undegraded":"2024-04-15T00:21:15.535551+0000","last_fullsized":"2024-04-15T00:21:15.535551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:44:30.015803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603746+0000","last_change":"2024-04-15T00:21:08.588235+0000","last_active":"2024-04-15T00:21:13.603746+0000","last_peered":"2024-04-15T00:21:13.603746+0000","last_clean":"2024-04-15T00:21:13.603746+0000","last_became_active":"2024-04-15T00:21:08.587951+0000","last_became_peered":"2024-04-15T00:21:08.587951+0000","last_unstale":"2024-04-15T00:21:13.603746+0000","last_undegraded":"2024-04-15T00:21:13.603746+0000","last_fullsized":"2024-04-15T00:21:13.603746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:08.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603367+0000","last_change":"2024-04-15T00:21:12.613395+0000","last_active":"2024-04-15T00:21:13.603367+0000","last_peered":"2024-04-15T00:21:13.603367+0000","last_clean":"2024-04-15T00:21:13.603367+0000","last_became_active":"2024-04-15T00:21:12.612976+0000","last_became_peered":"2024-04-15T00:21:12.612976+0000","last_unstale":"2024-04-15T00:21:13.603367+0000","last_undegraded":"2024-04-15T00:21:13.603367+0000","last_fullsized":"2024-04-15T00:21:13.603367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:05.044024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620111+0000","last_change":"2024-04-15T00:21:08.585248+0000","last_active":"2024-04-15T00:21:15.620111+0000","last_peered":"2024-04-15T00:21:15.620111+0000","last_clean":"2024-04-15T00:21:15.620111+0000","last_became_active":"2024-04-15T00:21:08.584882+0000","last_became_peered":"2024-04-15T00:21:08.584882+0000","last_unstale":"2024-04-15T00:21:15.620111+0000","last_undegraded":"2024-04-15T00:21:15.620111+0000","last_fullsized":"2024-04-15T00:21:15.620111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:27:41.268464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535912+0000","last_change":"2024-04-15T00:21:07.580541+0000","last_active":"2024-04-15T00:21:15.535912+0000","last_peered":"2024-04-15T00:21:15.535912+0000","last_clean":"2024-04-15T00:21:15.535912+0000","last_became_active":"2024-04-15T00:21:07.580229+0000","last_became_peered":"2024-04-15T00:21:07.580229+0000","last_unstale":"2024-04-15T00:21:15.535912+0000","last_undegraded":"2024-04-15T00:21:15.535912+0000","last_fullsized":"2024-04-15T00:21:15.535912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:34:26.325595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602904+0000","last_change":"2024-04-15T00:21:12.624175+0000","last_active":"2024-04-15T00:21:13.602904+0000","last_peered":"2024-04-15T00:21:13.602904+0000","last_clean":"2024-04-15T00:21:13.602904+0000","last_became_active":"2024-04-15T00:21:12.623783+0000","last_became_peered":"2024-04-15T00:21:12.623783+0000","last_unstale":"2024-04-15T00:21:13.602904+0000","last_undegraded":"2024-04-15T00:21:13.602904+0000","last_fullsized":"2024-04-15T00:21:13.602904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:22:04.031788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602602+0000","last_change":"2024-04-15T00:21:08.594955+0000","last_active":"2024-04-15T00:21:13.602602+0000","last_peered":"2024-04-15T00:21:13.602602+0000","last_clean":"2024-04-15T00:21:13.602602+0000","last_became_active":"2024-04-15T00:21:08.594535+0000","last_became_peered":"2024-04-15T00:21:08.594535+0000","last_unstale":"2024-04-15T00:21:13.602602+0000","last_undegraded":"2024-04-15T00:21:13.602602+0000","last_fullsized":"2024-04-15T00:21:13.602602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:40.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619669+0000","last_change":"2024-04-15T00:21:07.570862+0000","last_active":"2024-04-15T00:21:15.619669+0000","last_peered":"2024-04-15T00:21:15.619669+0000","last_clean":"2024-04-15T00:21:15.619669+0000","last_became_active":"2024-04-15T00:21:07.570555+0000","last_became_peered":"2024-04-15T00:21:07.570555+0000","last_unstale":"2024-04-15T00:21:15.619669+0000","last_undegraded":"2024-04-15T00:21:15.619669+0000","last_fullsized":"2024-04-15T00:21:15.619669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:54.810223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602579+0000","last_change":"2024-04-15T00:21:12.624936+0000","last_active":"2024-04-15T00:21:13.602579+0000","last_peered":"2024-04-15T00:21:13.602579+0000","last_clean":"2024-04-15T00:21:13.602579+0000","last_became_active":"2024-04-15T00:21:12.623808+0000","last_became_peered":"2024-04-15T00:21:12.623808+0000","last_unstale":"2024-04-15T00:21:13.602579+0000","last_undegraded":"2024-04-15T00:21:13.602579+0000","last_fullsized":"2024-04-15T00:21:13.602579+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:12.264127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602413+0000","last_change":"2024-04-15T00:21:08.574901+0000","last_active":"2024-04-15T00:21:13.602413+0000","last_peered":"2024-04-15T00:21:13.602413+0000","last_clean":"2024-04-15T00:21:13.602413+0000","last_became_active":"2024-04-15T00:21:08.574536+0000","last_became_peered":"2024-04-15T00:21:08.574536+0000","last_unstale":"2024-04-15T00:21:13.602413+0000","last_undegraded":"2024-04-15T00:21:13.602413+0000","last_fullsized":"2024-04-15T00:21:13.602413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:08.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619923+0000","last_change":"2024-04-15T00:21:07.577048+0000","last_active":"2024-04-15T00:21:15.619923+0000","last_peered":"2024-04-15T00:21:15.619923+0000","last_clean":"2024-04-15T00:21:15.619923+0000","last_became_active":"2024-04-15T00:21:07.576739+0000","last_became_peered":"2024-04-15T00:21:07.576739+0000","last_unstale":"2024-04-15T00:21:15.619923+0000","last_undegraded":"2024-04-15T00:21:15.619923+0000","last_fullsized":"2024-04-15T00:21:15.619923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:14.441186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620337+0000","last_change":"2024-04-15T00:21:12.632213+0000","last_active":"2024-04-15T00:21:15.620337+0000","last_peered":"2024-04-15T00:21:15.620337+0000","last_clean":"2024-04-15T00:21:15.620337+0000","last_became_active":"2024-04-15T00:21:12.631900+0000","last_became_peered":"2024-04-15T00:21:12.631900+0000","last_unstale":"2024-04-15T00:21:15.620337+0000","last_undegraded":"2024-04-15T00:21:15.620337+0000","last_fullsized":"2024-04-15T00:21:15.620337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:52:31.142377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602577+0000","last_change":"2024-04-15T00:21:08.590270+0000","last_active":"2024-04-15T00:21:13.602577+0000","last_peered":"2024-04-15T00:21:13.602577+0000","last_clean":"2024-04-15T00:21:13.602577+0000","last_became_active":"2024-04-15T00:21:08.589960+0000","last_became_peered":"2024-04-15T00:21:08.589960+0000","last_unstale":"2024-04-15T00:21:13.602577+0000","last_undegraded":"2024-04-15T00:21:13.602577+0000","last_fullsized":"2024-04-15T00:21:13.602577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:52.880065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535251+0000","last_change":"2024-04-15T00:21:07.577518+0000","last_active":"2024-04-15T00:21:15.535251+0000","last_peered":"2024-04-15T00:21:15.535251+0000","last_clean":"2024-04-15T00:21:15.535251+0000","last_became_active":"2024-04-15T00:21:07.576961+0000","last_became_peered":"2024-04-15T00:21:07.576961+0000","last_unstale":"2024-04-15T00:21:15.535251+0000","last_undegraded":"2024-04-15T00:21:15.535251+0000","last_fullsized":"2024-04-15T00:21:15.535251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:14.441186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602862+0000","last_change":"2024-04-15T00:21:12.624501+0000","last_active":"2024-04-15T00:21:13.602862+0000","last_peered":"2024-04-15T00:21:13.602862+0000","last_clean":"2024-04-15T00:21:13.602862+0000","last_became_active":"2024-04-15T00:21:12.624011+0000","last_became_peered":"2024-04-15T00:21:12.624011+0000","last_unstale":"2024-04-15T00:21:13.602862+0000","last_undegraded":"2024-04-15T00:21:13.602862+0000","last_fullsized":"2024-04-15T00:21:13.602862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:10:28.514357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620962+0000","last_change":"2024-04-15T00:21:08.601349+0000","last_active":"2024-04-15T00:21:15.620962+0000","last_peered":"2024-04-15T00:21:15.620962+0000","last_clean":"2024-04-15T00:21:15.620962+0000","last_became_active":"2024-04-15T00:21:08.601048+0000","last_became_peered":"2024-04-15T00:21:08.601048+0000","last_unstale":"2024-04-15T00:21:15.620962+0000","last_undegraded":"2024-04-15T00:21:15.620962+0000","last_fullsized":"2024-04-15T00:21:15.620962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:27:41.268464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619530+0000","last_change":"2024-04-15T00:21:07.577793+0000","last_active":"2024-04-15T00:21:15.619530+0000","last_peered":"2024-04-15T00:21:15.619530+0000","last_clean":"2024-04-15T00:21:15.619530+0000","last_became_active":"2024-04-15T00:21:07.577472+0000","last_became_peered":"2024-04-15T00:21:07.577472+0000","last_unstale":"2024-04-15T00:21:15.619530+0000","last_undegraded":"2024-04-15T00:21:15.619530+0000","last_fullsized":"2024-04-15T00:21:15.619530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:54.810223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602347+0000","last_change":"2024-04-15T00:21:12.634814+0000","last_active":"2024-04-15T00:21:13.602347+0000","last_peered":"2024-04-15T00:21:13.602347+0000","last_clean":"2024-04-15T00:21:13.602347+0000","last_became_active":"2024-04-15T00:21:12.633228+0000","last_became_peered":"2024-04-15T00:21:12.633228+0000","last_unstale":"2024-04-15T00:21:13.602347+0000","last_undegraded":"2024-04-15T00:21:13.602347+0000","last_fullsized":"2024-04-15T00:21:13.602347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:13.312501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602987+0000","last_change":"2024-04-15T00:21:08.596235+0000","last_active":"2024-04-15T00:21:13.602987+0000","last_peered":"2024-04-15T00:21:13.602987+0000","last_clean":"2024-04-15T00:21:13.602987+0000","last_became_active":"2024-04-15T00:21:08.595901+0000","last_became_peered":"2024-04-15T00:21:08.595901+0000","last_unstale":"2024-04-15T00:21:13.602987+0000","last_undegraded":"2024-04-15T00:21:13.602987+0000","last_fullsized":"2024-04-15T00:21:13.602987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:21:59.995077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620914+0000","last_change":"2024-04-15T00:21:07.573285+0000","last_active":"2024-04-15T00:21:15.620914+0000","last_peered":"2024-04-15T00:21:15.620914+0000","last_clean":"2024-04-15T00:21:15.620914+0000","last_became_active":"2024-04-15T00:21:07.572973+0000","last_became_peered":"2024-04-15T00:21:07.572973+0000","last_unstale":"2024-04-15T00:21:15.620914+0000","last_undegraded":"2024-04-15T00:21:15.620914+0000","last_fullsized":"2024-04-15T00:21:15.620914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602159+0000","last_change":"2024-04-15T00:21:12.633602+0000","last_active":"2024-04-15T00:21:13.602159+0000","last_peered":"2024-04-15T00:21:13.602159+0000","last_clean":"2024-04-15T00:21:13.602159+0000","last_became_active":"2024-04-15T00:21:12.633178+0000","last_became_peered":"2024-04-15T00:21:12.633178+0000","last_unstale":"2024-04-15T00:21:13.602159+0000","last_undegraded":"2024-04-15T00:21:13.602159+0000","last_fullsized":"2024-04-15T00:21:13.602159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:01:48.959493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.621191+0000","last_change":"2024-04-15T00:21:08.580727+0000","last_active":"2024-04-15T00:21:15.621191+0000","last_peered":"2024-04-15T00:21:15.621191+0000","last_clean":"2024-04-15T00:21:15.621191+0000","last_became_active":"2024-04-15T00:21:08.580418+0000","last_became_peered":"2024-04-15T00:21:08.580418+0000","last_unstale":"2024-04-15T00:21:15.621191+0000","last_undegraded":"2024-04-15T00:21:15.621191+0000","last_fullsized":"2024-04-15T00:21:15.621191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.536148+0000","last_change":"2024-04-15T00:21:07.575864+0000","last_active":"2024-04-15T00:21:15.536148+0000","last_peered":"2024-04-15T00:21:15.536148+0000","last_clean":"2024-04-15T00:21:15.536148+0000","last_became_active":"2024-04-15T00:21:07.575562+0000","last_became_peered":"2024-04-15T00:21:07.575562+0000","last_unstale":"2024-04-15T00:21:15.536148+0000","last_undegraded":"2024-04-15T00:21:15.536148+0000","last_fullsized":"2024-04-15T00:21:15.536148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:35:39.009511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620429+0000","last_change":"2024-04-15T00:21:12.633674+0000","last_active":"2024-04-15T00:21:15.620429+0000","last_peered":"2024-04-15T00:21:15.620429+0000","last_clean":"2024-04-15T00:21:15.620429+0000","last_became_active":"2024-04-15T00:21:12.633277+0000","last_became_peered":"2024-04-15T00:21:12.633277+0000","last_unstale":"2024-04-15T00:21:15.620429+0000","last_undegraded":"2024-04-15T00:21:15.620429+0000","last_fullsized":"2024-04-15T00:21:15.620429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:49.295552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603880+0000","last_change":"2024-04-15T00:21:08.578321+0000","last_active":"2024-04-15T00:21:13.603880+0000","last_peered":"2024-04-15T00:21:13.603880+0000","last_clean":"2024-04-15T00:21:13.603880+0000","last_became_active":"2024-04-15T00:21:08.578017+0000","last_became_peered":"2024-04-15T00:21:08.578017+0000","last_unstale":"2024-04-15T00:21:13.603880+0000","last_undegraded":"2024-04-15T00:21:13.603880+0000","last_fullsized":"2024-04-15T00:21:13.603880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:40.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.621338+0000","last_change":"2024-04-15T00:21:07.575183+0000","last_active":"2024-04-15T00:21:15.621338+0000","last_peered":"2024-04-15T00:21:15.621338+0000","last_clean":"2024-04-15T00:21:15.621338+0000","last_became_active":"2024-04-15T00:21:07.574822+0000","last_became_peered":"2024-04-15T00:21:07.574822+0000","last_unstale":"2024-04-15T00:21:15.621338+0000","last_undegraded":"2024-04-15T00:21:15.621338+0000","last_fullsized":"2024-04-15T00:21:15.621338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:26:22.612110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619998+0000","last_change":"2024-04-15T00:21:12.620150+0000","last_active":"2024-04-15T00:21:15.619998+0000","last_peered":"2024-04-15T00:21:15.619998+0000","last_clean":"2024-04-15T00:21:15.619998+0000","last_became_active":"2024-04-15T00:21:12.619694+0000","last_became_peered":"2024-04-15T00:21:12.619694+0000","last_unstale":"2024-04-15T00:21:15.619998+0000","last_undegraded":"2024-04-15T00:21:15.619998+0000","last_fullsized":"2024-04-15T00:21:15.619998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:34.506827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.604336+0000","last_change":"2024-04-15T00:21:08.596959+0000","last_active":"2024-04-15T00:21:13.604336+0000","last_peered":"2024-04-15T00:21:13.604336+0000","last_clean":"2024-04-15T00:21:13.604336+0000","last_became_active":"2024-04-15T00:21:08.596678+0000","last_became_peered":"2024-04-15T00:21:08.596678+0000","last_unstale":"2024-04-15T00:21:13.604336+0000","last_undegraded":"2024-04-15T00:21:13.604336+0000","last_fullsized":"2024-04-15T00:21:13.604336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:35:40.014598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603779+0000","last_change":"2024-04-15T00:21:07.574514+0000","last_active":"2024-04-15T00:21:13.603779+0000","last_peered":"2024-04-15T00:21:13.603779+0000","last_clean":"2024-04-15T00:21:13.603779+0000","last_became_active":"2024-04-15T00:21:07.574228+0000","last_became_peered":"2024-04-15T00:21:07.574228+0000","last_unstale":"2024-04-15T00:21:13.603779+0000","last_undegraded":"2024-04-15T00:21:13.603779+0000","last_fullsized":"2024-04-15T00:21:13.603779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.621262+0000","last_change":"2024-04-15T00:21:12.619733+0000","last_active":"2024-04-15T00:21:15.621262+0000","last_peered":"2024-04-15T00:21:15.621262+0000","last_clean":"2024-04-15T00:21:15.621262+0000","last_became_active":"2024-04-15T00:21:12.619307+0000","last_became_peered":"2024-04-15T00:21:12.619307+0000","last_unstale":"2024-04-15T00:21:15.621262+0000","last_undegraded":"2024-04-15T00:21:15.621262+0000","last_fullsized":"2024-04-15T00:21:15.621262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:48:00.696018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.621663+0000","last_change":"2024-04-15T00:21:08.589246+0000","last_active":"2024-04-15T00:21:15.621663+0000","last_peered":"2024-04-15T00:21:15.621663+0000","last_clean":"2024-04-15T00:21:15.621663+0000","last_became_active":"2024-04-15T00:21:08.588920+0000","last_became_peered":"2024-04-15T00:21:08.588920+0000","last_unstale":"2024-04-15T00:21:15.621663+0000","last_undegraded":"2024-04-15T00:21:15.621663+0000","last_fullsized":"2024-04-15T00:21:15.621663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619227+0000","last_change":"2024-04-15T00:21:07.566537+0000","last_active":"2024-04-15T00:21:15.619227+0000","last_peered":"2024-04-15T00:21:15.619227+0000","last_clean":"2024-04-15T00:21:15.619227+0000","last_became_active":"2024-04-15T00:21:07.566240+0000","last_became_peered":"2024-04-15T00:21:07.566240+0000","last_unstale":"2024-04-15T00:21:15.619227+0000","last_undegraded":"2024-04-15T00:21:15.619227+0000","last_fullsized":"2024-04-15T00:21:15.619227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:16:52.647503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.621073+0000","last_change":"2024-04-15T00:21:12.623452+0000","last_active":"2024-04-15T00:21:15.621073+0000","last_peered":"2024-04-15T00:21:15.621073+0000","last_clean":"2024-04-15T00:21:15.621073+0000","last_became_active":"2024-04-15T00:21:12.623066+0000","last_became_peered":"2024-04-15T00:21:12.623066+0000","last_unstale":"2024-04-15T00:21:15.621073+0000","last_undegraded":"2024-04-15T00:21:15.621073+0000","last_fullsized":"2024-04-15T00:21:15.621073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:11:16.107864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619704+0000","last_change":"2024-04-15T00:21:08.586376+0000","last_active":"2024-04-15T00:21:15.619704+0000","last_peered":"2024-04-15T00:21:15.619704+0000","last_clean":"2024-04-15T00:21:15.619704+0000","last_became_active":"2024-04-15T00:21:08.586054+0000","last_became_peered":"2024-04-15T00:21:08.586054+0000","last_unstale":"2024-04-15T00:21:15.619704+0000","last_undegraded":"2024-04-15T00:21:15.619704+0000","last_fullsized":"2024-04-15T00:21:15.619704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:02:56.329428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535288+0000","last_change":"2024-04-15T00:21:07.577289+0000","last_active":"2024-04-15T00:21:15.535288+0000","last_peered":"2024-04-15T00:21:15.535288+0000","last_clean":"2024-04-15T00:21:15.535288+0000","last_became_active":"2024-04-15T00:21:07.576602+0000","last_became_peered":"2024-04-15T00:21:07.576602+0000","last_unstale":"2024-04-15T00:21:15.535288+0000","last_undegraded":"2024-04-15T00:21:15.535288+0000","last_fullsized":"2024-04-15T00:21:15.535288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:26:22.612110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620938+0000","last_change":"2024-04-15T00:21:12.634248+0000","last_active":"2024-04-15T00:21:15.620938+0000","last_peered":"2024-04-15T00:21:15.620938+0000","last_clean":"2024-04-15T00:21:15.620938+0000","last_became_active":"2024-04-15T00:21:12.633239+0000","last_became_peered":"2024-04-15T00:21:12.633239+0000","last_unstale":"2024-04-15T00:21:15.620938+0000","last_undegraded":"2024-04-15T00:21:15.620938+0000","last_fullsized":"2024-04-15T00:21:15.620938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:52:31.142377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602451+0000","last_change":"2024-04-15T00:21:08.591060+0000","last_active":"2024-04-15T00:21:13.602451+0000","last_peered":"2024-04-15T00:21:13.602451+0000","last_clean":"2024-04-15T00:21:13.602451+0000","last_became_active":"2024-04-15T00:21:08.590781+0000","last_became_peered":"2024-04-15T00:21:08.590781+0000","last_unstale":"2024-04-15T00:21:13.602451+0000","last_undegraded":"2024-04-15T00:21:13.602451+0000","last_fullsized":"2024-04-15T00:21:13.602451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603293+0000","last_change":"2024-04-15T00:21:07.573617+0000","last_active":"2024-04-15T00:21:13.603293+0000","last_peered":"2024-04-15T00:21:13.603293+0000","last_clean":"2024-04-15T00:21:13.603293+0000","last_became_active":"2024-04-15T00:21:07.573308+0000","last_became_peered":"2024-04-15T00:21:07.573308+0000","last_unstale":"2024-04-15T00:21:13.603293+0000","last_undegraded":"2024-04-15T00:21:13.603293+0000","last_fullsized":"2024-04-15T00:21:13.603293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:36:11.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535374+0000","last_change":"2024-04-15T00:20:57.937516+0000","last_active":"2024-04-15T00:21:15.535374+0000","last_peered":"2024-04-15T00:21:15.535374+0000","last_clean":"2024-04-15T00:21:15.535374+0000","last_became_active":"2024-04-15T00:20:57.936329+0000","last_became_peered":"2024-04-15T00:20:57.936329+0000","last_unstale":"2024-04-15T00:21:15.535374+0000","last_undegraded":"2024-04-15T00:21:15.535374+0000","last_fullsized":"2024-04-15T00:21:15.535374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:20:56.517419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:20:56.517419+0000","last_clean_scrub_stamp":"2024-04-15T00:20:56.517419+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:07:23.949459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620409+0000","last_change":"2024-04-15T00:21:12.633530+0000","last_active":"2024-04-15T00:21:15.620409+0000","last_peered":"2024-04-15T00:21:15.620409+0000","last_clean":"2024-04-15T00:21:15.620409+0000","last_became_active":"2024-04-15T00:21:12.633124+0000","last_became_peered":"2024-04-15T00:21:12.633124+0000","last_unstale":"2024-04-15T00:21:15.620409+0000","last_undegraded":"2024-04-15T00:21:15.620409+0000","last_fullsized":"2024-04-15T00:21:15.620409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:49.295552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535728+0000","last_change":"2024-04-15T00:21:08.583443+0000","last_active":"2024-04-15T00:21:15.535728+0000","last_peered":"2024-04-15T00:21:15.535728+0000","last_clean":"2024-04-15T00:21:15.535728+0000","last_became_active":"2024-04-15T00:21:08.583143+0000","last_became_peered":"2024-04-15T00:21:08.583143+0000","last_unstale":"2024-04-15T00:21:15.535728+0000","last_undegraded":"2024-04-15T00:21:15.535728+0000","last_fullsized":"2024-04-15T00:21:15.535728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:01.007313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619590+0000","last_change":"2024-04-15T00:21:07.579386+0000","last_active":"2024-04-15T00:21:15.619590+0000","last_peered":"2024-04-15T00:21:15.619590+0000","last_clean":"2024-04-15T00:21:15.619590+0000","last_became_active":"2024-04-15T00:21:07.579024+0000","last_became_peered":"2024-04-15T00:21:07.579024+0000","last_unstale":"2024-04-15T00:21:15.619590+0000","last_undegraded":"2024-04-15T00:21:15.619590+0000","last_fullsized":"2024-04-15T00:21:15.619590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:36:11.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620189+0000","last_change":"2024-04-15T00:21:12.635286+0000","last_active":"2024-04-15T00:21:15.620189+0000","last_peered":"2024-04-15T00:21:15.620189+0000","last_clean":"2024-04-15T00:21:15.620189+0000","last_became_active":"2024-04-15T00:21:12.634689+0000","last_became_peered":"2024-04-15T00:21:12.634689+0000","last_unstale":"2024-04-15T00:21:15.620189+0000","last_undegraded":"2024-04-15T00:21:15.620189+0000","last_fullsized":"2024-04-15T00:21:15.620189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:05.044024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603811+0000","last_change":"2024-04-15T00:21:08.579790+0000","last_active":"2024-04-15T00:21:13.603811+0000","last_peered":"2024-04-15T00:21:13.603811+0000","last_clean":"2024-04-15T00:21:13.603811+0000","last_became_active":"2024-04-15T00:21:08.576604+0000","last_became_peered":"2024-04-15T00:21:08.576604+0000","last_unstale":"2024-04-15T00:21:13.603811+0000","last_undegraded":"2024-04-15T00:21:13.603811+0000","last_fullsized":"2024-04-15T00:21:13.603811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:52:10.558592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619527+0000","last_change":"2024-04-15T00:21:07.571553+0000","last_active":"2024-04-15T00:21:15.619527+0000","last_peered":"2024-04-15T00:21:15.619527+0000","last_clean":"2024-04-15T00:21:15.619527+0000","last_became_active":"2024-04-15T00:21:07.571238+0000","last_became_peered":"2024-04-15T00:21:07.571238+0000","last_unstale":"2024-04-15T00:21:15.619527+0000","last_undegraded":"2024-04-15T00:21:15.619527+0000","last_fullsized":"2024-04-15T00:21:15.619527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:35:39.009511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620592+0000","last_change":"2024-04-15T00:21:12.619646+0000","last_active":"2024-04-15T00:21:15.620592+0000","last_peered":"2024-04-15T00:21:15.620592+0000","last_clean":"2024-04-15T00:21:15.620592+0000","last_became_active":"2024-04-15T00:21:12.619263+0000","last_became_peered":"2024-04-15T00:21:12.619263+0000","last_unstale":"2024-04-15T00:21:15.620592+0000","last_undegraded":"2024-04-15T00:21:15.620592+0000","last_fullsized":"2024-04-15T00:21:15.620592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:31.463828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.536088+0000","last_change":"2024-04-15T00:21:08.599410+0000","last_active":"2024-04-15T00:21:15.536088+0000","last_peered":"2024-04-15T00:21:15.536088+0000","last_clean":"2024-04-15T00:21:15.536088+0000","last_became_active":"2024-04-15T00:21:08.599132+0000","last_became_peered":"2024-04-15T00:21:08.599132+0000","last_unstale":"2024-04-15T00:21:15.536088+0000","last_undegraded":"2024-04-15T00:21:15.536088+0000","last_fullsized":"2024-04-15T00:21:15.536088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:47:56.659307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619601+0000","last_change":"2024-04-15T00:21:07.567917+0000","last_active":"2024-04-15T00:21:15.619601+0000","last_peered":"2024-04-15T00:21:15.619601+0000","last_clean":"2024-04-15T00:21:15.619601+0000","last_became_active":"2024-04-15T00:21:07.567673+0000","last_became_peered":"2024-04-15T00:21:07.567673+0000","last_unstale":"2024-04-15T00:21:15.619601+0000","last_undegraded":"2024-04-15T00:21:15.619601+0000","last_fullsized":"2024-04-15T00:21:15.619601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:54.810223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602134+0000","last_change":"2024-04-15T00:21:12.632937+0000","last_active":"2024-04-15T00:21:13.602134+0000","last_peered":"2024-04-15T00:21:13.602134+0000","last_clean":"2024-04-15T00:21:13.602134+0000","last_became_active":"2024-04-15T00:21:12.632508+0000","last_became_peered":"2024-04-15T00:21:12.632508+0000","last_unstale":"2024-04-15T00:21:13.602134+0000","last_undegraded":"2024-04-15T00:21:13.602134+0000","last_fullsized":"2024-04-15T00:21:13.602134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:07:36.246879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535820+0000","last_change":"2024-04-15T00:21:08.600430+0000","last_active":"2024-04-15T00:21:15.535820+0000","last_peered":"2024-04-15T00:21:15.535820+0000","last_clean":"2024-04-15T00:21:15.535820+0000","last_became_active":"2024-04-15T00:21:08.600142+0000","last_became_peered":"2024-04-15T00:21:08.600142+0000","last_unstale":"2024-04-15T00:21:15.535820+0000","last_undegraded":"2024-04-15T00:21:15.535820+0000","last_fullsized":"2024-04-15T00:21:15.535820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:30.470116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602933+0000","last_change":"2024-04-15T00:21:07.576781+0000","last_active":"2024-04-15T00:21:13.602933+0000","last_peered":"2024-04-15T00:21:13.602933+0000","last_clean":"2024-04-15T00:21:13.602933+0000","last_became_active":"2024-04-15T00:21:07.576491+0000","last_became_peered":"2024-04-15T00:21:07.576491+0000","last_unstale":"2024-04-15T00:21:13.602933+0000","last_undegraded":"2024-04-15T00:21:13.602933+0000","last_fullsized":"2024-04-15T00:21:13.602933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:41:31.846500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602828+0000","last_change":"2024-04-15T00:21:12.620247+0000","last_active":"2024-04-15T00:21:13.602828+0000","last_peered":"2024-04-15T00:21:13.602828+0000","last_clean":"2024-04-15T00:21:13.602828+0000","last_became_active":"2024-04-15T00:21:12.619257+0000","last_became_peered":"2024-04-15T00:21:12.619257+0000","last_unstale":"2024-04-15T00:21:13.602828+0000","last_undegraded":"2024-04-15T00:21:13.602828+0000","last_fullsized":"2024-04-15T00:21:13.602828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:44.287619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535641+0000","last_change":"2024-04-15T00:21:08.590732+0000","last_active":"2024-04-15T00:21:15.535641+0000","last_peered":"2024-04-15T00:21:15.535641+0000","last_clean":"2024-04-15T00:21:15.535641+0000","last_became_active":"2024-04-15T00:21:08.590450+0000","last_became_peered":"2024-04-15T00:21:08.590450+0000","last_unstale":"2024-04-15T00:21:15.535641+0000","last_undegraded":"2024-04-15T00:21:15.535641+0000","last_fullsized":"2024-04-15T00:21:15.535641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:10:24.477646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619783+0000","last_change":"2024-04-15T00:21:07.566984+0000","last_active":"2024-04-15T00:21:15.619783+0000","last_peered":"2024-04-15T00:21:15.619783+0000","last_clean":"2024-04-15T00:21:15.619783+0000","last_became_active":"2024-04-15T00:21:07.566681+0000","last_became_peered":"2024-04-15T00:21:07.566681+0000","last_unstale":"2024-04-15T00:21:15.619783+0000","last_undegraded":"2024-04-15T00:21:15.619783+0000","last_fullsized":"2024-04-15T00:21:15.619783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:21:35.113136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620857+0000","last_change":"2024-04-15T00:21:12.615981+0000","last_active":"2024-04-15T00:21:15.620857+0000","last_peered":"2024-04-15T00:21:15.620857+0000","last_clean":"2024-04-15T00:21:15.620857+0000","last_became_active":"2024-04-15T00:21:12.615577+0000","last_became_peered":"2024-04-15T00:21:12.615577+0000","last_unstale":"2024-04-15T00:21:15.620857+0000","last_undegraded":"2024-04-15T00:21:15.620857+0000","last_fullsized":"2024-04-15T00:21:15.620857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:52:14.595303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619951+0000","last_change":"2024-04-15T00:21:08.588266+0000","last_active":"2024-04-15T00:21:15.619951+0000","last_peered":"2024-04-15T00:21:15.619951+0000","last_clean":"2024-04-15T00:21:15.619951+0000","last_became_active":"2024-04-15T00:21:08.587962+0000","last_became_peered":"2024-04-15T00:21:08.587962+0000","last_unstale":"2024-04-15T00:21:15.619951+0000","last_undegraded":"2024-04-15T00:21:15.619951+0000","last_fullsized":"2024-04-15T00:21:15.619951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619445+0000","last_change":"2024-04-15T00:21:07.573664+0000","last_active":"2024-04-15T00:21:15.619445+0000","last_peered":"2024-04-15T00:21:15.619445+0000","last_clean":"2024-04-15T00:21:15.619445+0000","last_became_active":"2024-04-15T00:21:07.573325+0000","last_became_peered":"2024-04-15T00:21:07.573325+0000","last_unstale":"2024-04-15T00:21:15.619445+0000","last_undegraded":"2024-04-15T00:21:15.619445+0000","last_fullsized":"2024-04-15T00:21:15.619445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:16:52.647503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602823+0000","last_change":"2024-04-15T00:21:12.634889+0000","last_active":"2024-04-15T00:21:13.602823+0000","last_peered":"2024-04-15T00:21:13.602823+0000","last_clean":"2024-04-15T00:21:13.602823+0000","last_became_active":"2024-04-15T00:21:12.634527+0000","last_became_peered":"2024-04-15T00:21:12.634527+0000","last_unstale":"2024-04-15T00:21:13.602823+0000","last_undegraded":"2024-04-15T00:21:13.602823+0000","last_fullsized":"2024-04-15T00:21:13.602823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:29.469506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535769+0000","last_change":"2024-04-15T00:21:08.593412+0000","last_active":"2024-04-15T00:21:15.535769+0000","last_peered":"2024-04-15T00:21:15.535769+0000","last_clean":"2024-04-15T00:21:15.535769+0000","last_became_active":"2024-04-15T00:21:08.593112+0000","last_became_peered":"2024-04-15T00:21:08.593112+0000","last_unstale":"2024-04-15T00:21:15.535769+0000","last_undegraded":"2024-04-15T00:21:15.535769+0000","last_fullsized":"2024-04-15T00:21:15.535769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:45.258841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603654+0000","last_change":"2024-04-15T00:21:07.576800+0000","last_active":"2024-04-15T00:21:13.603654+0000","last_peered":"2024-04-15T00:21:13.603654+0000","last_clean":"2024-04-15T00:21:13.603654+0000","last_became_active":"2024-04-15T00:21:07.576501+0000","last_became_peered":"2024-04-15T00:21:07.576501+0000","last_unstale":"2024-04-15T00:21:13.603654+0000","last_undegraded":"2024-04-15T00:21:13.603654+0000","last_fullsized":"2024-04-15T00:21:13.603654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:54.810223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603284+0000","last_change":"2024-04-15T00:21:12.634065+0000","last_active":"2024-04-15T00:21:13.603284+0000","last_peered":"2024-04-15T00:21:13.603284+0000","last_clean":"2024-04-15T00:21:13.603284+0000","last_became_active":"2024-04-15T00:21:12.633242+0000","last_became_peered":"2024-04-15T00:21:12.633242+0000","last_unstale":"2024-04-15T00:21:13.603284+0000","last_undegraded":"2024-04-15T00:21:13.603284+0000","last_fullsized":"2024-04-15T00:21:13.603284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:38:32.207334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619978+0000","last_change":"2024-04-15T00:21:08.598979+0000","last_active":"2024-04-15T00:21:15.619978+0000","last_peered":"2024-04-15T00:21:15.619978+0000","last_clean":"2024-04-15T00:21:15.619978+0000","last_became_active":"2024-04-15T00:21:08.598700+0000","last_became_peered":"2024-04-15T00:21:08.598700+0000","last_unstale":"2024-04-15T00:21:15.619978+0000","last_undegraded":"2024-04-15T00:21:15.619978+0000","last_fullsized":"2024-04-15T00:21:15.619978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:10.980339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619067+0000","last_change":"2024-04-15T00:21:07.573340+0000","last_active":"2024-04-15T00:21:15.619067+0000","last_peered":"2024-04-15T00:21:15.619067+0000","last_clean":"2024-04-15T00:21:15.619067+0000","last_became_active":"2024-04-15T00:21:07.572749+0000","last_became_peered":"2024-04-15T00:21:07.572749+0000","last_unstale":"2024-04-15T00:21:15.619067+0000","last_undegraded":"2024-04-15T00:21:15.619067+0000","last_fullsized":"2024-04-15T00:21:15.619067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:05:06.225337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603983+0000","last_change":"2024-04-15T00:21:12.632412+0000","last_active":"2024-04-15T00:21:13.603983+0000","last_peered":"2024-04-15T00:21:13.603983+0000","last_clean":"2024-04-15T00:21:13.603983+0000","last_became_active":"2024-04-15T00:21:12.631982+0000","last_became_peered":"2024-04-15T00:21:12.631982+0000","last_unstale":"2024-04-15T00:21:13.603983+0000","last_undegraded":"2024-04-15T00:21:13.603983+0000","last_fullsized":"2024-04-15T00:21:13.603983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:11:44.674232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535698+0000","last_change":"2024-04-15T00:21:08.582822+0000","last_active":"2024-04-15T00:21:15.535698+0000","last_peered":"2024-04-15T00:21:15.535698+0000","last_clean":"2024-04-15T00:21:15.535698+0000","last_became_active":"2024-04-15T00:21:08.582531+0000","last_became_peered":"2024-04-15T00:21:08.582531+0000","last_unstale":"2024-04-15T00:21:15.535698+0000","last_undegraded":"2024-04-15T00:21:15.535698+0000","last_fullsized":"2024-04-15T00:21:15.535698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:21:59.995077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:17.849923+0000","last_change":"2024-04-15T00:21:07.576694+0000","last_active":"2024-04-15T00:21:17.849923+0000","last_peered":"2024-04-15T00:21:17.849923+0000","last_clean":"2024-04-15T00:21:17.849923+0000","last_became_active":"2024-04-15T00:21:07.576380+0000","last_became_peered":"2024-04-15T00:21:07.576380+0000","last_unstale":"2024-04-15T00:21:17.849923+0000","last_undegraded":"2024-04-15T00:21:17.849923+0000","last_fullsized":"2024-04-15T00:21:17.849923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:36:11.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620233+0000","last_change":"2024-04-15T00:21:12.620928+0000","last_active":"2024-04-15T00:21:15.620233+0000","last_peered":"2024-04-15T00:21:15.620233+0000","last_clean":"2024-04-15T00:21:15.620233+0000","last_became_active":"2024-04-15T00:21:12.620536+0000","last_became_peered":"2024-04-15T00:21:12.620536+0000","last_unstale":"2024-04-15T00:21:15.620233+0000","last_undegraded":"2024-04-15T00:21:15.620233+0000","last_fullsized":"2024-04-15T00:21:15.620233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:52:14.595303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603960+0000","last_change":"2024-04-15T00:21:08.588132+0000","last_active":"2024-04-15T00:21:13.603960+0000","last_peered":"2024-04-15T00:21:13.603960+0000","last_clean":"2024-04-15T00:21:13.603960+0000","last_became_active":"2024-04-15T00:21:08.587383+0000","last_became_peered":"2024-04-15T00:21:08.587383+0000","last_unstale":"2024-04-15T00:21:13.603960+0000","last_undegraded":"2024-04-15T00:21:13.603960+0000","last_fullsized":"2024-04-15T00:21:13.603960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:15.446273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619661+0000","last_change":"2024-04-15T00:21:07.574695+0000","last_active":"2024-04-15T00:21:15.619661+0000","last_peered":"2024-04-15T00:21:15.619661+0000","last_clean":"2024-04-15T00:21:15.619661+0000","last_became_active":"2024-04-15T00:21:07.574389+0000","last_became_peered":"2024-04-15T00:21:07.574389+0000","last_unstale":"2024-04-15T00:21:15.619661+0000","last_undegraded":"2024-04-15T00:21:15.619661+0000","last_fullsized":"2024-04-15T00:21:15.619661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:34:26.325595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.604076+0000","last_change":"2024-04-15T00:21:12.620255+0000","last_active":"2024-04-15T00:21:13.604076+0000","last_peered":"2024-04-15T00:21:13.604076+0000","last_clean":"2024-04-15T00:21:13.604076+0000","last_became_active":"2024-04-15T00:21:12.619218+0000","last_became_peered":"2024-04-15T00:21:12.619218+0000","last_unstale":"2024-04-15T00:21:13.604076+0000","last_undegraded":"2024-04-15T00:21:13.604076+0000","last_fullsized":"2024-04-15T00:21:13.604076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:49.295552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.621210+0000","last_change":"2024-04-15T00:21:08.597898+0000","last_active":"2024-04-15T00:21:15.621210+0000","last_peered":"2024-04-15T00:21:15.621210+0000","last_clean":"2024-04-15T00:21:15.621210+0000","last_became_active":"2024-04-15T00:21:08.597262+0000","last_became_peered":"2024-04-15T00:21:08.597262+0000","last_unstale":"2024-04-15T00:21:15.621210+0000","last_undegraded":"2024-04-15T00:21:15.621210+0000","last_fullsized":"2024-04-15T00:21:15.621210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603559+0000","last_change":"2024-04-15T00:21:07.574003+0000","last_active":"2024-04-15T00:21:13.603559+0000","last_peered":"2024-04-15T00:21:13.603559+0000","last_clean":"2024-04-15T00:21:13.603559+0000","last_became_active":"2024-04-15T00:21:07.573469+0000","last_became_peered":"2024-04-15T00:21:07.573469+0000","last_unstale":"2024-04-15T00:21:13.603559+0000","last_undegraded":"2024-04-15T00:21:13.603559+0000","last_fullsized":"2024-04-15T00:21:13.603559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:16:52.647503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602626+0000","last_change":"2024-04-15T00:21:12.624850+0000","last_active":"2024-04-15T00:21:13.602626+0000","last_peered":"2024-04-15T00:21:13.602626+0000","last_clean":"2024-04-15T00:21:13.602626+0000","last_became_active":"2024-04-15T00:21:12.624484+0000","last_became_peered":"2024-04-15T00:21:12.624484+0000","last_unstale":"2024-04-15T00:21:13.602626+0000","last_undegraded":"2024-04-15T00:21:13.602626+0000","last_fullsized":"2024-04-15T00:21:13.602626+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:15:08.738300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603345+0000","last_change":"2024-04-15T00:21:08.591705+0000","last_active":"2024-04-15T00:21:13.603345+0000","last_peered":"2024-04-15T00:21:13.603345+0000","last_clean":"2024-04-15T00:21:13.603345+0000","last_became_active":"2024-04-15T00:21:08.591407+0000","last_became_peered":"2024-04-15T00:21:08.591407+0000","last_unstale":"2024-04-15T00:21:13.603345+0000","last_undegraded":"2024-04-15T00:21:13.603345+0000","last_fullsized":"2024-04-15T00:21:13.603345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619610+0000","last_change":"2024-04-15T00:21:07.574971+0000","last_active":"2024-04-15T00:21:15.619610+0000","last_peered":"2024-04-15T00:21:15.619610+0000","last_clean":"2024-04-15T00:21:15.619610+0000","last_became_active":"2024-04-15T00:21:07.574656+0000","last_became_peered":"2024-04-15T00:21:07.574656+0000","last_unstale":"2024-04-15T00:21:15.619610+0000","last_undegraded":"2024-04-15T00:21:15.619610+0000","last_fullsized":"2024-04-15T00:21:15.619610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:21:35.113136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602552+0000","last_change":"2024-04-15T00:21:12.633646+0000","last_active":"2024-04-15T00:21:13.602552+0000","last_peered":"2024-04-15T00:21:13.602552+0000","last_clean":"2024-04-15T00:21:13.602552+0000","last_became_active":"2024-04-15T00:21:12.633262+0000","last_became_peered":"2024-04-15T00:21:12.633262+0000","last_unstale":"2024-04-15T00:21:13.602552+0000","last_undegraded":"2024-04-15T00:21:13.602552+0000","last_fullsized":"2024-04-15T00:21:13.602552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:26:17.136974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620791+0000","last_change":"2024-04-15T00:21:12.634552+0000","last_active":"2024-04-15T00:21:15.620791+0000","last_peered":"2024-04-15T00:21:15.620791+0000","last_clean":"2024-04-15T00:21:15.620791+0000","last_became_active":"2024-04-15T00:21:12.633824+0000","last_became_peered":"2024-04-15T00:21:12.633824+0000","last_unstale":"2024-04-15T00:21:15.620791+0000","last_undegraded":"2024-04-15T00:21:15.620791+0000","last_fullsized":"2024-04-15T00:21:15.620791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:34.506827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620127+0000","last_change":"2024-04-15T00:21:08.577988+0000","last_active":"2024-04-15T00:21:15.620127+0000","last_peered":"2024-04-15T00:21:15.620127+0000","last_clean":"2024-04-15T00:21:15.620127+0000","last_became_active":"2024-04-15T00:21:08.577692+0000","last_became_peered":"2024-04-15T00:21:08.577692+0000","last_unstale":"2024-04-15T00:21:15.620127+0000","last_undegraded":"2024-04-15T00:21:15.620127+0000","last_fullsized":"2024-04-15T00:21:15.620127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602539+0000","last_change":"2024-04-15T00:21:07.563155+0000","last_active":"2024-04-15T00:21:13.602539+0000","last_peered":"2024-04-15T00:21:13.602539+0000","last_clean":"2024-04-15T00:21:13.602539+0000","last_became_active":"2024-04-15T00:21:07.562747+0000","last_became_peered":"2024-04-15T00:21:07.562747+0000","last_unstale":"2024-04-15T00:21:13.602539+0000","last_undegraded":"2024-04-15T00:21:13.602539+0000","last_fullsized":"2024-04-15T00:21:13.602539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:21:35.113136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620544+0000","last_change":"2024-04-15T00:21:12.624627+0000","last_active":"2024-04-15T00:21:15.620544+0000","last_peered":"2024-04-15T00:21:15.620544+0000","last_clean":"2024-04-15T00:21:15.620544+0000","last_became_active":"2024-04-15T00:21:12.624245+0000","last_became_peered":"2024-04-15T00:21:12.624245+0000","last_unstale":"2024-04-15T00:21:15.620544+0000","last_undegraded":"2024-04-15T00:21:15.620544+0000","last_fullsized":"2024-04-15T00:21:15.620544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:31.463828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602302+0000","last_change":"2024-04-15T00:21:08.590595+0000","last_active":"2024-04-15T00:21:13.602302+0000","last_peered":"2024-04-15T00:21:13.602302+0000","last_clean":"2024-04-15T00:21:13.602302+0000","last_became_active":"2024-04-15T00:21:08.590333+0000","last_became_peered":"2024-04-15T00:21:08.590333+0000","last_unstale":"2024-04-15T00:21:13.602302+0000","last_undegraded":"2024-04-15T00:21:13.602302+0000","last_fullsized":"2024-04-15T00:21:13.602302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602611+0000","last_change":"2024-04-15T00:21:07.576399+0000","last_active":"2024-04-15T00:21:13.602611+0000","last_peered":"2024-04-15T00:21:13.602611+0000","last_clean":"2024-04-15T00:21:13.602611+0000","last_became_active":"2024-04-15T00:21:07.576008+0000","last_became_peered":"2024-04-15T00:21:07.576008+0000","last_unstale":"2024-04-15T00:21:13.602611+0000","last_undegraded":"2024-04-15T00:21:13.602611+0000","last_fullsized":"2024-04-15T00:21:13.602611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:16:52.647503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619476+0000","last_change":"2024-04-15T00:21:07.572597+0000","last_active":"2024-04-15T00:21:15.619476+0000","last_peered":"2024-04-15T00:21:15.619476+0000","last_clean":"2024-04-15T00:21:15.619476+0000","last_became_active":"2024-04-15T00:21:07.572273+0000","last_became_peered":"2024-04-15T00:21:07.572273+0000","last_unstale":"2024-04-15T00:21:15.619476+0000","last_undegraded":"2024-04-15T00:21:15.619476+0000","last_fullsized":"2024-04-15T00:21:15.619476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620643+0000","last_change":"2024-04-15T00:21:08.587210+0000","last_active":"2024-04-15T00:21:15.620643+0000","last_peered":"2024-04-15T00:21:15.620643+0000","last_clean":"2024-04-15T00:21:15.620643+0000","last_became_active":"2024-04-15T00:21:08.586910+0000","last_became_peered":"2024-04-15T00:21:08.586910+0000","last_unstale":"2024-04-15T00:21:15.620643+0000","last_undegraded":"2024-04-15T00:21:15.620643+0000","last_fullsized":"2024-04-15T00:21:15.620643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619912+0000","last_change":"2024-04-15T00:21:12.622128+0000","last_active":"2024-04-15T00:21:15.619912+0000","last_peered":"2024-04-15T00:21:15.619912+0000","last_clean":"2024-04-15T00:21:15.619912+0000","last_became_active":"2024-04-15T00:21:12.621682+0000","last_became_peered":"2024-04-15T00:21:12.621682+0000","last_unstale":"2024-04-15T00:21:15.619912+0000","last_undegraded":"2024-04-15T00:21:15.619912+0000","last_fullsized":"2024-04-15T00:21:15.619912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:03:00.366139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602718+0000","last_change":"2024-04-15T00:21:07.577069+0000","last_active":"2024-04-15T00:21:13.602718+0000","last_peered":"2024-04-15T00:21:13.602718+0000","last_clean":"2024-04-15T00:21:13.602718+0000","last_became_active":"2024-04-15T00:21:07.576791+0000","last_became_peered":"2024-04-15T00:21:07.576791+0000","last_unstale":"2024-04-15T00:21:13.602718+0000","last_undegraded":"2024-04-15T00:21:13.602718+0000","last_fullsized":"2024-04-15T00:21:13.602718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:36:11.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603254+0000","last_change":"2024-04-15T00:21:08.584214+0000","last_active":"2024-04-15T00:21:13.603254+0000","last_peered":"2024-04-15T00:21:13.603254+0000","last_clean":"2024-04-15T00:21:13.603254+0000","last_became_active":"2024-04-15T00:21:08.583909+0000","last_became_peered":"2024-04-15T00:21:08.583909+0000","last_unstale":"2024-04-15T00:21:13.603254+0000","last_undegraded":"2024-04-15T00:21:13.603254+0000","last_fullsized":"2024-04-15T00:21:13.603254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:55.815311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602896+0000","last_change":"2024-04-15T00:21:12.624156+0000","last_active":"2024-04-15T00:21:13.602896+0000","last_peered":"2024-04-15T00:21:13.602896+0000","last_clean":"2024-04-15T00:21:13.602896+0000","last_became_active":"2024-04-15T00:21:12.623756+0000","last_became_peered":"2024-04-15T00:21:12.623756+0000","last_unstale":"2024-04-15T00:21:13.602896+0000","last_undegraded":"2024-04-15T00:21:13.602896+0000","last_fullsized":"2024-04-15T00:21:13.602896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:31:33.202296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619829+0000","last_change":"2024-04-15T00:21:08.588647+0000","last_active":"2024-04-15T00:21:15.619829+0000","last_peered":"2024-04-15T00:21:15.619829+0000","last_clean":"2024-04-15T00:21:15.619829+0000","last_became_active":"2024-04-15T00:21:08.587719+0000","last_became_peered":"2024-04-15T00:21:08.587719+0000","last_unstale":"2024-04-15T00:21:15.619829+0000","last_undegraded":"2024-04-15T00:21:15.619829+0000","last_fullsized":"2024-04-15T00:21:15.619829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:39.454082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619475+0000","last_change":"2024-04-15T00:21:08.596094+0000","last_active":"2024-04-15T00:21:15.619475+0000","last_peered":"2024-04-15T00:21:15.619475+0000","last_clean":"2024-04-15T00:21:15.619475+0000","last_became_active":"2024-04-15T00:21:08.595790+0000","last_became_peered":"2024-04-15T00:21:08.595790+0000","last_unstale":"2024-04-15T00:21:15.619475+0000","last_undegraded":"2024-04-15T00:21:15.619475+0000","last_fullsized":"2024-04-15T00:21:15.619475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:15.446273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603593+0000","last_change":"2024-04-15T00:21:08.583148+0000","last_active":"2024-04-15T00:21:13.603593+0000","last_peered":"2024-04-15T00:21:13.603593+0000","last_clean":"2024-04-15T00:21:13.603593+0000","last_became_active":"2024-04-15T00:21:08.582801+0000","last_became_peered":"2024-04-15T00:21:08.582801+0000","last_unstale":"2024-04-15T00:21:13.603593+0000","last_undegraded":"2024-04-15T00:21:13.603593+0000","last_fullsized":"2024-04-15T00:21:13.603593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:01.007313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620505+0000","last_change":"2024-04-15T00:21:08.596406+0000","last_active":"2024-04-15T00:21:15.620505+0000","last_peered":"2024-04-15T00:21:15.620505+0000","last_clean":"2024-04-15T00:21:15.620505+0000","last_became_active":"2024-04-15T00:21:08.596144+0000","last_became_peered":"2024-04-15T00:21:08.596144+0000","last_unstale":"2024-04-15T00:21:15.620505+0000","last_undegraded":"2024-04-15T00:21:15.620505+0000","last_fullsized":"2024-04-15T00:21:15.620505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603411+0000","last_change":"2024-04-15T00:21:08.591959+0000","last_active":"2024-04-15T00:21:13.603411+0000","last_peered":"2024-04-15T00:21:13.603411+0000","last_clean":"2024-04-15T00:21:13.603411+0000","last_became_active":"2024-04-15T00:21:08.591479+0000","last_became_peered":"2024-04-15T00:21:08.591479+0000","last_unstale":"2024-04-15T00:21:13.603411+0000","last_undegraded":"2024-04-15T00:21:13.603411+0000","last_fullsized":"2024-04-15T00:21:13.603411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619869+0000","last_change":"2024-04-15T00:21:08.577658+0000","last_active":"2024-04-15T00:21:15.619869+0000","last_peered":"2024-04-15T00:21:15.619869+0000","last_clean":"2024-04-15T00:21:15.619869+0000","last_became_active":"2024-04-15T00:21:08.577358+0000","last_became_peered":"2024-04-15T00:21:08.577358+0000","last_unstale":"2024-04-15T00:21:15.619869+0000","last_undegraded":"2024-04-15T00:21:15.619869+0000","last_fullsized":"2024-04-15T00:21:15.619869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620568+0000","last_change":"2024-04-15T00:21:08.593462+0000","last_active":"2024-04-15T00:21:15.620568+0000","last_peered":"2024-04-15T00:21:15.620568+0000","last_clean":"2024-04-15T00:21:15.620568+0000","last_became_active":"2024-04-15T00:21:08.593174+0000","last_became_peered":"2024-04-15T00:21:08.593174+0000","last_unstale":"2024-04-15T00:21:15.620568+0000","last_undegraded":"2024-04-15T00:21:15.620568+0000","last_fullsized":"2024-04-15T00:21:15.620568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602883+0000","last_change":"2024-04-15T00:21:08.582109+0000","last_active":"2024-04-15T00:21:13.602883+0000","last_peered":"2024-04-15T00:21:13.602883+0000","last_clean":"2024-04-15T00:21:13.602883+0000","last_became_active":"2024-04-15T00:21:08.581828+0000","last_became_peered":"2024-04-15T00:21:08.581828+0000","last_unstale":"2024-04-15T00:21:13.602883+0000","last_undegraded":"2024-04-15T00:21:13.602883+0000","last_fullsized":"2024-04-15T00:21:13.602883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:01.007313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602485+0000","last_change":"2024-04-15T00:21:08.582329+0000","last_active":"2024-04-15T00:21:13.602485+0000","last_peered":"2024-04-15T00:21:13.602485+0000","last_clean":"2024-04-15T00:21:13.602485+0000","last_became_active":"2024-04-15T00:21:08.582011+0000","last_became_peered":"2024-04-15T00:21:08.582011+0000","last_unstale":"2024-04-15T00:21:13.602485+0000","last_undegraded":"2024-04-15T00:21:13.602485+0000","last_fullsized":"2024-04-15T00:21:13.602485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602496+0000","last_change":"2024-04-15T00:21:08.581215+0000","last_active":"2024-04-15T00:21:13.602496+0000","last_peered":"2024-04-15T00:21:13.602496+0000","last_clean":"2024-04-15T00:21:13.602496+0000","last_became_active":"2024-04-15T00:21:08.579860+0000","last_became_peered":"2024-04-15T00:21:08.579860+0000","last_unstale":"2024-04-15T00:21:13.602496+0000","last_undegraded":"2024-04-15T00:21:13.602496+0000","last_fullsized":"2024-04-15T00:21:13.602496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603446+0000","last_change":"2024-04-15T00:21:08.592785+0000","last_active":"2024-04-15T00:21:13.603446+0000","last_peered":"2024-04-15T00:21:13.603446+0000","last_clean":"2024-04-15T00:21:13.603446+0000","last_became_active":"2024-04-15T00:21:08.592110+0000","last_became_peered":"2024-04-15T00:21:08.592110+0000","last_unstale":"2024-04-15T00:21:13.603446+0000","last_undegraded":"2024-04-15T00:21:13.603446+0000","last_fullsized":"2024-04-15T00:21:13.603446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:45.258841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620413+0000","last_change":"2024-04-15T00:21:08.599781+0000","last_active":"2024-04-15T00:21:15.620413+0000","last_peered":"2024-04-15T00:21:15.620413+0000","last_clean":"2024-04-15T00:21:15.620413+0000","last_became_active":"2024-04-15T00:21:08.599460+0000","last_became_peered":"2024-04-15T00:21:08.599460+0000","last_unstale":"2024-04-15T00:21:15.620413+0000","last_undegraded":"2024-04-15T00:21:15.620413+0000","last_fullsized":"2024-04-15T00:21:15.620413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:39.454082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620344+0000","last_change":"2024-04-15T00:21:08.588233+0000","last_active":"2024-04-15T00:21:15.620344+0000","last_peered":"2024-04-15T00:21:15.620344+0000","last_clean":"2024-04-15T00:21:15.620344+0000","last_became_active":"2024-04-15T00:21:08.586235+0000","last_became_peered":"2024-04-15T00:21:08.586235+0000","last_unstale":"2024-04-15T00:21:15.620344+0000","last_undegraded":"2024-04-15T00:21:15.620344+0000","last_fullsized":"2024-04-15T00:21:15.620344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.536068+0000","last_change":"2024-04-15T00:21:08.582000+0000","last_active":"2024-04-15T00:21:15.536068+0000","last_peered":"2024-04-15T00:21:15.536068+0000","last_clean":"2024-04-15T00:21:15.536068+0000","last_became_active":"2024-04-15T00:21:08.581714+0000","last_became_peered":"2024-04-15T00:21:08.581714+0000","last_unstale":"2024-04-15T00:21:15.536068+0000","last_undegraded":"2024-04-15T00:21:15.536068+0000","last_fullsized":"2024-04-15T00:21:15.536068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:27.427117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620436+0000","last_change":"2024-04-15T00:21:08.582994+0000","last_active":"2024-04-15T00:21:15.620436+0000","last_peered":"2024-04-15T00:21:15.620436+0000","last_clean":"2024-04-15T00:21:15.620436+0000","last_became_active":"2024-04-15T00:21:08.582594+0000","last_became_peered":"2024-04-15T00:21:08.582594+0000","last_unstale":"2024-04-15T00:21:15.620436+0000","last_undegraded":"2024-04-15T00:21:15.620436+0000","last_fullsized":"2024-04-15T00:21:15.620436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:26:23.617197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.604186+0000","last_change":"2024-04-15T00:21:08.591937+0000","last_active":"2024-04-15T00:21:13.604186+0000","last_peered":"2024-04-15T00:21:13.604186+0000","last_clean":"2024-04-15T00:21:13.604186+0000","last_became_active":"2024-04-15T00:21:08.591655+0000","last_became_peered":"2024-04-15T00:21:08.591655+0000","last_unstale":"2024-04-15T00:21:13.604186+0000","last_undegraded":"2024-04-15T00:21:13.604186+0000","last_fullsized":"2024-04-15T00:21:13.604186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:21:59.995077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602330+0000","last_change":"2024-04-15T00:21:08.590844+0000","last_active":"2024-04-15T00:21:13.602330+0000","last_peered":"2024-04-15T00:21:13.602330+0000","last_clean":"2024-04-15T00:21:13.602330+0000","last_became_active":"2024-04-15T00:21:08.588982+0000","last_became_peered":"2024-04-15T00:21:08.588982+0000","last_unstale":"2024-04-15T00:21:13.602330+0000","last_undegraded":"2024-04-15T00:21:13.602330+0000","last_fullsized":"2024-04-15T00:21:13.602330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620225+0000","last_change":"2024-04-15T00:21:08.581452+0000","last_active":"2024-04-15T00:21:15.620225+0000","last_peered":"2024-04-15T00:21:15.620225+0000","last_clean":"2024-04-15T00:21:15.620225+0000","last_became_active":"2024-04-15T00:21:08.580967+0000","last_became_peered":"2024-04-15T00:21:08.580967+0000","last_unstale":"2024-04-15T00:21:15.620225+0000","last_undegraded":"2024-04-15T00:21:15.620225+0000","last_fullsized":"2024-04-15T00:21:15.620225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619889+0000","last_change":"2024-04-15T00:21:08.587249+0000","last_active":"2024-04-15T00:21:15.619889+0000","last_peered":"2024-04-15T00:21:15.619889+0000","last_clean":"2024-04-15T00:21:15.619889+0000","last_became_active":"2024-04-15T00:21:08.586885+0000","last_became_peered":"2024-04-15T00:21:08.586885+0000","last_unstale":"2024-04-15T00:21:15.619889+0000","last_undegraded":"2024-04-15T00:21:15.619889+0000","last_fullsized":"2024-04-15T00:21:15.619889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:44:31.020890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602456+0000","last_change":"2024-04-15T00:21:08.579970+0000","last_active":"2024-04-15T00:21:13.602456+0000","last_peered":"2024-04-15T00:21:13.602456+0000","last_clean":"2024-04-15T00:21:13.602456+0000","last_became_active":"2024-04-15T00:21:08.579652+0000","last_became_peered":"2024-04-15T00:21:08.579652+0000","last_unstale":"2024-04-15T00:21:13.602456+0000","last_undegraded":"2024-04-15T00:21:13.602456+0000","last_fullsized":"2024-04-15T00:21:13.602456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:10:24.477646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602944+0000","last_change":"2024-04-15T00:21:08.588376+0000","last_active":"2024-04-15T00:21:13.602944+0000","last_peered":"2024-04-15T00:21:13.602944+0000","last_clean":"2024-04-15T00:21:13.602944+0000","last_became_active":"2024-04-15T00:21:08.587712+0000","last_became_peered":"2024-04-15T00:21:08.587712+0000","last_unstale":"2024-04-15T00:21:13.602944+0000","last_undegraded":"2024-04-15T00:21:13.602944+0000","last_fullsized":"2024-04-15T00:21:13.602944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:34:27.330682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620402+0000","last_change":"2024-04-15T00:21:08.597204+0000","last_active":"2024-04-15T00:21:15.620402+0000","last_peered":"2024-04-15T00:21:15.620402+0000","last_clean":"2024-04-15T00:21:15.620402+0000","last_became_active":"2024-04-15T00:21:08.596862+0000","last_became_peered":"2024-04-15T00:21:08.596862+0000","last_unstale":"2024-04-15T00:21:15.620402+0000","last_undegraded":"2024-04-15T00:21:15.620402+0000","last_fullsized":"2024-04-15T00:21:15.620402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620515+0000","last_change":"2024-04-15T00:21:08.598199+0000","last_active":"2024-04-15T00:21:15.620515+0000","last_peered":"2024-04-15T00:21:15.620515+0000","last_clean":"2024-04-15T00:21:15.620515+0000","last_became_active":"2024-04-15T00:21:08.597790+0000","last_became_peered":"2024-04-15T00:21:08.597790+0000","last_unstale":"2024-04-15T00:21:15.620515+0000","last_undegraded":"2024-04-15T00:21:15.620515+0000","last_fullsized":"2024-04-15T00:21:15.620515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.536057+0000","last_change":"2024-04-15T00:21:08.600496+0000","last_active":"2024-04-15T00:21:15.536057+0000","last_peered":"2024-04-15T00:21:15.536057+0000","last_clean":"2024-04-15T00:21:15.536057+0000","last_became_active":"2024-04-15T00:21:08.600121+0000","last_became_peered":"2024-04-15T00:21:08.600121+0000","last_unstale":"2024-04-15T00:21:15.536057+0000","last_undegraded":"2024-04-15T00:21:15.536057+0000","last_fullsized":"2024-04-15T00:21:15.536057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:11:12.071153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602194+0000","last_change":"2024-04-15T00:21:08.583866+0000","last_active":"2024-04-15T00:21:13.602194+0000","last_peered":"2024-04-15T00:21:13.602194+0000","last_clean":"2024-04-15T00:21:13.602194+0000","last_became_active":"2024-04-15T00:21:08.583563+0000","last_became_peered":"2024-04-15T00:21:08.583563+0000","last_unstale":"2024-04-15T00:21:13.602194+0000","last_undegraded":"2024-04-15T00:21:13.602194+0000","last_fullsized":"2024-04-15T00:21:13.602194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:27:41.268464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535532+0000","last_change":"2024-04-15T00:21:08.596983+0000","last_active":"2024-04-15T00:21:15.535532+0000","last_peered":"2024-04-15T00:21:15.535532+0000","last_clean":"2024-04-15T00:21:15.535532+0000","last_became_active":"2024-04-15T00:21:08.596640+0000","last_became_peered":"2024-04-15T00:21:08.596640+0000","last_unstale":"2024-04-15T00:21:15.535532+0000","last_undegraded":"2024-04-15T00:21:15.535532+0000","last_fullsized":"2024-04-15T00:21:15.535532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:40.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603293+0000","last_change":"2024-04-15T00:21:08.593027+0000","last_active":"2024-04-15T00:21:13.603293+0000","last_peered":"2024-04-15T00:21:13.603293+0000","last_clean":"2024-04-15T00:21:13.603293+0000","last_became_active":"2024-04-15T00:21:08.592476+0000","last_became_peered":"2024-04-15T00:21:08.592476+0000","last_unstale":"2024-04-15T00:21:13.603293+0000","last_undegraded":"2024-04-15T00:21:13.603293+0000","last_fullsized":"2024-04-15T00:21:13.603293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:10:24.477646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535675+0000","last_change":"2024-04-15T00:21:08.591419+0000","last_active":"2024-04-15T00:21:15.535675+0000","last_peered":"2024-04-15T00:21:15.535675+0000","last_clean":"2024-04-15T00:21:15.535675+0000","last_became_active":"2024-04-15T00:21:08.591101+0000","last_became_peered":"2024-04-15T00:21:08.591101+0000","last_unstale":"2024-04-15T00:21:15.535675+0000","last_undegraded":"2024-04-15T00:21:15.535675+0000","last_fullsized":"2024-04-15T00:21:15.535675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:52:10.558592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603323+0000","last_change":"2024-04-15T00:21:08.581621+0000","last_active":"2024-04-15T00:21:13.603323+0000","last_peered":"2024-04-15T00:21:13.603323+0000","last_clean":"2024-04-15T00:21:13.603323+0000","last_became_active":"2024-04-15T00:21:08.581316+0000","last_became_peered":"2024-04-15T00:21:08.581316+0000","last_unstale":"2024-04-15T00:21:13.603323+0000","last_undegraded":"2024-04-15T00:21:13.603323+0000","last_fullsized":"2024-04-15T00:21:13.603323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:27.427117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620634+0000","last_change":"2024-04-15T00:21:08.590252+0000","last_active":"2024-04-15T00:21:15.620634+0000","last_peered":"2024-04-15T00:21:15.620634+0000","last_clean":"2024-04-15T00:21:15.620634+0000","last_became_active":"2024-04-15T00:21:08.589919+0000","last_became_peered":"2024-04-15T00:21:08.589919+0000","last_unstale":"2024-04-15T00:21:15.620634+0000","last_undegraded":"2024-04-15T00:21:15.620634+0000","last_fullsized":"2024-04-15T00:21:15.620634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:46:53.537904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620862+0000","last_change":"2024-04-15T00:21:08.588530+0000","last_active":"2024-04-15T00:21:15.620862+0000","last_peered":"2024-04-15T00:21:15.620862+0000","last_clean":"2024-04-15T00:21:15.620862+0000","last_became_active":"2024-04-15T00:21:08.588208+0000","last_became_peered":"2024-04-15T00:21:08.588208+0000","last_unstale":"2024-04-15T00:21:15.620862+0000","last_undegraded":"2024-04-15T00:21:15.620862+0000","last_fullsized":"2024-04-15T00:21:15.620862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:08.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535948+0000","last_change":"2024-04-15T00:21:08.588469+0000","last_active":"2024-04-15T00:21:15.535948+0000","last_peered":"2024-04-15T00:21:15.535948+0000","last_clean":"2024-04-15T00:21:15.535948+0000","last_became_active":"2024-04-15T00:21:08.587646+0000","last_became_peered":"2024-04-15T00:21:08.587646+0000","last_unstale":"2024-04-15T00:21:15.535948+0000","last_undegraded":"2024-04-15T00:21:15.535948+0000","last_fullsized":"2024-04-15T00:21:15.535948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:52:27.105666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":107929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":104087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":695093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":695037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":107929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":104177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":274432,"data_stored":104213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":104247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T00:21:30.046 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T00:21:30.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.175+0000 7fb95dcde640 1 Processor -- start 2024-04-15T00:21:30.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.175+0000 7fb95dcde640 1 -- start start 2024-04-15T00:21:30.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.176+0000 7fb95dcde640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb9581461d0 0x7fb95813edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:30.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.176+0000 7fb95dcde640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb9580b13a0 0x7fb95813f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:30.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.176+0000 7fb95dcde640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9581456f0 con 0x7fb9580b0fc0 2024-04-15T00:21:30.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.176+0000 7fb95dcde640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fb958145d40 con 0x7fb9580b13a0 2024-04-15T00:21:30.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.176+0000 7fb95dcde640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fb9581459d0 con 0x7fb9581461d0 2024-04-15T00:21:30.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.176+0000 7fb9577fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb9580b0fc0 0x7fb958071430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:39472/0 (socket says 172.21.15.31:39472) 2024-04-15T00:21:30.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.176+0000 7fb9577fe640 1 -- 172.21.15.31:0/4007897045 learned_addr learned my addr 172.21.15.31:0/4007897045 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:30.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.176+0000 7fb956ffd640 1 --2- 172.21.15.31:0/4007897045 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb9581461d0 0x7fb95813edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:30.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.176+0000 7fb957fff640 1 --2- 172.21.15.31:0/4007897045 >> v2:172.21.15.50:3300/0 conn(0x7fb9580b13a0 0x7fb95813f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:30.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.176+0000 7fb9567fc640 1 -- 172.21.15.31:0/4007897045 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4115538795 0 0) 0x7fb9581456f0 con 0x7fb9580b0fc0 2024-04-15T00:21:30.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.176+0000 7fb9567fc640 1 -- 172.21.15.31:0/4007897045 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb940003520 con 0x7fb9580b0fc0 2024-04-15T00:21:30.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.176+0000 7fb956ffd640 1 -- 172.21.15.31:0/4007897045 >> v2:172.21.15.50:3300/0 conn(0x7fb9580b13a0 msgr2=0x7fb95813f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:30.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.176+0000 7fb956ffd640 1 --2- 172.21.15.31:0/4007897045 >> v2:172.21.15.50:3300/0 conn(0x7fb9580b13a0 0x7fb95813f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:30.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.176+0000 7fb956ffd640 1 -- 172.21.15.31:0/4007897045 >> v1:172.21.15.31:6789/0 conn(0x7fb9580b0fc0 legacy=0x7fb958071430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:30.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.176+0000 7fb956ffd640 1 -- 172.21.15.31:0/4007897045 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb958072da0 con 0x7fb9581461d0 2024-04-15T00:21:30.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.177+0000 7fb956ffd640 1 --2- 172.21.15.31:0/4007897045 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb9581461d0 0x7fb95813edc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0097a0 tx=0x7fb94c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1d22c48536c57fd server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:30.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.177+0000 7fb9567fc640 1 -- 172.21.15.31:0/4007897045 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c0315a0 con 0x7fb9581461d0 2024-04-15T00:21:30.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.177+0000 7fb9567fc640 1 -- 172.21.15.31:0/4007897045 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb94c037070 con 0x7fb9581461d0 2024-04-15T00:21:30.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.177+0000 7fb9567fc640 1 -- 172.21.15.31:0/4007897045 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c031960 con 0x7fb9581461d0 2024-04-15T00:21:30.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.178+0000 7fb95dcde640 1 -- 172.21.15.31:0/4007897045 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb9581461d0 msgr2=0x7fb95813edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:30.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.178+0000 7fb95dcde640 1 --2- 172.21.15.31:0/4007897045 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb9581461d0 0x7fb95813edc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0097a0 tx=0x7fb94c02b840 comp rx=0 tx=0).stop 2024-04-15T00:21:30.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.178+0000 7fb95dcde640 1 -- 172.21.15.31:0/4007897045 shutdown_connections 2024-04-15T00:21:30.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.178+0000 7fb95dcde640 1 --2- 172.21.15.31:0/4007897045 >> v2:172.21.15.50:3300/0 conn(0x7fb9580b13a0 0x7fb95813f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:30.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.178+0000 7fb95dcde640 1 --2- 172.21.15.31:0/4007897045 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb9581461d0 0x7fb95813edc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:30.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.178+0000 7fb95dcde640 1 -- 172.21.15.31:0/4007897045 >> 172.21.15.31:0/4007897045 conn(0x7fb9580b77b0 msgr2=0x7fb9580b7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:30.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.178+0000 7fb95dcde640 1 -- 172.21.15.31:0/4007897045 shutdown_connections 2024-04-15T00:21:30.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.178+0000 7fb95dcde640 1 -- 172.21.15.31:0/4007897045 wait complete. 2024-04-15T00:21:30.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.179+0000 7fb95dcde640 1 Processor -- start 2024-04-15T00:21:30.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.179+0000 7fb95dcde640 1 -- start start 2024-04-15T00:21:30.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.180+0000 7fb95dcde640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb9580b0fc0 0x7fb958148360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:30.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.180+0000 7fb95dcde640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9580b13a0 0x7fb9581488a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:30.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.180+0000 7fb95dcde640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9581461d0 0x7fb9581de1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:30.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.180+0000 7fb95dcde640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb9580b1e90 con 0x7fb9580b13a0 2024-04-15T00:21:30.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.180+0000 7fb95dcde640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb9580b1d10 con 0x7fb9581461d0 2024-04-15T00:21:30.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.180+0000 7fb95dcde640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fb95813f840 con 0x7fb9580b0fc0 2024-04-15T00:21:30.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.180+0000 7fb956ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9580b13a0 0x7fb9581488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:30.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.180+0000 7fb956ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9580b13a0 0x7fb9581488a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52100/0 (socket says 172.21.15.31:52100) 2024-04-15T00:21:30.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.180+0000 7fb956ffd640 1 -- 172.21.15.31:0/2124559909 learned_addr learned my addr 172.21.15.31:0/2124559909 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:30.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.180+0000 7fb9577fe640 1 --2- 172.21.15.31:0/2124559909 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb9580b0fc0 0x7fb958148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:30.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.180+0000 7fb957fff640 1 --2- 172.21.15.31:0/2124559909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9581461d0 0x7fb9581de1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:30.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.180+0000 7fb956ffd640 1 -- 172.21.15.31:0/2124559909 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb9580b0fc0 msgr2=0x7fb958148360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:30.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.180+0000 7fb956ffd640 1 --2- 172.21.15.31:0/2124559909 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb9580b0fc0 0x7fb958148360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:30.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.180+0000 7fb956ffd640 1 -- 172.21.15.31:0/2124559909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9581461d0 msgr2=0x7fb9581de1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:30.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.180+0000 7fb956ffd640 1 --2- 172.21.15.31:0/2124559909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9581461d0 0x7fb9581de1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:30.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.180+0000 7fb956ffd640 1 -- 172.21.15.31:0/2124559909 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9581495e0 con 0x7fb9580b13a0 2024-04-15T00:21:30.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.180+0000 7fb957fff640 1 --2- 172.21.15.31:0/2124559909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9581461d0 0x7fb9581de1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:30.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.180+0000 7fb956ffd640 1 --2- 172.21.15.31:0/2124559909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9580b13a0 0x7fb9581488a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb94c02be50 tx=0x7fb94c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:30.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.180+0000 7fb93ffff640 1 -- 172.21.15.31:0/2124559909 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c032630 con 0x7fb9580b13a0 2024-04-15T00:21:30.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.180+0000 7fb93ffff640 1 -- 172.21.15.31:0/2124559909 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb94c0327f0 con 0x7fb9580b13a0 2024-04-15T00:21:30.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.180+0000 7fb95dcde640 1 -- 172.21.15.31:0/2124559909 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9580b4190 con 0x7fb9580b13a0 2024-04-15T00:21:30.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.180+0000 7fb93ffff640 1 -- 172.21.15.31:0/2124559909 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c032be0 con 0x7fb9580b13a0 2024-04-15T00:21:30.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.181+0000 7fb95dcde640 1 -- 172.21.15.31:0/2124559909 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb958142e60 con 0x7fb9580b13a0 2024-04-15T00:21:30.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.182+0000 7fb95dcde640 1 -- 172.21.15.31:0/2124559909 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9580b3f80 con 0x7fb9580b13a0 2024-04-15T00:21:30.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.182+0000 7fb93ffff640 1 -- 172.21.15.31:0/2124559909 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fb94c04c020 con 0x7fb9580b13a0 2024-04-15T00:21:30.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.182+0000 7fb93ffff640 1 --2- 172.21.15.31:0/2124559909 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb94406b990 0x7fb94406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:30.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.182+0000 7fb93ffff640 1 -- 172.21.15.31:0/2124559909 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb94c02f020 con 0x7fb9580b13a0 2024-04-15T00:21:30.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.182+0000 7fb9577fe640 1 --2- 172.21.15.31:0/2124559909 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb94406b990 0x7fb94406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:30.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.183+0000 7fb9577fe640 1 --2- 172.21.15.31:0/2124559909 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb94406b990 0x7fb94406de50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb948005c00 tx=0x7fb948009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:30.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.187+0000 7fb93ffff640 1 -- 172.21.15.31:0/2124559909 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb94c040070 con 0x7fb9580b13a0 2024-04-15T00:21:30.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.363+0000 7fb95dcde640 1 -- 172.21.15.31:0/2124559909 --> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb9580b4360 con 0x7fb94406b990 2024-04-15T00:21:30.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.371+0000 7fb93ffff640 1 -- 172.21.15.31:0/2124559909 <== mgr.4107 v2:172.21.15.31:6832/915470279 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7fb9580b4360 con 0x7fb94406b990 2024-04-15T00:21:30.382 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:21:30.384 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-15T00:21:30.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.374+0000 7fb95dcde640 1 -- 172.21.15.31:0/2124559909 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb94406b990 msgr2=0x7fb94406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:30.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.374+0000 7fb95dcde640 1 --2- 172.21.15.31:0/2124559909 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb94406b990 0x7fb94406de50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb948005c00 tx=0x7fb948009040 comp rx=0 tx=0).stop 2024-04-15T00:21:30.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.374+0000 7fb95dcde640 1 -- 172.21.15.31:0/2124559909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9580b13a0 msgr2=0x7fb9581488a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:30.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.374+0000 7fb95dcde640 1 --2- 172.21.15.31:0/2124559909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9580b13a0 0x7fb9581488a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb94c02be50 tx=0x7fb94c0046c0 comp rx=0 tx=0).stop 2024-04-15T00:21:30.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.374+0000 7fb95dcde640 1 -- 172.21.15.31:0/2124559909 shutdown_connections 2024-04-15T00:21:30.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.374+0000 7fb95dcde640 1 --2- 172.21.15.31:0/2124559909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9581461d0 0x7fb9581de1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:30.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.374+0000 7fb95dcde640 1 --2- 172.21.15.31:0/2124559909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9580b13a0 0x7fb9581488a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:30.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.374+0000 7fb95dcde640 1 --2- 172.21.15.31:0/2124559909 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb94406b990 0x7fb94406de50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:30.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.374+0000 7fb95dcde640 1 --2- 172.21.15.31:0/2124559909 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb9580b0fc0 0x7fb958148360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:30.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.374+0000 7fb95dcde640 1 -- 172.21.15.31:0/2124559909 >> 172.21.15.31:0/2124559909 conn(0x7fb9580b77b0 msgr2=0x7fb9580b9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:30.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.374+0000 7fb95dcde640 1 -- 172.21.15.31:0/2124559909 shutdown_connections 2024-04-15T00:21:30.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.374+0000 7fb95dcde640 1 -- 172.21.15.31:0/2124559909 wait complete. 2024-04-15T00:21:30.392 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-04-15T00:21:28.395574+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231920,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742800,"statfs":{"total":773094113280,"available":772856627200,"internally_reserved":0,"allocated":3350528,"data_stored":2022712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002432"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619325+0000","last_change":"2024-04-15T00:21:07.577313+0000","last_active":"2024-04-15T00:21:15.619325+0000","last_peered":"2024-04-15T00:21:15.619325+0000","last_clean":"2024-04-15T00:21:15.619325+0000","last_became_active":"2024-04-15T00:21:07.576921+0000","last_became_peered":"2024-04-15T00:21:07.576921+0000","last_unstale":"2024-04-15T00:21:15.619325+0000","last_undegraded":"2024-04-15T00:21:15.619325+0000","last_fullsized":"2024-04-15T00:21:15.619325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:41:31.846500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603048+0000","last_change":"2024-04-15T00:21:08.579912+0000","last_active":"2024-04-15T00:21:13.603048+0000","last_peered":"2024-04-15T00:21:13.603048+0000","last_clean":"2024-04-15T00:21:13.603048+0000","last_became_active":"2024-04-15T00:21:08.579545+0000","last_became_peered":"2024-04-15T00:21:08.579545+0000","last_unstale":"2024-04-15T00:21:13.603048+0000","last_undegraded":"2024-04-15T00:21:13.603048+0000","last_fullsized":"2024-04-15T00:21:13.603048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602258+0000","last_change":"2024-04-15T00:21:12.634366+0000","last_active":"2024-04-15T00:21:13.602258+0000","last_peered":"2024-04-15T00:21:13.602258+0000","last_clean":"2024-04-15T00:21:13.602258+0000","last_became_active":"2024-04-15T00:21:12.633323+0000","last_became_peered":"2024-04-15T00:21:12.633323+0000","last_unstale":"2024-04-15T00:21:13.602258+0000","last_undegraded":"2024-04-15T00:21:13.602258+0000","last_fullsized":"2024-04-15T00:21:13.602258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:26:21.575108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603161+0000","last_change":"2024-04-15T00:21:07.569057+0000","last_active":"2024-04-15T00:21:13.603161+0000","last_peered":"2024-04-15T00:21:13.603161+0000","last_clean":"2024-04-15T00:21:13.603161+0000","last_became_active":"2024-04-15T00:21:07.568724+0000","last_became_peered":"2024-04-15T00:21:07.568724+0000","last_unstale":"2024-04-15T00:21:13.603161+0000","last_undegraded":"2024-04-15T00:21:13.603161+0000","last_fullsized":"2024-04-15T00:21:13.603161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:21:35.113136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.621077+0000","last_change":"2024-04-15T00:21:08.598196+0000","last_active":"2024-04-15T00:21:15.621077+0000","last_peered":"2024-04-15T00:21:15.621077+0000","last_clean":"2024-04-15T00:21:15.621077+0000","last_became_active":"2024-04-15T00:21:08.597625+0000","last_became_peered":"2024-04-15T00:21:08.597625+0000","last_unstale":"2024-04-15T00:21:15.621077+0000","last_undegraded":"2024-04-15T00:21:15.621077+0000","last_fullsized":"2024-04-15T00:21:15.621077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602202+0000","last_change":"2024-04-15T00:21:12.624625+0000","last_active":"2024-04-15T00:21:13.602202+0000","last_peered":"2024-04-15T00:21:13.602202+0000","last_clean":"2024-04-15T00:21:13.602202+0000","last_became_active":"2024-04-15T00:21:12.624222+0000","last_became_peered":"2024-04-15T00:21:12.624222+0000","last_unstale":"2024-04-15T00:21:13.602202+0000","last_undegraded":"2024-04-15T00:21:13.602202+0000","last_fullsized":"2024-04-15T00:21:13.602202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:28.534842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.536054+0000","last_change":"2024-04-15T00:21:07.576936+0000","last_active":"2024-04-15T00:21:15.536054+0000","last_peered":"2024-04-15T00:21:15.536054+0000","last_clean":"2024-04-15T00:21:15.536054+0000","last_became_active":"2024-04-15T00:21:07.576674+0000","last_became_peered":"2024-04-15T00:21:07.576674+0000","last_unstale":"2024-04-15T00:21:15.536054+0000","last_undegraded":"2024-04-15T00:21:15.536054+0000","last_fullsized":"2024-04-15T00:21:15.536054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603516+0000","last_change":"2024-04-15T00:21:08.587098+0000","last_active":"2024-04-15T00:21:13.603516+0000","last_peered":"2024-04-15T00:21:13.603516+0000","last_clean":"2024-04-15T00:21:13.603516+0000","last_became_active":"2024-04-15T00:21:08.586825+0000","last_became_peered":"2024-04-15T00:21:08.586825+0000","last_unstale":"2024-04-15T00:21:13.603516+0000","last_undegraded":"2024-04-15T00:21:13.603516+0000","last_fullsized":"2024-04-15T00:21:13.603516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:30.470116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.604467+0000","last_change":"2024-04-15T00:21:12.619903+0000","last_active":"2024-04-15T00:21:13.604467+0000","last_peered":"2024-04-15T00:21:13.604467+0000","last_clean":"2024-04-15T00:21:13.604467+0000","last_became_active":"2024-04-15T00:21:12.619259+0000","last_became_peered":"2024-04-15T00:21:12.619259+0000","last_unstale":"2024-04-15T00:21:13.604467+0000","last_undegraded":"2024-04-15T00:21:13.604467+0000","last_fullsized":"2024-04-15T00:21:13.604467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:31.463828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535551+0000","last_change":"2024-04-15T00:21:07.579089+0000","last_active":"2024-04-15T00:21:15.535551+0000","last_peered":"2024-04-15T00:21:15.535551+0000","last_clean":"2024-04-15T00:21:15.535551+0000","last_became_active":"2024-04-15T00:21:07.578733+0000","last_became_peered":"2024-04-15T00:21:07.578733+0000","last_unstale":"2024-04-15T00:21:15.535551+0000","last_undegraded":"2024-04-15T00:21:15.535551+0000","last_fullsized":"2024-04-15T00:21:15.535551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:44:30.015803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603746+0000","last_change":"2024-04-15T00:21:08.588235+0000","last_active":"2024-04-15T00:21:13.603746+0000","last_peered":"2024-04-15T00:21:13.603746+0000","last_clean":"2024-04-15T00:21:13.603746+0000","last_became_active":"2024-04-15T00:21:08.587951+0000","last_became_peered":"2024-04-15T00:21:08.587951+0000","last_unstale":"2024-04-15T00:21:13.603746+0000","last_undegraded":"2024-04-15T00:21:13.603746+0000","last_fullsized":"2024-04-15T00:21:13.603746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:08.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603367+0000","last_change":"2024-04-15T00:21:12.613395+0000","last_active":"2024-04-15T00:21:13.603367+0000","last_peered":"2024-04-15T00:21:13.603367+0000","last_clean":"2024-04-15T00:21:13.603367+0000","last_became_active":"2024-04-15T00:21:12.612976+0000","last_became_peered":"2024-04-15T00:21:12.612976+0000","last_unstale":"2024-04-15T00:21:13.603367+0000","last_undegraded":"2024-04-15T00:21:13.603367+0000","last_fullsized":"2024-04-15T00:21:13.603367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:05.044024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620111+0000","last_change":"2024-04-15T00:21:08.585248+0000","last_active":"2024-04-15T00:21:15.620111+0000","last_peered":"2024-04-15T00:21:15.620111+0000","last_clean":"2024-04-15T00:21:15.620111+0000","last_became_active":"2024-04-15T00:21:08.584882+0000","last_became_peered":"2024-04-15T00:21:08.584882+0000","last_unstale":"2024-04-15T00:21:15.620111+0000","last_undegraded":"2024-04-15T00:21:15.620111+0000","last_fullsized":"2024-04-15T00:21:15.620111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:27:41.268464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535912+0000","last_change":"2024-04-15T00:21:07.580541+0000","last_active":"2024-04-15T00:21:15.535912+0000","last_peered":"2024-04-15T00:21:15.535912+0000","last_clean":"2024-04-15T00:21:15.535912+0000","last_became_active":"2024-04-15T00:21:07.580229+0000","last_became_peered":"2024-04-15T00:21:07.580229+0000","last_unstale":"2024-04-15T00:21:15.535912+0000","last_undegraded":"2024-04-15T00:21:15.535912+0000","last_fullsized":"2024-04-15T00:21:15.535912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:34:26.325595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602904+0000","last_change":"2024-04-15T00:21:12.624175+0000","last_active":"2024-04-15T00:21:13.602904+0000","last_peered":"2024-04-15T00:21:13.602904+0000","last_clean":"2024-04-15T00:21:13.602904+0000","last_became_active":"2024-04-15T00:21:12.623783+0000","last_became_peered":"2024-04-15T00:21:12.623783+0000","last_unstale":"2024-04-15T00:21:13.602904+0000","last_undegraded":"2024-04-15T00:21:13.602904+0000","last_fullsized":"2024-04-15T00:21:13.602904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:22:04.031788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602602+0000","last_change":"2024-04-15T00:21:08.594955+0000","last_active":"2024-04-15T00:21:13.602602+0000","last_peered":"2024-04-15T00:21:13.602602+0000","last_clean":"2024-04-15T00:21:13.602602+0000","last_became_active":"2024-04-15T00:21:08.594535+0000","last_became_peered":"2024-04-15T00:21:08.594535+0000","last_unstale":"2024-04-15T00:21:13.602602+0000","last_undegraded":"2024-04-15T00:21:13.602602+0000","last_fullsized":"2024-04-15T00:21:13.602602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:40.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619669+0000","last_change":"2024-04-15T00:21:07.570862+0000","last_active":"2024-04-15T00:21:15.619669+0000","last_peered":"2024-04-15T00:21:15.619669+0000","last_clean":"2024-04-15T00:21:15.619669+0000","last_became_active":"2024-04-15T00:21:07.570555+0000","last_became_peered":"2024-04-15T00:21:07.570555+0000","last_unstale":"2024-04-15T00:21:15.619669+0000","last_undegraded":"2024-04-15T00:21:15.619669+0000","last_fullsized":"2024-04-15T00:21:15.619669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:54.810223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602579+0000","last_change":"2024-04-15T00:21:12.624936+0000","last_active":"2024-04-15T00:21:13.602579+0000","last_peered":"2024-04-15T00:21:13.602579+0000","last_clean":"2024-04-15T00:21:13.602579+0000","last_became_active":"2024-04-15T00:21:12.623808+0000","last_became_peered":"2024-04-15T00:21:12.623808+0000","last_unstale":"2024-04-15T00:21:13.602579+0000","last_undegraded":"2024-04-15T00:21:13.602579+0000","last_fullsized":"2024-04-15T00:21:13.602579+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:12.264127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602413+0000","last_change":"2024-04-15T00:21:08.574901+0000","last_active":"2024-04-15T00:21:13.602413+0000","last_peered":"2024-04-15T00:21:13.602413+0000","last_clean":"2024-04-15T00:21:13.602413+0000","last_became_active":"2024-04-15T00:21:08.574536+0000","last_became_peered":"2024-04-15T00:21:08.574536+0000","last_unstale":"2024-04-15T00:21:13.602413+0000","last_undegraded":"2024-04-15T00:21:13.602413+0000","last_fullsized":"2024-04-15T00:21:13.602413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:08.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619923+0000","last_change":"2024-04-15T00:21:07.577048+0000","last_active":"2024-04-15T00:21:15.619923+0000","last_peered":"2024-04-15T00:21:15.619923+0000","last_clean":"2024-04-15T00:21:15.619923+0000","last_became_active":"2024-04-15T00:21:07.576739+0000","last_became_peered":"2024-04-15T00:21:07.576739+0000","last_unstale":"2024-04-15T00:21:15.619923+0000","last_undegraded":"2024-04-15T00:21:15.619923+0000","last_fullsized":"2024-04-15T00:21:15.619923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:14.441186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620337+0000","last_change":"2024-04-15T00:21:12.632213+0000","last_active":"2024-04-15T00:21:15.620337+0000","last_peered":"2024-04-15T00:21:15.620337+0000","last_clean":"2024-04-15T00:21:15.620337+0000","last_became_active":"2024-04-15T00:21:12.631900+0000","last_became_peered":"2024-04-15T00:21:12.631900+0000","last_unstale":"2024-04-15T00:21:15.620337+0000","last_undegraded":"2024-04-15T00:21:15.620337+0000","last_fullsized":"2024-04-15T00:21:15.620337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:52:31.142377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602577+0000","last_change":"2024-04-15T00:21:08.590270+0000","last_active":"2024-04-15T00:21:13.602577+0000","last_peered":"2024-04-15T00:21:13.602577+0000","last_clean":"2024-04-15T00:21:13.602577+0000","last_became_active":"2024-04-15T00:21:08.589960+0000","last_became_peered":"2024-04-15T00:21:08.589960+0000","last_unstale":"2024-04-15T00:21:13.602577+0000","last_undegraded":"2024-04-15T00:21:13.602577+0000","last_fullsized":"2024-04-15T00:21:13.602577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:52.880065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535251+0000","last_change":"2024-04-15T00:21:07.577518+0000","last_active":"2024-04-15T00:21:15.535251+0000","last_peered":"2024-04-15T00:21:15.535251+0000","last_clean":"2024-04-15T00:21:15.535251+0000","last_became_active":"2024-04-15T00:21:07.576961+0000","last_became_peered":"2024-04-15T00:21:07.576961+0000","last_unstale":"2024-04-15T00:21:15.535251+0000","last_undegraded":"2024-04-15T00:21:15.535251+0000","last_fullsized":"2024-04-15T00:21:15.535251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:14.441186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602862+0000","last_change":"2024-04-15T00:21:12.624501+0000","last_active":"2024-04-15T00:21:13.602862+0000","last_peered":"2024-04-15T00:21:13.602862+0000","last_clean":"2024-04-15T00:21:13.602862+0000","last_became_active":"2024-04-15T00:21:12.624011+0000","last_became_peered":"2024-04-15T00:21:12.624011+0000","last_unstale":"2024-04-15T00:21:13.602862+0000","last_undegraded":"2024-04-15T00:21:13.602862+0000","last_fullsized":"2024-04-15T00:21:13.602862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:10:28.514357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620962+0000","last_change":"2024-04-15T00:21:08.601349+0000","last_active":"2024-04-15T00:21:15.620962+0000","last_peered":"2024-04-15T00:21:15.620962+0000","last_clean":"2024-04-15T00:21:15.620962+0000","last_became_active":"2024-04-15T00:21:08.601048+0000","last_became_peered":"2024-04-15T00:21:08.601048+0000","last_unstale":"2024-04-15T00:21:15.620962+0000","last_undegraded":"2024-04-15T00:21:15.620962+0000","last_fullsized":"2024-04-15T00:21:15.620962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:27:41.268464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619530+0000","last_change":"2024-04-15T00:21:07.577793+0000","last_active":"2024-04-15T00:21:15.619530+0000","last_peered":"2024-04-15T00:21:15.619530+0000","last_clean":"2024-04-15T00:21:15.619530+0000","last_became_active":"2024-04-15T00:21:07.577472+0000","last_became_peered":"2024-04-15T00:21:07.577472+0000","last_unstale":"2024-04-15T00:21:15.619530+0000","last_undegraded":"2024-04-15T00:21:15.619530+0000","last_fullsized":"2024-04-15T00:21:15.619530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:54.810223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602347+0000","last_change":"2024-04-15T00:21:12.634814+0000","last_active":"2024-04-15T00:21:13.602347+0000","last_peered":"2024-04-15T00:21:13.602347+0000","last_clean":"2024-04-15T00:21:13.602347+0000","last_became_active":"2024-04-15T00:21:12.633228+0000","last_became_peered":"2024-04-15T00:21:12.633228+0000","last_unstale":"2024-04-15T00:21:13.602347+0000","last_undegraded":"2024-04-15T00:21:13.602347+0000","last_fullsized":"2024-04-15T00:21:13.602347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:13.312501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602987+0000","last_change":"2024-04-15T00:21:08.596235+0000","last_active":"2024-04-15T00:21:13.602987+0000","last_peered":"2024-04-15T00:21:13.602987+0000","last_clean":"2024-04-15T00:21:13.602987+0000","last_became_active":"2024-04-15T00:21:08.595901+0000","last_became_peered":"2024-04-15T00:21:08.595901+0000","last_unstale":"2024-04-15T00:21:13.602987+0000","last_undegraded":"2024-04-15T00:21:13.602987+0000","last_fullsized":"2024-04-15T00:21:13.602987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:21:59.995077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620914+0000","last_change":"2024-04-15T00:21:07.573285+0000","last_active":"2024-04-15T00:21:15.620914+0000","last_peered":"2024-04-15T00:21:15.620914+0000","last_clean":"2024-04-15T00:21:15.620914+0000","last_became_active":"2024-04-15T00:21:07.572973+0000","last_became_peered":"2024-04-15T00:21:07.572973+0000","last_unstale":"2024-04-15T00:21:15.620914+0000","last_undegraded":"2024-04-15T00:21:15.620914+0000","last_fullsized":"2024-04-15T00:21:15.620914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602159+0000","last_change":"2024-04-15T00:21:12.633602+0000","last_active":"2024-04-15T00:21:13.602159+0000","last_peered":"2024-04-15T00:21:13.602159+0000","last_clean":"2024-04-15T00:21:13.602159+0000","last_became_active":"2024-04-15T00:21:12.633178+0000","last_became_peered":"2024-04-15T00:21:12.633178+0000","last_unstale":"2024-04-15T00:21:13.602159+0000","last_undegraded":"2024-04-15T00:21:13.602159+0000","last_fullsized":"2024-04-15T00:21:13.602159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:01:48.959493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.621191+0000","last_change":"2024-04-15T00:21:08.580727+0000","last_active":"2024-04-15T00:21:15.621191+0000","last_peered":"2024-04-15T00:21:15.621191+0000","last_clean":"2024-04-15T00:21:15.621191+0000","last_became_active":"2024-04-15T00:21:08.580418+0000","last_became_peered":"2024-04-15T00:21:08.580418+0000","last_unstale":"2024-04-15T00:21:15.621191+0000","last_undegraded":"2024-04-15T00:21:15.621191+0000","last_fullsized":"2024-04-15T00:21:15.621191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.536148+0000","last_change":"2024-04-15T00:21:07.575864+0000","last_active":"2024-04-15T00:21:15.536148+0000","last_peered":"2024-04-15T00:21:15.536148+0000","last_clean":"2024-04-15T00:21:15.536148+0000","last_became_active":"2024-04-15T00:21:07.575562+0000","last_became_peered":"2024-04-15T00:21:07.575562+0000","last_unstale":"2024-04-15T00:21:15.536148+0000","last_undegraded":"2024-04-15T00:21:15.536148+0000","last_fullsized":"2024-04-15T00:21:15.536148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:35:39.009511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620429+0000","last_change":"2024-04-15T00:21:12.633674+0000","last_active":"2024-04-15T00:21:15.620429+0000","last_peered":"2024-04-15T00:21:15.620429+0000","last_clean":"2024-04-15T00:21:15.620429+0000","last_became_active":"2024-04-15T00:21:12.633277+0000","last_became_peered":"2024-04-15T00:21:12.633277+0000","last_unstale":"2024-04-15T00:21:15.620429+0000","last_undegraded":"2024-04-15T00:21:15.620429+0000","last_fullsized":"2024-04-15T00:21:15.620429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:49.295552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603880+0000","last_change":"2024-04-15T00:21:08.578321+0000","last_active":"2024-04-15T00:21:13.603880+0000","last_peered":"2024-04-15T00:21:13.603880+0000","last_clean":"2024-04-15T00:21:13.603880+0000","last_became_active":"2024-04-15T00:21:08.578017+0000","last_became_peered":"2024-04-15T00:21:08.578017+0000","last_unstale":"2024-04-15T00:21:13.603880+0000","last_undegraded":"2024-04-15T00:21:13.603880+0000","last_fullsized":"2024-04-15T00:21:13.603880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:40.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.621338+0000","last_change":"2024-04-15T00:21:07.575183+0000","last_active":"2024-04-15T00:21:15.621338+0000","last_peered":"2024-04-15T00:21:15.621338+0000","last_clean":"2024-04-15T00:21:15.621338+0000","last_became_active":"2024-04-15T00:21:07.574822+0000","last_became_peered":"2024-04-15T00:21:07.574822+0000","last_unstale":"2024-04-15T00:21:15.621338+0000","last_undegraded":"2024-04-15T00:21:15.621338+0000","last_fullsized":"2024-04-15T00:21:15.621338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:26:22.612110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619998+0000","last_change":"2024-04-15T00:21:12.620150+0000","last_active":"2024-04-15T00:21:15.619998+0000","last_peered":"2024-04-15T00:21:15.619998+0000","last_clean":"2024-04-15T00:21:15.619998+0000","last_became_active":"2024-04-15T00:21:12.619694+0000","last_became_peered":"2024-04-15T00:21:12.619694+0000","last_unstale":"2024-04-15T00:21:15.619998+0000","last_undegraded":"2024-04-15T00:21:15.619998+0000","last_fullsized":"2024-04-15T00:21:15.619998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:34.506827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.604336+0000","last_change":"2024-04-15T00:21:08.596959+0000","last_active":"2024-04-15T00:21:13.604336+0000","last_peered":"2024-04-15T00:21:13.604336+0000","last_clean":"2024-04-15T00:21:13.604336+0000","last_became_active":"2024-04-15T00:21:08.596678+0000","last_became_peered":"2024-04-15T00:21:08.596678+0000","last_unstale":"2024-04-15T00:21:13.604336+0000","last_undegraded":"2024-04-15T00:21:13.604336+0000","last_fullsized":"2024-04-15T00:21:13.604336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:35:40.014598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603779+0000","last_change":"2024-04-15T00:21:07.574514+0000","last_active":"2024-04-15T00:21:13.603779+0000","last_peered":"2024-04-15T00:21:13.603779+0000","last_clean":"2024-04-15T00:21:13.603779+0000","last_became_active":"2024-04-15T00:21:07.574228+0000","last_became_peered":"2024-04-15T00:21:07.574228+0000","last_unstale":"2024-04-15T00:21:13.603779+0000","last_undegraded":"2024-04-15T00:21:13.603779+0000","last_fullsized":"2024-04-15T00:21:13.603779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.621262+0000","last_change":"2024-04-15T00:21:12.619733+0000","last_active":"2024-04-15T00:21:15.621262+0000","last_peered":"2024-04-15T00:21:15.621262+0000","last_clean":"2024-04-15T00:21:15.621262+0000","last_became_active":"2024-04-15T00:21:12.619307+0000","last_became_peered":"2024-04-15T00:21:12.619307+0000","last_unstale":"2024-04-15T00:21:15.621262+0000","last_undegraded":"2024-04-15T00:21:15.621262+0000","last_fullsized":"2024-04-15T00:21:15.621262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:48:00.696018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.621663+0000","last_change":"2024-04-15T00:21:08.589246+0000","last_active":"2024-04-15T00:21:15.621663+0000","last_peered":"2024-04-15T00:21:15.621663+0000","last_clean":"2024-04-15T00:21:15.621663+0000","last_became_active":"2024-04-15T00:21:08.588920+0000","last_became_peered":"2024-04-15T00:21:08.588920+0000","last_unstale":"2024-04-15T00:21:15.621663+0000","last_undegraded":"2024-04-15T00:21:15.621663+0000","last_fullsized":"2024-04-15T00:21:15.621663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619227+0000","last_change":"2024-04-15T00:21:07.566537+0000","last_active":"2024-04-15T00:21:15.619227+0000","last_peered":"2024-04-15T00:21:15.619227+0000","last_clean":"2024-04-15T00:21:15.619227+0000","last_became_active":"2024-04-15T00:21:07.566240+0000","last_became_peered":"2024-04-15T00:21:07.566240+0000","last_unstale":"2024-04-15T00:21:15.619227+0000","last_undegraded":"2024-04-15T00:21:15.619227+0000","last_fullsized":"2024-04-15T00:21:15.619227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:16:52.647503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.621073+0000","last_change":"2024-04-15T00:21:12.623452+0000","last_active":"2024-04-15T00:21:15.621073+0000","last_peered":"2024-04-15T00:21:15.621073+0000","last_clean":"2024-04-15T00:21:15.621073+0000","last_became_active":"2024-04-15T00:21:12.623066+0000","last_became_peered":"2024-04-15T00:21:12.623066+0000","last_unstale":"2024-04-15T00:21:15.621073+0000","last_undegraded":"2024-04-15T00:21:15.621073+0000","last_fullsized":"2024-04-15T00:21:15.621073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:11:16.107864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619704+0000","last_change":"2024-04-15T00:21:08.586376+0000","last_active":"2024-04-15T00:21:15.619704+0000","last_peered":"2024-04-15T00:21:15.619704+0000","last_clean":"2024-04-15T00:21:15.619704+0000","last_became_active":"2024-04-15T00:21:08.586054+0000","last_became_peered":"2024-04-15T00:21:08.586054+0000","last_unstale":"2024-04-15T00:21:15.619704+0000","last_undegraded":"2024-04-15T00:21:15.619704+0000","last_fullsized":"2024-04-15T00:21:15.619704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:02:56.329428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535288+0000","last_change":"2024-04-15T00:21:07.577289+0000","last_active":"2024-04-15T00:21:15.535288+0000","last_peered":"2024-04-15T00:21:15.535288+0000","last_clean":"2024-04-15T00:21:15.535288+0000","last_became_active":"2024-04-15T00:21:07.576602+0000","last_became_peered":"2024-04-15T00:21:07.576602+0000","last_unstale":"2024-04-15T00:21:15.535288+0000","last_undegraded":"2024-04-15T00:21:15.535288+0000","last_fullsized":"2024-04-15T00:21:15.535288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:26:22.612110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620938+0000","last_change":"2024-04-15T00:21:12.634248+0000","last_active":"2024-04-15T00:21:15.620938+0000","last_peered":"2024-04-15T00:21:15.620938+0000","last_clean":"2024-04-15T00:21:15.620938+0000","last_became_active":"2024-04-15T00:21:12.633239+0000","last_became_peered":"2024-04-15T00:21:12.633239+0000","last_unstale":"2024-04-15T00:21:15.620938+0000","last_undegraded":"2024-04-15T00:21:15.620938+0000","last_fullsized":"2024-04-15T00:21:15.620938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:52:31.142377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602451+0000","last_change":"2024-04-15T00:21:08.591060+0000","last_active":"2024-04-15T00:21:13.602451+0000","last_peered":"2024-04-15T00:21:13.602451+0000","last_clean":"2024-04-15T00:21:13.602451+0000","last_became_active":"2024-04-15T00:21:08.590781+0000","last_became_peered":"2024-04-15T00:21:08.590781+0000","last_unstale":"2024-04-15T00:21:13.602451+0000","last_undegraded":"2024-04-15T00:21:13.602451+0000","last_fullsized":"2024-04-15T00:21:13.602451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603293+0000","last_change":"2024-04-15T00:21:07.573617+0000","last_active":"2024-04-15T00:21:13.603293+0000","last_peered":"2024-04-15T00:21:13.603293+0000","last_clean":"2024-04-15T00:21:13.603293+0000","last_became_active":"2024-04-15T00:21:07.573308+0000","last_became_peered":"2024-04-15T00:21:07.573308+0000","last_unstale":"2024-04-15T00:21:13.603293+0000","last_undegraded":"2024-04-15T00:21:13.603293+0000","last_fullsized":"2024-04-15T00:21:13.603293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:36:11.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535374+0000","last_change":"2024-04-15T00:20:57.937516+0000","last_active":"2024-04-15T00:21:15.535374+0000","last_peered":"2024-04-15T00:21:15.535374+0000","last_clean":"2024-04-15T00:21:15.535374+0000","last_became_active":"2024-04-15T00:20:57.936329+0000","last_became_peered":"2024-04-15T00:20:57.936329+0000","last_unstale":"2024-04-15T00:21:15.535374+0000","last_undegraded":"2024-04-15T00:21:15.535374+0000","last_fullsized":"2024-04-15T00:21:15.535374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:20:56.517419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:20:56.517419+0000","last_clean_scrub_stamp":"2024-04-15T00:20:56.517419+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:07:23.949459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620409+0000","last_change":"2024-04-15T00:21:12.633530+0000","last_active":"2024-04-15T00:21:15.620409+0000","last_peered":"2024-04-15T00:21:15.620409+0000","last_clean":"2024-04-15T00:21:15.620409+0000","last_became_active":"2024-04-15T00:21:12.633124+0000","last_became_peered":"2024-04-15T00:21:12.633124+0000","last_unstale":"2024-04-15T00:21:15.620409+0000","last_undegraded":"2024-04-15T00:21:15.620409+0000","last_fullsized":"2024-04-15T00:21:15.620409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:49.295552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535728+0000","last_change":"2024-04-15T00:21:08.583443+0000","last_active":"2024-04-15T00:21:15.535728+0000","last_peered":"2024-04-15T00:21:15.535728+0000","last_clean":"2024-04-15T00:21:15.535728+0000","last_became_active":"2024-04-15T00:21:08.583143+0000","last_became_peered":"2024-04-15T00:21:08.583143+0000","last_unstale":"2024-04-15T00:21:15.535728+0000","last_undegraded":"2024-04-15T00:21:15.535728+0000","last_fullsized":"2024-04-15T00:21:15.535728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:01.007313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619590+0000","last_change":"2024-04-15T00:21:07.579386+0000","last_active":"2024-04-15T00:21:15.619590+0000","last_peered":"2024-04-15T00:21:15.619590+0000","last_clean":"2024-04-15T00:21:15.619590+0000","last_became_active":"2024-04-15T00:21:07.579024+0000","last_became_peered":"2024-04-15T00:21:07.579024+0000","last_unstale":"2024-04-15T00:21:15.619590+0000","last_undegraded":"2024-04-15T00:21:15.619590+0000","last_fullsized":"2024-04-15T00:21:15.619590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:36:11.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620189+0000","last_change":"2024-04-15T00:21:12.635286+0000","last_active":"2024-04-15T00:21:15.620189+0000","last_peered":"2024-04-15T00:21:15.620189+0000","last_clean":"2024-04-15T00:21:15.620189+0000","last_became_active":"2024-04-15T00:21:12.634689+0000","last_became_peered":"2024-04-15T00:21:12.634689+0000","last_unstale":"2024-04-15T00:21:15.620189+0000","last_undegraded":"2024-04-15T00:21:15.620189+0000","last_fullsized":"2024-04-15T00:21:15.620189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:05.044024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603811+0000","last_change":"2024-04-15T00:21:08.579790+0000","last_active":"2024-04-15T00:21:13.603811+0000","last_peered":"2024-04-15T00:21:13.603811+0000","last_clean":"2024-04-15T00:21:13.603811+0000","last_became_active":"2024-04-15T00:21:08.576604+0000","last_became_peered":"2024-04-15T00:21:08.576604+0000","last_unstale":"2024-04-15T00:21:13.603811+0000","last_undegraded":"2024-04-15T00:21:13.603811+0000","last_fullsized":"2024-04-15T00:21:13.603811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:52:10.558592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619527+0000","last_change":"2024-04-15T00:21:07.571553+0000","last_active":"2024-04-15T00:21:15.619527+0000","last_peered":"2024-04-15T00:21:15.619527+0000","last_clean":"2024-04-15T00:21:15.619527+0000","last_became_active":"2024-04-15T00:21:07.571238+0000","last_became_peered":"2024-04-15T00:21:07.571238+0000","last_unstale":"2024-04-15T00:21:15.619527+0000","last_undegraded":"2024-04-15T00:21:15.619527+0000","last_fullsized":"2024-04-15T00:21:15.619527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:35:39.009511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620592+0000","last_change":"2024-04-15T00:21:12.619646+0000","last_active":"2024-04-15T00:21:15.620592+0000","last_peered":"2024-04-15T00:21:15.620592+0000","last_clean":"2024-04-15T00:21:15.620592+0000","last_became_active":"2024-04-15T00:21:12.619263+0000","last_became_peered":"2024-04-15T00:21:12.619263+0000","last_unstale":"2024-04-15T00:21:15.620592+0000","last_undegraded":"2024-04-15T00:21:15.620592+0000","last_fullsized":"2024-04-15T00:21:15.620592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:31.463828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.536088+0000","last_change":"2024-04-15T00:21:08.599410+0000","last_active":"2024-04-15T00:21:15.536088+0000","last_peered":"2024-04-15T00:21:15.536088+0000","last_clean":"2024-04-15T00:21:15.536088+0000","last_became_active":"2024-04-15T00:21:08.599132+0000","last_became_peered":"2024-04-15T00:21:08.599132+0000","last_unstale":"2024-04-15T00:21:15.536088+0000","last_undegraded":"2024-04-15T00:21:15.536088+0000","last_fullsized":"2024-04-15T00:21:15.536088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:47:56.659307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619601+0000","last_change":"2024-04-15T00:21:07.567917+0000","last_active":"2024-04-15T00:21:15.619601+0000","last_peered":"2024-04-15T00:21:15.619601+0000","last_clean":"2024-04-15T00:21:15.619601+0000","last_became_active":"2024-04-15T00:21:07.567673+0000","last_became_peered":"2024-04-15T00:21:07.567673+0000","last_unstale":"2024-04-15T00:21:15.619601+0000","last_undegraded":"2024-04-15T00:21:15.619601+0000","last_fullsized":"2024-04-15T00:21:15.619601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:54.810223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602134+0000","last_change":"2024-04-15T00:21:12.632937+0000","last_active":"2024-04-15T00:21:13.602134+0000","last_peered":"2024-04-15T00:21:13.602134+0000","last_clean":"2024-04-15T00:21:13.602134+0000","last_became_active":"2024-04-15T00:21:12.632508+0000","last_became_peered":"2024-04-15T00:21:12.632508+0000","last_unstale":"2024-04-15T00:21:13.602134+0000","last_undegraded":"2024-04-15T00:21:13.602134+0000","last_fullsized":"2024-04-15T00:21:13.602134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:07:36.246879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535820+0000","last_change":"2024-04-15T00:21:08.600430+0000","last_active":"2024-04-15T00:21:15.535820+0000","last_peered":"2024-04-15T00:21:15.535820+0000","last_clean":"2024-04-15T00:21:15.535820+0000","last_became_active":"2024-04-15T00:21:08.600142+0000","last_became_peered":"2024-04-15T00:21:08.600142+0000","last_unstale":"2024-04-15T00:21:15.535820+0000","last_undegraded":"2024-04-15T00:21:15.535820+0000","last_fullsized":"2024-04-15T00:21:15.535820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:30.470116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602933+0000","last_change":"2024-04-15T00:21:07.576781+0000","last_active":"2024-04-15T00:21:13.602933+0000","last_peered":"2024-04-15T00:21:13.602933+0000","last_clean":"2024-04-15T00:21:13.602933+0000","last_became_active":"2024-04-15T00:21:07.576491+0000","last_became_peered":"2024-04-15T00:21:07.576491+0000","last_unstale":"2024-04-15T00:21:13.602933+0000","last_undegraded":"2024-04-15T00:21:13.602933+0000","last_fullsized":"2024-04-15T00:21:13.602933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:41:31.846500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602828+0000","last_change":"2024-04-15T00:21:12.620247+0000","last_active":"2024-04-15T00:21:13.602828+0000","last_peered":"2024-04-15T00:21:13.602828+0000","last_clean":"2024-04-15T00:21:13.602828+0000","last_became_active":"2024-04-15T00:21:12.619257+0000","last_became_peered":"2024-04-15T00:21:12.619257+0000","last_unstale":"2024-04-15T00:21:13.602828+0000","last_undegraded":"2024-04-15T00:21:13.602828+0000","last_fullsized":"2024-04-15T00:21:13.602828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:44.287619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535641+0000","last_change":"2024-04-15T00:21:08.590732+0000","last_active":"2024-04-15T00:21:15.535641+0000","last_peered":"2024-04-15T00:21:15.535641+0000","last_clean":"2024-04-15T00:21:15.535641+0000","last_became_active":"2024-04-15T00:21:08.590450+0000","last_became_peered":"2024-04-15T00:21:08.590450+0000","last_unstale":"2024-04-15T00:21:15.535641+0000","last_undegraded":"2024-04-15T00:21:15.535641+0000","last_fullsized":"2024-04-15T00:21:15.535641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:10:24.477646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619783+0000","last_change":"2024-04-15T00:21:07.566984+0000","last_active":"2024-04-15T00:21:15.619783+0000","last_peered":"2024-04-15T00:21:15.619783+0000","last_clean":"2024-04-15T00:21:15.619783+0000","last_became_active":"2024-04-15T00:21:07.566681+0000","last_became_peered":"2024-04-15T00:21:07.566681+0000","last_unstale":"2024-04-15T00:21:15.619783+0000","last_undegraded":"2024-04-15T00:21:15.619783+0000","last_fullsized":"2024-04-15T00:21:15.619783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:21:35.113136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620857+0000","last_change":"2024-04-15T00:21:12.615981+0000","last_active":"2024-04-15T00:21:15.620857+0000","last_peered":"2024-04-15T00:21:15.620857+0000","last_clean":"2024-04-15T00:21:15.620857+0000","last_became_active":"2024-04-15T00:21:12.615577+0000","last_became_peered":"2024-04-15T00:21:12.615577+0000","last_unstale":"2024-04-15T00:21:15.620857+0000","last_undegraded":"2024-04-15T00:21:15.620857+0000","last_fullsized":"2024-04-15T00:21:15.620857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:52:14.595303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619951+0000","last_change":"2024-04-15T00:21:08.588266+0000","last_active":"2024-04-15T00:21:15.619951+0000","last_peered":"2024-04-15T00:21:15.619951+0000","last_clean":"2024-04-15T00:21:15.619951+0000","last_became_active":"2024-04-15T00:21:08.587962+0000","last_became_peered":"2024-04-15T00:21:08.587962+0000","last_unstale":"2024-04-15T00:21:15.619951+0000","last_undegraded":"2024-04-15T00:21:15.619951+0000","last_fullsized":"2024-04-15T00:21:15.619951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619445+0000","last_change":"2024-04-15T00:21:07.573664+0000","last_active":"2024-04-15T00:21:15.619445+0000","last_peered":"2024-04-15T00:21:15.619445+0000","last_clean":"2024-04-15T00:21:15.619445+0000","last_became_active":"2024-04-15T00:21:07.573325+0000","last_became_peered":"2024-04-15T00:21:07.573325+0000","last_unstale":"2024-04-15T00:21:15.619445+0000","last_undegraded":"2024-04-15T00:21:15.619445+0000","last_fullsized":"2024-04-15T00:21:15.619445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:16:52.647503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602823+0000","last_change":"2024-04-15T00:21:12.634889+0000","last_active":"2024-04-15T00:21:13.602823+0000","last_peered":"2024-04-15T00:21:13.602823+0000","last_clean":"2024-04-15T00:21:13.602823+0000","last_became_active":"2024-04-15T00:21:12.634527+0000","last_became_peered":"2024-04-15T00:21:12.634527+0000","last_unstale":"2024-04-15T00:21:13.602823+0000","last_undegraded":"2024-04-15T00:21:13.602823+0000","last_fullsized":"2024-04-15T00:21:13.602823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:29.469506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535769+0000","last_change":"2024-04-15T00:21:08.593412+0000","last_active":"2024-04-15T00:21:15.535769+0000","last_peered":"2024-04-15T00:21:15.535769+0000","last_clean":"2024-04-15T00:21:15.535769+0000","last_became_active":"2024-04-15T00:21:08.593112+0000","last_became_peered":"2024-04-15T00:21:08.593112+0000","last_unstale":"2024-04-15T00:21:15.535769+0000","last_undegraded":"2024-04-15T00:21:15.535769+0000","last_fullsized":"2024-04-15T00:21:15.535769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:45.258841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603654+0000","last_change":"2024-04-15T00:21:07.576800+0000","last_active":"2024-04-15T00:21:13.603654+0000","last_peered":"2024-04-15T00:21:13.603654+0000","last_clean":"2024-04-15T00:21:13.603654+0000","last_became_active":"2024-04-15T00:21:07.576501+0000","last_became_peered":"2024-04-15T00:21:07.576501+0000","last_unstale":"2024-04-15T00:21:13.603654+0000","last_undegraded":"2024-04-15T00:21:13.603654+0000","last_fullsized":"2024-04-15T00:21:13.603654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:54.810223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603284+0000","last_change":"2024-04-15T00:21:12.634065+0000","last_active":"2024-04-15T00:21:13.603284+0000","last_peered":"2024-04-15T00:21:13.603284+0000","last_clean":"2024-04-15T00:21:13.603284+0000","last_became_active":"2024-04-15T00:21:12.633242+0000","last_became_peered":"2024-04-15T00:21:12.633242+0000","last_unstale":"2024-04-15T00:21:13.603284+0000","last_undegraded":"2024-04-15T00:21:13.603284+0000","last_fullsized":"2024-04-15T00:21:13.603284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:38:32.207334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619978+0000","last_change":"2024-04-15T00:21:08.598979+0000","last_active":"2024-04-15T00:21:15.619978+0000","last_peered":"2024-04-15T00:21:15.619978+0000","last_clean":"2024-04-15T00:21:15.619978+0000","last_became_active":"2024-04-15T00:21:08.598700+0000","last_became_peered":"2024-04-15T00:21:08.598700+0000","last_unstale":"2024-04-15T00:21:15.619978+0000","last_undegraded":"2024-04-15T00:21:15.619978+0000","last_fullsized":"2024-04-15T00:21:15.619978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:10.980339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619067+0000","last_change":"2024-04-15T00:21:07.573340+0000","last_active":"2024-04-15T00:21:15.619067+0000","last_peered":"2024-04-15T00:21:15.619067+0000","last_clean":"2024-04-15T00:21:15.619067+0000","last_became_active":"2024-04-15T00:21:07.572749+0000","last_became_peered":"2024-04-15T00:21:07.572749+0000","last_unstale":"2024-04-15T00:21:15.619067+0000","last_undegraded":"2024-04-15T00:21:15.619067+0000","last_fullsized":"2024-04-15T00:21:15.619067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:05:06.225337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603983+0000","last_change":"2024-04-15T00:21:12.632412+0000","last_active":"2024-04-15T00:21:13.603983+0000","last_peered":"2024-04-15T00:21:13.603983+0000","last_clean":"2024-04-15T00:21:13.603983+0000","last_became_active":"2024-04-15T00:21:12.631982+0000","last_became_peered":"2024-04-15T00:21:12.631982+0000","last_unstale":"2024-04-15T00:21:13.603983+0000","last_undegraded":"2024-04-15T00:21:13.603983+0000","last_fullsized":"2024-04-15T00:21:13.603983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:11:44.674232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535698+0000","last_change":"2024-04-15T00:21:08.582822+0000","last_active":"2024-04-15T00:21:15.535698+0000","last_peered":"2024-04-15T00:21:15.535698+0000","last_clean":"2024-04-15T00:21:15.535698+0000","last_became_active":"2024-04-15T00:21:08.582531+0000","last_became_peered":"2024-04-15T00:21:08.582531+0000","last_unstale":"2024-04-15T00:21:15.535698+0000","last_undegraded":"2024-04-15T00:21:15.535698+0000","last_fullsized":"2024-04-15T00:21:15.535698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:21:59.995077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:17.849923+0000","last_change":"2024-04-15T00:21:07.576694+0000","last_active":"2024-04-15T00:21:17.849923+0000","last_peered":"2024-04-15T00:21:17.849923+0000","last_clean":"2024-04-15T00:21:17.849923+0000","last_became_active":"2024-04-15T00:21:07.576380+0000","last_became_peered":"2024-04-15T00:21:07.576380+0000","last_unstale":"2024-04-15T00:21:17.849923+0000","last_undegraded":"2024-04-15T00:21:17.849923+0000","last_fullsized":"2024-04-15T00:21:17.849923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:36:11.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620233+0000","last_change":"2024-04-15T00:21:12.620928+0000","last_active":"2024-04-15T00:21:15.620233+0000","last_peered":"2024-04-15T00:21:15.620233+0000","last_clean":"2024-04-15T00:21:15.620233+0000","last_became_active":"2024-04-15T00:21:12.620536+0000","last_became_peered":"2024-04-15T00:21:12.620536+0000","last_unstale":"2024-04-15T00:21:15.620233+0000","last_undegraded":"2024-04-15T00:21:15.620233+0000","last_fullsized":"2024-04-15T00:21:15.620233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:52:14.595303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603960+0000","last_change":"2024-04-15T00:21:08.588132+0000","last_active":"2024-04-15T00:21:13.603960+0000","last_peered":"2024-04-15T00:21:13.603960+0000","last_clean":"2024-04-15T00:21:13.603960+0000","last_became_active":"2024-04-15T00:21:08.587383+0000","last_became_peered":"2024-04-15T00:21:08.587383+0000","last_unstale":"2024-04-15T00:21:13.603960+0000","last_undegraded":"2024-04-15T00:21:13.603960+0000","last_fullsized":"2024-04-15T00:21:13.603960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:15.446273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619661+0000","last_change":"2024-04-15T00:21:07.574695+0000","last_active":"2024-04-15T00:21:15.619661+0000","last_peered":"2024-04-15T00:21:15.619661+0000","last_clean":"2024-04-15T00:21:15.619661+0000","last_became_active":"2024-04-15T00:21:07.574389+0000","last_became_peered":"2024-04-15T00:21:07.574389+0000","last_unstale":"2024-04-15T00:21:15.619661+0000","last_undegraded":"2024-04-15T00:21:15.619661+0000","last_fullsized":"2024-04-15T00:21:15.619661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:34:26.325595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.604076+0000","last_change":"2024-04-15T00:21:12.620255+0000","last_active":"2024-04-15T00:21:13.604076+0000","last_peered":"2024-04-15T00:21:13.604076+0000","last_clean":"2024-04-15T00:21:13.604076+0000","last_became_active":"2024-04-15T00:21:12.619218+0000","last_became_peered":"2024-04-15T00:21:12.619218+0000","last_unstale":"2024-04-15T00:21:13.604076+0000","last_undegraded":"2024-04-15T00:21:13.604076+0000","last_fullsized":"2024-04-15T00:21:13.604076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:49.295552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.621210+0000","last_change":"2024-04-15T00:21:08.597898+0000","last_active":"2024-04-15T00:21:15.621210+0000","last_peered":"2024-04-15T00:21:15.621210+0000","last_clean":"2024-04-15T00:21:15.621210+0000","last_became_active":"2024-04-15T00:21:08.597262+0000","last_became_peered":"2024-04-15T00:21:08.597262+0000","last_unstale":"2024-04-15T00:21:15.621210+0000","last_undegraded":"2024-04-15T00:21:15.621210+0000","last_fullsized":"2024-04-15T00:21:15.621210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603559+0000","last_change":"2024-04-15T00:21:07.574003+0000","last_active":"2024-04-15T00:21:13.603559+0000","last_peered":"2024-04-15T00:21:13.603559+0000","last_clean":"2024-04-15T00:21:13.603559+0000","last_became_active":"2024-04-15T00:21:07.573469+0000","last_became_peered":"2024-04-15T00:21:07.573469+0000","last_unstale":"2024-04-15T00:21:13.603559+0000","last_undegraded":"2024-04-15T00:21:13.603559+0000","last_fullsized":"2024-04-15T00:21:13.603559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:16:52.647503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602626+0000","last_change":"2024-04-15T00:21:12.624850+0000","last_active":"2024-04-15T00:21:13.602626+0000","last_peered":"2024-04-15T00:21:13.602626+0000","last_clean":"2024-04-15T00:21:13.602626+0000","last_became_active":"2024-04-15T00:21:12.624484+0000","last_became_peered":"2024-04-15T00:21:12.624484+0000","last_unstale":"2024-04-15T00:21:13.602626+0000","last_undegraded":"2024-04-15T00:21:13.602626+0000","last_fullsized":"2024-04-15T00:21:13.602626+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:15:08.738300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603345+0000","last_change":"2024-04-15T00:21:08.591705+0000","last_active":"2024-04-15T00:21:13.603345+0000","last_peered":"2024-04-15T00:21:13.603345+0000","last_clean":"2024-04-15T00:21:13.603345+0000","last_became_active":"2024-04-15T00:21:08.591407+0000","last_became_peered":"2024-04-15T00:21:08.591407+0000","last_unstale":"2024-04-15T00:21:13.603345+0000","last_undegraded":"2024-04-15T00:21:13.603345+0000","last_fullsized":"2024-04-15T00:21:13.603345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619610+0000","last_change":"2024-04-15T00:21:07.574971+0000","last_active":"2024-04-15T00:21:15.619610+0000","last_peered":"2024-04-15T00:21:15.619610+0000","last_clean":"2024-04-15T00:21:15.619610+0000","last_became_active":"2024-04-15T00:21:07.574656+0000","last_became_peered":"2024-04-15T00:21:07.574656+0000","last_unstale":"2024-04-15T00:21:15.619610+0000","last_undegraded":"2024-04-15T00:21:15.619610+0000","last_fullsized":"2024-04-15T00:21:15.619610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:21:35.113136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602552+0000","last_change":"2024-04-15T00:21:12.633646+0000","last_active":"2024-04-15T00:21:13.602552+0000","last_peered":"2024-04-15T00:21:13.602552+0000","last_clean":"2024-04-15T00:21:13.602552+0000","last_became_active":"2024-04-15T00:21:12.633262+0000","last_became_peered":"2024-04-15T00:21:12.633262+0000","last_unstale":"2024-04-15T00:21:13.602552+0000","last_undegraded":"2024-04-15T00:21:13.602552+0000","last_fullsized":"2024-04-15T00:21:13.602552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:26:17.136974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620791+0000","last_change":"2024-04-15T00:21:12.634552+0000","last_active":"2024-04-15T00:21:15.620791+0000","last_peered":"2024-04-15T00:21:15.620791+0000","last_clean":"2024-04-15T00:21:15.620791+0000","last_became_active":"2024-04-15T00:21:12.633824+0000","last_became_peered":"2024-04-15T00:21:12.633824+0000","last_unstale":"2024-04-15T00:21:15.620791+0000","last_undegraded":"2024-04-15T00:21:15.620791+0000","last_fullsized":"2024-04-15T00:21:15.620791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:34.506827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620127+0000","last_change":"2024-04-15T00:21:08.577988+0000","last_active":"2024-04-15T00:21:15.620127+0000","last_peered":"2024-04-15T00:21:15.620127+0000","last_clean":"2024-04-15T00:21:15.620127+0000","last_became_active":"2024-04-15T00:21:08.577692+0000","last_became_peered":"2024-04-15T00:21:08.577692+0000","last_unstale":"2024-04-15T00:21:15.620127+0000","last_undegraded":"2024-04-15T00:21:15.620127+0000","last_fullsized":"2024-04-15T00:21:15.620127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602539+0000","last_change":"2024-04-15T00:21:07.563155+0000","last_active":"2024-04-15T00:21:13.602539+0000","last_peered":"2024-04-15T00:21:13.602539+0000","last_clean":"2024-04-15T00:21:13.602539+0000","last_became_active":"2024-04-15T00:21:07.562747+0000","last_became_peered":"2024-04-15T00:21:07.562747+0000","last_unstale":"2024-04-15T00:21:13.602539+0000","last_undegraded":"2024-04-15T00:21:13.602539+0000","last_fullsized":"2024-04-15T00:21:13.602539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:21:35.113136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620544+0000","last_change":"2024-04-15T00:21:12.624627+0000","last_active":"2024-04-15T00:21:15.620544+0000","last_peered":"2024-04-15T00:21:15.620544+0000","last_clean":"2024-04-15T00:21:15.620544+0000","last_became_active":"2024-04-15T00:21:12.624245+0000","last_became_peered":"2024-04-15T00:21:12.624245+0000","last_unstale":"2024-04-15T00:21:15.620544+0000","last_undegraded":"2024-04-15T00:21:15.620544+0000","last_fullsized":"2024-04-15T00:21:15.620544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:31.463828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602302+0000","last_change":"2024-04-15T00:21:08.590595+0000","last_active":"2024-04-15T00:21:13.602302+0000","last_peered":"2024-04-15T00:21:13.602302+0000","last_clean":"2024-04-15T00:21:13.602302+0000","last_became_active":"2024-04-15T00:21:08.590333+0000","last_became_peered":"2024-04-15T00:21:08.590333+0000","last_unstale":"2024-04-15T00:21:13.602302+0000","last_undegraded":"2024-04-15T00:21:13.602302+0000","last_fullsized":"2024-04-15T00:21:13.602302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602611+0000","last_change":"2024-04-15T00:21:07.576399+0000","last_active":"2024-04-15T00:21:13.602611+0000","last_peered":"2024-04-15T00:21:13.602611+0000","last_clean":"2024-04-15T00:21:13.602611+0000","last_became_active":"2024-04-15T00:21:07.576008+0000","last_became_peered":"2024-04-15T00:21:07.576008+0000","last_unstale":"2024-04-15T00:21:13.602611+0000","last_undegraded":"2024-04-15T00:21:13.602611+0000","last_fullsized":"2024-04-15T00:21:13.602611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:16:52.647503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619476+0000","last_change":"2024-04-15T00:21:07.572597+0000","last_active":"2024-04-15T00:21:15.619476+0000","last_peered":"2024-04-15T00:21:15.619476+0000","last_clean":"2024-04-15T00:21:15.619476+0000","last_became_active":"2024-04-15T00:21:07.572273+0000","last_became_peered":"2024-04-15T00:21:07.572273+0000","last_unstale":"2024-04-15T00:21:15.619476+0000","last_undegraded":"2024-04-15T00:21:15.619476+0000","last_fullsized":"2024-04-15T00:21:15.619476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620643+0000","last_change":"2024-04-15T00:21:08.587210+0000","last_active":"2024-04-15T00:21:15.620643+0000","last_peered":"2024-04-15T00:21:15.620643+0000","last_clean":"2024-04-15T00:21:15.620643+0000","last_became_active":"2024-04-15T00:21:08.586910+0000","last_became_peered":"2024-04-15T00:21:08.586910+0000","last_unstale":"2024-04-15T00:21:15.620643+0000","last_undegraded":"2024-04-15T00:21:15.620643+0000","last_fullsized":"2024-04-15T00:21:15.620643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619912+0000","last_change":"2024-04-15T00:21:12.622128+0000","last_active":"2024-04-15T00:21:15.619912+0000","last_peered":"2024-04-15T00:21:15.619912+0000","last_clean":"2024-04-15T00:21:15.619912+0000","last_became_active":"2024-04-15T00:21:12.621682+0000","last_became_peered":"2024-04-15T00:21:12.621682+0000","last_unstale":"2024-04-15T00:21:15.619912+0000","last_undegraded":"2024-04-15T00:21:15.619912+0000","last_fullsized":"2024-04-15T00:21:15.619912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:03:00.366139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602718+0000","last_change":"2024-04-15T00:21:07.577069+0000","last_active":"2024-04-15T00:21:13.602718+0000","last_peered":"2024-04-15T00:21:13.602718+0000","last_clean":"2024-04-15T00:21:13.602718+0000","last_became_active":"2024-04-15T00:21:07.576791+0000","last_became_peered":"2024-04-15T00:21:07.576791+0000","last_unstale":"2024-04-15T00:21:13.602718+0000","last_undegraded":"2024-04-15T00:21:13.602718+0000","last_fullsized":"2024-04-15T00:21:13.602718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:36:11.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603254+0000","last_change":"2024-04-15T00:21:08.584214+0000","last_active":"2024-04-15T00:21:13.603254+0000","last_peered":"2024-04-15T00:21:13.603254+0000","last_clean":"2024-04-15T00:21:13.603254+0000","last_became_active":"2024-04-15T00:21:08.583909+0000","last_became_peered":"2024-04-15T00:21:08.583909+0000","last_unstale":"2024-04-15T00:21:13.603254+0000","last_undegraded":"2024-04-15T00:21:13.603254+0000","last_fullsized":"2024-04-15T00:21:13.603254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:55.815311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602896+0000","last_change":"2024-04-15T00:21:12.624156+0000","last_active":"2024-04-15T00:21:13.602896+0000","last_peered":"2024-04-15T00:21:13.602896+0000","last_clean":"2024-04-15T00:21:13.602896+0000","last_became_active":"2024-04-15T00:21:12.623756+0000","last_became_peered":"2024-04-15T00:21:12.623756+0000","last_unstale":"2024-04-15T00:21:13.602896+0000","last_undegraded":"2024-04-15T00:21:13.602896+0000","last_fullsized":"2024-04-15T00:21:13.602896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:31:33.202296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619829+0000","last_change":"2024-04-15T00:21:08.588647+0000","last_active":"2024-04-15T00:21:15.619829+0000","last_peered":"2024-04-15T00:21:15.619829+0000","last_clean":"2024-04-15T00:21:15.619829+0000","last_became_active":"2024-04-15T00:21:08.587719+0000","last_became_peered":"2024-04-15T00:21:08.587719+0000","last_unstale":"2024-04-15T00:21:15.619829+0000","last_undegraded":"2024-04-15T00:21:15.619829+0000","last_fullsized":"2024-04-15T00:21:15.619829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:39.454082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619475+0000","last_change":"2024-04-15T00:21:08.596094+0000","last_active":"2024-04-15T00:21:15.619475+0000","last_peered":"2024-04-15T00:21:15.619475+0000","last_clean":"2024-04-15T00:21:15.619475+0000","last_became_active":"2024-04-15T00:21:08.595790+0000","last_became_peered":"2024-04-15T00:21:08.595790+0000","last_unstale":"2024-04-15T00:21:15.619475+0000","last_undegraded":"2024-04-15T00:21:15.619475+0000","last_fullsized":"2024-04-15T00:21:15.619475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:15.446273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603593+0000","last_change":"2024-04-15T00:21:08.583148+0000","last_active":"2024-04-15T00:21:13.603593+0000","last_peered":"2024-04-15T00:21:13.603593+0000","last_clean":"2024-04-15T00:21:13.603593+0000","last_became_active":"2024-04-15T00:21:08.582801+0000","last_became_peered":"2024-04-15T00:21:08.582801+0000","last_unstale":"2024-04-15T00:21:13.603593+0000","last_undegraded":"2024-04-15T00:21:13.603593+0000","last_fullsized":"2024-04-15T00:21:13.603593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:01.007313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620505+0000","last_change":"2024-04-15T00:21:08.596406+0000","last_active":"2024-04-15T00:21:15.620505+0000","last_peered":"2024-04-15T00:21:15.620505+0000","last_clean":"2024-04-15T00:21:15.620505+0000","last_became_active":"2024-04-15T00:21:08.596144+0000","last_became_peered":"2024-04-15T00:21:08.596144+0000","last_unstale":"2024-04-15T00:21:15.620505+0000","last_undegraded":"2024-04-15T00:21:15.620505+0000","last_fullsized":"2024-04-15T00:21:15.620505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603411+0000","last_change":"2024-04-15T00:21:08.591959+0000","last_active":"2024-04-15T00:21:13.603411+0000","last_peered":"2024-04-15T00:21:13.603411+0000","last_clean":"2024-04-15T00:21:13.603411+0000","last_became_active":"2024-04-15T00:21:08.591479+0000","last_became_peered":"2024-04-15T00:21:08.591479+0000","last_unstale":"2024-04-15T00:21:13.603411+0000","last_undegraded":"2024-04-15T00:21:13.603411+0000","last_fullsized":"2024-04-15T00:21:13.603411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619869+0000","last_change":"2024-04-15T00:21:08.577658+0000","last_active":"2024-04-15T00:21:15.619869+0000","last_peered":"2024-04-15T00:21:15.619869+0000","last_clean":"2024-04-15T00:21:15.619869+0000","last_became_active":"2024-04-15T00:21:08.577358+0000","last_became_peered":"2024-04-15T00:21:08.577358+0000","last_unstale":"2024-04-15T00:21:15.619869+0000","last_undegraded":"2024-04-15T00:21:15.619869+0000","last_fullsized":"2024-04-15T00:21:15.619869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620568+0000","last_change":"2024-04-15T00:21:08.593462+0000","last_active":"2024-04-15T00:21:15.620568+0000","last_peered":"2024-04-15T00:21:15.620568+0000","last_clean":"2024-04-15T00:21:15.620568+0000","last_became_active":"2024-04-15T00:21:08.593174+0000","last_became_peered":"2024-04-15T00:21:08.593174+0000","last_unstale":"2024-04-15T00:21:15.620568+0000","last_undegraded":"2024-04-15T00:21:15.620568+0000","last_fullsized":"2024-04-15T00:21:15.620568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602883+0000","last_change":"2024-04-15T00:21:08.582109+0000","last_active":"2024-04-15T00:21:13.602883+0000","last_peered":"2024-04-15T00:21:13.602883+0000","last_clean":"2024-04-15T00:21:13.602883+0000","last_became_active":"2024-04-15T00:21:08.581828+0000","last_became_peered":"2024-04-15T00:21:08.581828+0000","last_unstale":"2024-04-15T00:21:13.602883+0000","last_undegraded":"2024-04-15T00:21:13.602883+0000","last_fullsized":"2024-04-15T00:21:13.602883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:01.007313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602485+0000","last_change":"2024-04-15T00:21:08.582329+0000","last_active":"2024-04-15T00:21:13.602485+0000","last_peered":"2024-04-15T00:21:13.602485+0000","last_clean":"2024-04-15T00:21:13.602485+0000","last_became_active":"2024-04-15T00:21:08.582011+0000","last_became_peered":"2024-04-15T00:21:08.582011+0000","last_unstale":"2024-04-15T00:21:13.602485+0000","last_undegraded":"2024-04-15T00:21:13.602485+0000","last_fullsized":"2024-04-15T00:21:13.602485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602496+0000","last_change":"2024-04-15T00:21:08.581215+0000","last_active":"2024-04-15T00:21:13.602496+0000","last_peered":"2024-04-15T00:21:13.602496+0000","last_clean":"2024-04-15T00:21:13.602496+0000","last_became_active":"2024-04-15T00:21:08.579860+0000","last_became_peered":"2024-04-15T00:21:08.579860+0000","last_unstale":"2024-04-15T00:21:13.602496+0000","last_undegraded":"2024-04-15T00:21:13.602496+0000","last_fullsized":"2024-04-15T00:21:13.602496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603446+0000","last_change":"2024-04-15T00:21:08.592785+0000","last_active":"2024-04-15T00:21:13.603446+0000","last_peered":"2024-04-15T00:21:13.603446+0000","last_clean":"2024-04-15T00:21:13.603446+0000","last_became_active":"2024-04-15T00:21:08.592110+0000","last_became_peered":"2024-04-15T00:21:08.592110+0000","last_unstale":"2024-04-15T00:21:13.603446+0000","last_undegraded":"2024-04-15T00:21:13.603446+0000","last_fullsized":"2024-04-15T00:21:13.603446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:45.258841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620413+0000","last_change":"2024-04-15T00:21:08.599781+0000","last_active":"2024-04-15T00:21:15.620413+0000","last_peered":"2024-04-15T00:21:15.620413+0000","last_clean":"2024-04-15T00:21:15.620413+0000","last_became_active":"2024-04-15T00:21:08.599460+0000","last_became_peered":"2024-04-15T00:21:08.599460+0000","last_unstale":"2024-04-15T00:21:15.620413+0000","last_undegraded":"2024-04-15T00:21:15.620413+0000","last_fullsized":"2024-04-15T00:21:15.620413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:39.454082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620344+0000","last_change":"2024-04-15T00:21:08.588233+0000","last_active":"2024-04-15T00:21:15.620344+0000","last_peered":"2024-04-15T00:21:15.620344+0000","last_clean":"2024-04-15T00:21:15.620344+0000","last_became_active":"2024-04-15T00:21:08.586235+0000","last_became_peered":"2024-04-15T00:21:08.586235+0000","last_unstale":"2024-04-15T00:21:15.620344+0000","last_undegraded":"2024-04-15T00:21:15.620344+0000","last_fullsized":"2024-04-15T00:21:15.620344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.536068+0000","last_change":"2024-04-15T00:21:08.582000+0000","last_active":"2024-04-15T00:21:15.536068+0000","last_peered":"2024-04-15T00:21:15.536068+0000","last_clean":"2024-04-15T00:21:15.536068+0000","last_became_active":"2024-04-15T00:21:08.581714+0000","last_became_peered":"2024-04-15T00:21:08.581714+0000","last_unstale":"2024-04-15T00:21:15.536068+0000","last_undegraded":"2024-04-15T00:21:15.536068+0000","last_fullsized":"2024-04-15T00:21:15.536068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:27.427117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620436+0000","last_change":"2024-04-15T00:21:08.582994+0000","last_active":"2024-04-15T00:21:15.620436+0000","last_peered":"2024-04-15T00:21:15.620436+0000","last_clean":"2024-04-15T00:21:15.620436+0000","last_became_active":"2024-04-15T00:21:08.582594+0000","last_became_peered":"2024-04-15T00:21:08.582594+0000","last_unstale":"2024-04-15T00:21:15.620436+0000","last_undegraded":"2024-04-15T00:21:15.620436+0000","last_fullsized":"2024-04-15T00:21:15.620436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:26:23.617197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.604186+0000","last_change":"2024-04-15T00:21:08.591937+0000","last_active":"2024-04-15T00:21:13.604186+0000","last_peered":"2024-04-15T00:21:13.604186+0000","last_clean":"2024-04-15T00:21:13.604186+0000","last_became_active":"2024-04-15T00:21:08.591655+0000","last_became_peered":"2024-04-15T00:21:08.591655+0000","last_unstale":"2024-04-15T00:21:13.604186+0000","last_undegraded":"2024-04-15T00:21:13.604186+0000","last_fullsized":"2024-04-15T00:21:13.604186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:21:59.995077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602330+0000","last_change":"2024-04-15T00:21:08.590844+0000","last_active":"2024-04-15T00:21:13.602330+0000","last_peered":"2024-04-15T00:21:13.602330+0000","last_clean":"2024-04-15T00:21:13.602330+0000","last_became_active":"2024-04-15T00:21:08.588982+0000","last_became_peered":"2024-04-15T00:21:08.588982+0000","last_unstale":"2024-04-15T00:21:13.602330+0000","last_undegraded":"2024-04-15T00:21:13.602330+0000","last_fullsized":"2024-04-15T00:21:13.602330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620225+0000","last_change":"2024-04-15T00:21:08.581452+0000","last_active":"2024-04-15T00:21:15.620225+0000","last_peered":"2024-04-15T00:21:15.620225+0000","last_clean":"2024-04-15T00:21:15.620225+0000","last_became_active":"2024-04-15T00:21:08.580967+0000","last_became_peered":"2024-04-15T00:21:08.580967+0000","last_unstale":"2024-04-15T00:21:15.620225+0000","last_undegraded":"2024-04-15T00:21:15.620225+0000","last_fullsized":"2024-04-15T00:21:15.620225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.619889+0000","last_change":"2024-04-15T00:21:08.587249+0000","last_active":"2024-04-15T00:21:15.619889+0000","last_peered":"2024-04-15T00:21:15.619889+0000","last_clean":"2024-04-15T00:21:15.619889+0000","last_became_active":"2024-04-15T00:21:08.586885+0000","last_became_peered":"2024-04-15T00:21:08.586885+0000","last_unstale":"2024-04-15T00:21:15.619889+0000","last_undegraded":"2024-04-15T00:21:15.619889+0000","last_fullsized":"2024-04-15T00:21:15.619889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:44:31.020890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602456+0000","last_change":"2024-04-15T00:21:08.579970+0000","last_active":"2024-04-15T00:21:13.602456+0000","last_peered":"2024-04-15T00:21:13.602456+0000","last_clean":"2024-04-15T00:21:13.602456+0000","last_became_active":"2024-04-15T00:21:08.579652+0000","last_became_peered":"2024-04-15T00:21:08.579652+0000","last_unstale":"2024-04-15T00:21:13.602456+0000","last_undegraded":"2024-04-15T00:21:13.602456+0000","last_fullsized":"2024-04-15T00:21:13.602456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:10:24.477646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602944+0000","last_change":"2024-04-15T00:21:08.588376+0000","last_active":"2024-04-15T00:21:13.602944+0000","last_peered":"2024-04-15T00:21:13.602944+0000","last_clean":"2024-04-15T00:21:13.602944+0000","last_became_active":"2024-04-15T00:21:08.587712+0000","last_became_peered":"2024-04-15T00:21:08.587712+0000","last_unstale":"2024-04-15T00:21:13.602944+0000","last_undegraded":"2024-04-15T00:21:13.602944+0000","last_fullsized":"2024-04-15T00:21:13.602944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:34:27.330682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620402+0000","last_change":"2024-04-15T00:21:08.597204+0000","last_active":"2024-04-15T00:21:15.620402+0000","last_peered":"2024-04-15T00:21:15.620402+0000","last_clean":"2024-04-15T00:21:15.620402+0000","last_became_active":"2024-04-15T00:21:08.596862+0000","last_became_peered":"2024-04-15T00:21:08.596862+0000","last_unstale":"2024-04-15T00:21:15.620402+0000","last_undegraded":"2024-04-15T00:21:15.620402+0000","last_fullsized":"2024-04-15T00:21:15.620402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620515+0000","last_change":"2024-04-15T00:21:08.598199+0000","last_active":"2024-04-15T00:21:15.620515+0000","last_peered":"2024-04-15T00:21:15.620515+0000","last_clean":"2024-04-15T00:21:15.620515+0000","last_became_active":"2024-04-15T00:21:08.597790+0000","last_became_peered":"2024-04-15T00:21:08.597790+0000","last_unstale":"2024-04-15T00:21:15.620515+0000","last_undegraded":"2024-04-15T00:21:15.620515+0000","last_fullsized":"2024-04-15T00:21:15.620515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.536057+0000","last_change":"2024-04-15T00:21:08.600496+0000","last_active":"2024-04-15T00:21:15.536057+0000","last_peered":"2024-04-15T00:21:15.536057+0000","last_clean":"2024-04-15T00:21:15.536057+0000","last_became_active":"2024-04-15T00:21:08.600121+0000","last_became_peered":"2024-04-15T00:21:08.600121+0000","last_unstale":"2024-04-15T00:21:15.536057+0000","last_undegraded":"2024-04-15T00:21:15.536057+0000","last_fullsized":"2024-04-15T00:21:15.536057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:11:12.071153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.602194+0000","last_change":"2024-04-15T00:21:08.583866+0000","last_active":"2024-04-15T00:21:13.602194+0000","last_peered":"2024-04-15T00:21:13.602194+0000","last_clean":"2024-04-15T00:21:13.602194+0000","last_became_active":"2024-04-15T00:21:08.583563+0000","last_became_peered":"2024-04-15T00:21:08.583563+0000","last_unstale":"2024-04-15T00:21:13.602194+0000","last_undegraded":"2024-04-15T00:21:13.602194+0000","last_fullsized":"2024-04-15T00:21:13.602194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:27:41.268464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535532+0000","last_change":"2024-04-15T00:21:08.596983+0000","last_active":"2024-04-15T00:21:15.535532+0000","last_peered":"2024-04-15T00:21:15.535532+0000","last_clean":"2024-04-15T00:21:15.535532+0000","last_became_active":"2024-04-15T00:21:08.596640+0000","last_became_peered":"2024-04-15T00:21:08.596640+0000","last_unstale":"2024-04-15T00:21:15.535532+0000","last_undegraded":"2024-04-15T00:21:15.535532+0000","last_fullsized":"2024-04-15T00:21:15.535532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:40.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603293+0000","last_change":"2024-04-15T00:21:08.593027+0000","last_active":"2024-04-15T00:21:13.603293+0000","last_peered":"2024-04-15T00:21:13.603293+0000","last_clean":"2024-04-15T00:21:13.603293+0000","last_became_active":"2024-04-15T00:21:08.592476+0000","last_became_peered":"2024-04-15T00:21:08.592476+0000","last_unstale":"2024-04-15T00:21:13.603293+0000","last_undegraded":"2024-04-15T00:21:13.603293+0000","last_fullsized":"2024-04-15T00:21:13.603293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:10:24.477646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535675+0000","last_change":"2024-04-15T00:21:08.591419+0000","last_active":"2024-04-15T00:21:15.535675+0000","last_peered":"2024-04-15T00:21:15.535675+0000","last_clean":"2024-04-15T00:21:15.535675+0000","last_became_active":"2024-04-15T00:21:08.591101+0000","last_became_peered":"2024-04-15T00:21:08.591101+0000","last_unstale":"2024-04-15T00:21:15.535675+0000","last_undegraded":"2024-04-15T00:21:15.535675+0000","last_fullsized":"2024-04-15T00:21:15.535675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:52:10.558592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:13.603323+0000","last_change":"2024-04-15T00:21:08.581621+0000","last_active":"2024-04-15T00:21:13.603323+0000","last_peered":"2024-04-15T00:21:13.603323+0000","last_clean":"2024-04-15T00:21:13.603323+0000","last_became_active":"2024-04-15T00:21:08.581316+0000","last_became_peered":"2024-04-15T00:21:08.581316+0000","last_unstale":"2024-04-15T00:21:13.603323+0000","last_undegraded":"2024-04-15T00:21:13.603323+0000","last_fullsized":"2024-04-15T00:21:13.603323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:27.427117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620634+0000","last_change":"2024-04-15T00:21:08.590252+0000","last_active":"2024-04-15T00:21:15.620634+0000","last_peered":"2024-04-15T00:21:15.620634+0000","last_clean":"2024-04-15T00:21:15.620634+0000","last_became_active":"2024-04-15T00:21:08.589919+0000","last_became_peered":"2024-04-15T00:21:08.589919+0000","last_unstale":"2024-04-15T00:21:15.620634+0000","last_undegraded":"2024-04-15T00:21:15.620634+0000","last_fullsized":"2024-04-15T00:21:15.620634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:46:53.537904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.620862+0000","last_change":"2024-04-15T00:21:08.588530+0000","last_active":"2024-04-15T00:21:15.620862+0000","last_peered":"2024-04-15T00:21:15.620862+0000","last_clean":"2024-04-15T00:21:15.620862+0000","last_became_active":"2024-04-15T00:21:08.588208+0000","last_became_peered":"2024-04-15T00:21:08.588208+0000","last_unstale":"2024-04-15T00:21:15.620862+0000","last_undegraded":"2024-04-15T00:21:15.620862+0000","last_fullsized":"2024-04-15T00:21:15.620862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:08.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-15T00:21:15.535948+0000","last_change":"2024-04-15T00:21:08.588469+0000","last_active":"2024-04-15T00:21:15.535948+0000","last_peered":"2024-04-15T00:21:15.535948+0000","last_clean":"2024-04-15T00:21:15.535948+0000","last_became_active":"2024-04-15T00:21:08.587646+0000","last_became_peered":"2024-04-15T00:21:08.587646+0000","last_unstale":"2024-04-15T00:21:15.535948+0000","last_undegraded":"2024-04-15T00:21:15.535948+0000","last_fullsized":"2024-04-15T00:21:15.535948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:52:27.105666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":107929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":104087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":695093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":695037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":107929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":104177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":274432,"data_stored":104213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":104247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T00:21:30.398 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-15T00:21:30.399 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-15T00:21:30.399 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-15T00:21:30.400 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-15T00:21:30.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.525+0000 7f1bcf829640 1 Processor -- start 2024-04-15T00:21:30.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.525+0000 7f1bcf829640 1 -- start start 2024-04-15T00:21:30.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.526+0000 7f1bcf829640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1bc80b9bd0 0x7f1bc80bb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:30.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.526+0000 7f1bcf829640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1bc80b94f0 0x7f1bc8147600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:30.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.526+0000 7f1bcf829640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bc80b9fb0 con 0x7f1bc814b870 2024-04-15T00:21:30.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.526+0000 7f1bcf829640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f1bc814b3e0 con 0x7f1bc80b94f0 2024-04-15T00:21:30.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.526+0000 7f1bcf829640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f1bc8147b40 con 0x7f1bc80b9bd0 2024-04-15T00:21:30.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.526+0000 7f1bccdc4640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1bc80b94f0 0x7f1bc8147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:30.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.526+0000 7f1bcddc6640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1bc814b870 0x7f1bc80b8a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:39484/0 (socket says 172.21.15.31:39484) 2024-04-15T00:21:30.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.526+0000 7f1bcddc6640 1 -- 172.21.15.31:0/3752357303 learned_addr learned my addr 172.21.15.31:0/3752357303 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:30.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.526+0000 7f1bcd5c5640 1 --2- 172.21.15.31:0/3752357303 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1bc80b9bd0 0x7f1bc80bb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:30.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.526+0000 7f1bccdc4640 1 -- 172.21.15.31:0/3752357303 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1bc80b9bd0 msgr2=0x7f1bc80bb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:30.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.526+0000 7f1bccdc4640 1 --2- 172.21.15.31:0/3752357303 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1bc80b9bd0 0x7f1bc80bb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:30.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.526+0000 7f1bccdc4640 1 -- 172.21.15.31:0/3752357303 >> v1:172.21.15.31:6789/0 conn(0x7f1bc814b870 legacy=0x7f1bc80b8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:30.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.526+0000 7f1bccdc4640 1 -- 172.21.15.31:0/3752357303 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc814ad90 con 0x7f1bc80b94f0 2024-04-15T00:21:30.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.526+0000 7f1bcd5c5640 1 --2- 172.21.15.31:0/3752357303 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1bc80b9bd0 0x7f1bc80bb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:21:30.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.527+0000 7f1bccdc4640 1 --2- 172.21.15.31:0/3752357303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1bc80b94f0 0x7f1bc8147600 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc0097a0 tx=0x7f1bbc02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d95d0e797352901 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:30.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.527+0000 7f1bc7fff640 1 -- 172.21.15.31:0/3752357303 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc038070 con 0x7f1bc80b94f0 2024-04-15T00:21:30.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.527+0000 7f1bc7fff640 1 -- 172.21.15.31:0/3752357303 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bbc031700 con 0x7f1bc80b94f0 2024-04-15T00:21:30.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.527+0000 7f1bc7fff640 1 -- 172.21.15.31:0/3752357303 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc031ad0 con 0x7f1bc80b94f0 2024-04-15T00:21:30.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.528+0000 7f1bcf829640 1 -- 172.21.15.31:0/3752357303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1bc80b94f0 msgr2=0x7f1bc8147600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:30.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.528+0000 7f1bcf829640 1 --2- 172.21.15.31:0/3752357303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1bc80b94f0 0x7f1bc8147600 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc0097a0 tx=0x7f1bbc02b7a0 comp rx=0 tx=0).stop 2024-04-15T00:21:30.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.528+0000 7f1bcf829640 1 -- 172.21.15.31:0/3752357303 shutdown_connections 2024-04-15T00:21:30.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.528+0000 7f1bcf829640 1 --2- 172.21.15.31:0/3752357303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1bc80b94f0 0x7f1bc8147600 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:30.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.528+0000 7f1bcf829640 1 --2- 172.21.15.31:0/3752357303 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1bc80b9bd0 0x7f1bc80bb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:30.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.528+0000 7f1bcf829640 1 -- 172.21.15.31:0/3752357303 >> 172.21.15.31:0/3752357303 conn(0x7f1bc809ed70 msgr2=0x7f1bc809f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:30.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.528+0000 7f1bcf829640 1 -- 172.21.15.31:0/3752357303 shutdown_connections 2024-04-15T00:21:30.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.528+0000 7f1bcf829640 1 -- 172.21.15.31:0/3752357303 wait complete. 2024-04-15T00:21:30.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.529+0000 7f1bcf829640 1 Processor -- start 2024-04-15T00:21:30.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.529+0000 7f1bcf829640 1 -- start start 2024-04-15T00:21:30.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.529+0000 7f1bcf829640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1bc80b94f0 0x7f1bc81444a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:30.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.529+0000 7f1bcf829640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bc80b9bd0 0x7f1bc81dd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:30.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.529+0000 7f1bcf829640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1bc814b870 0x7f1bc81d1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.529+0000 7f1bcf829640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc80b9170 con 0x7f1bc814b870 2024-04-15T00:21:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.529+0000 7f1bcf829640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc80bcbe0 con 0x7f1bc80b9bd0 2024-04-15T00:21:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.529+0000 7f1bcf829640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f1bc80b92f0 con 0x7f1bc80b94f0 2024-04-15T00:21:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.529+0000 7f1bcddc6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1bc814b870 0x7f1bc81d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.530+0000 7f1bcddc6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1bc814b870 0x7f1bc81d1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52116/0 (socket says 172.21.15.31:52116) 2024-04-15T00:21:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.530+0000 7f1bcddc6640 1 -- 172.21.15.31:0/3462908397 learned_addr learned my addr 172.21.15.31:0/3462908397 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.530+0000 7f1bcd5c5640 1 --2- 172.21.15.31:0/3462908397 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1bc80b94f0 0x7f1bc81444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.530+0000 7f1bccdc4640 1 --2- 172.21.15.31:0/3462908397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bc80b9bd0 0x7f1bc81dd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.530+0000 7f1bcddc6640 1 -- 172.21.15.31:0/3462908397 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1bc80b94f0 msgr2=0x7f1bc81444a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.530+0000 7f1bcddc6640 1 --2- 172.21.15.31:0/3462908397 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1bc80b94f0 0x7f1bc81444a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.530+0000 7f1bcddc6640 1 -- 172.21.15.31:0/3462908397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bc80b9bd0 msgr2=0x7f1bc81dd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.530+0000 7f1bcddc6640 1 --2- 172.21.15.31:0/3462908397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bc80b9bd0 0x7f1bc81dd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.530+0000 7f1bcddc6640 1 -- 172.21.15.31:0/3462908397 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc81d1a60 con 0x7f1bc814b870 2024-04-15T00:21:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.530+0000 7f1bccdc4640 1 --2- 172.21.15.31:0/3462908397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bc80b9bd0 0x7f1bc81dd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.530+0000 7f1bcd5c5640 1 --2- 172.21.15.31:0/3462908397 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1bc80b94f0 0x7f1bc81444a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:30.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.530+0000 7f1bcddc6640 1 --2- 172.21.15.31:0/3462908397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1bc814b870 0x7f1bc81d1520 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1bb800c9f0 tx=0x7f1bb800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:30.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.530+0000 7f1bc5ffb640 1 -- 172.21.15.31:0/3462908397 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8017070 con 0x7f1bc814b870 2024-04-15T00:21:30.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.530+0000 7f1bc5ffb640 1 -- 172.21.15.31:0/3462908397 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb800ab70 con 0x7f1bc814b870 2024-04-15T00:21:30.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.530+0000 7f1bcf829640 1 -- 172.21.15.31:0/3462908397 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bc81d1ce0 con 0x7f1bc814b870 2024-04-15T00:21:30.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.530+0000 7f1bc5ffb640 1 -- 172.21.15.31:0/3462908397 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8012400 con 0x7f1bc814b870 2024-04-15T00:21:30.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.530+0000 7f1bcf829640 1 -- 172.21.15.31:0/3462908397 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bc81d0e90 con 0x7f1bc814b870 2024-04-15T00:21:30.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.531+0000 7f1bcf829640 1 -- 172.21.15.31:0/3462908397 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bc804f620 con 0x7f1bc814b870 2024-04-15T00:21:30.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.532+0000 7f1bc5ffb640 1 -- 172.21.15.31:0/3462908397 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f1bb801a070 con 0x7f1bc814b870 2024-04-15T00:21:30.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.532+0000 7f1bc5ffb640 1 --2- 172.21.15.31:0/3462908397 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f1bb406b9c0 0x7f1bb406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:30.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.532+0000 7f1bc5ffb640 1 -- 172.21.15.31:0/3462908397 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1bb808a610 con 0x7f1bc814b870 2024-04-15T00:21:30.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.532+0000 7f1bcd5c5640 1 --2- 172.21.15.31:0/3462908397 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f1bb406b9c0 0x7f1bb406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:30.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.532+0000 7f1bcd5c5640 1 --2- 172.21.15.31:0/3462908397 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f1bb406b9c0 0x7f1bb406de80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000aa30 tx=0x7f1bc0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:30.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.536+0000 7f1bc5ffb640 1 -- 172.21.15.31:0/3462908397 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f1bc81d1a60 con 0x7f1bc814b870 2024-04-15T00:21:30.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.758+0000 7f1bcf829640 1 -- 172.21.15.31:0/3462908397 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1bc8145e70 con 0x7f1bc814b870 2024-04-15T00:21:30.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.758+0000 7f1bc5ffb640 1 -- 172.21.15.31:0/3462908397 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f1bb8058920 con 0x7f1bc814b870 2024-04-15T00:21:30.766 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:21:30.766 INFO:teuthology.orchestra.run.smithi031.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-15T00:21:30.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.760+0000 7f1bcf829640 1 -- 172.21.15.31:0/3462908397 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f1bb406b9c0 msgr2=0x7f1bb406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:30.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.760+0000 7f1bcf829640 1 --2- 172.21.15.31:0/3462908397 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f1bb406b9c0 0x7f1bb406de80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000aa30 tx=0x7f1bc0008040 comp rx=0 tx=0).stop 2024-04-15T00:21:30.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.760+0000 7f1bcf829640 1 -- 172.21.15.31:0/3462908397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1bc814b870 msgr2=0x7f1bc81d1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:30.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.760+0000 7f1bcf829640 1 --2- 172.21.15.31:0/3462908397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1bc814b870 0x7f1bc81d1520 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1bb800c9f0 tx=0x7f1bb800ceb0 comp rx=0 tx=0).stop 2024-04-15T00:21:30.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.760+0000 7f1bcf829640 1 -- 172.21.15.31:0/3462908397 shutdown_connections 2024-04-15T00:21:30.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.760+0000 7f1bcf829640 1 --2- 172.21.15.31:0/3462908397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1bc814b870 0x7f1bc81d1520 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:30.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.760+0000 7f1bcf829640 1 --2- 172.21.15.31:0/3462908397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bc80b9bd0 0x7f1bc81dd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:30.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.760+0000 7f1bcf829640 1 --2- 172.21.15.31:0/3462908397 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f1bb406b9c0 0x7f1bb406de80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:30.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.760+0000 7f1bcf829640 1 --2- 172.21.15.31:0/3462908397 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f1bc80b94f0 0x7f1bc81444a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:30.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.760+0000 7f1bcf829640 1 -- 172.21.15.31:0/3462908397 >> 172.21.15.31:0/3462908397 conn(0x7f1bc809ed70 msgr2=0x7f1bc8072d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:30.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.760+0000 7f1bcf829640 1 -- 172.21.15.31:0/3462908397 shutdown_connections 2024-04-15T00:21:30.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.760+0000 7f1bcf829640 1 -- 172.21.15.31:0/3462908397 wait complete. 2024-04-15T00:21:30.778 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-15T00:21:30.779 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:21:30.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.873+0000 7f59a55fa640 1 Processor -- start 2024-04-15T00:21:30.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.873+0000 7f59a55fa640 1 -- start start 2024-04-15T00:21:30.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.874+0000 7f59a55fa640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f59a00b4c20 0x7f59a00af930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:30.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.874+0000 7f59a55fa640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a006c020 con 0x7f59a00b0590 2024-04-15T00:21:30.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.874+0000 7f59a55fa640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a0067560 con 0x7f59a0067180 2024-04-15T00:21:30.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.874+0000 7f59a55fa640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f59a00b50b0 con 0x7f59a00b4c20 2024-04-15T00:21:30.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.874+0000 7f599f7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f59a00b4c20 0x7f59a00af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:30.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.874+0000 7f599e7fc640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f59a00b0590 0x7f59a006b910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:39488/0 (socket says 172.21.15.31:39488) 2024-04-15T00:21:30.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.874+0000 7f599e7fc640 1 -- 172.21.15.31:0/3359411923 learned_addr learned my addr 172.21.15.31:0/3359411923 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:30.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.874+0000 7f599f7fe640 1 -- 172.21.15.31:0/3359411923 >> v1:172.21.15.50:6789/0 conn(0x7f59a0067180 legacy=0x7f59a006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:30.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.874+0000 7f599dffb640 1 -- 172.21.15.31:0/3359411923 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 6293687 0 0) 0x7f59a006c020 con 0x7f59a00b0590 2024-04-15T00:21:30.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.874+0000 7f599f7fe640 1 -- 172.21.15.31:0/3359411923 >> v1:172.21.15.31:6789/0 conn(0x7f59a00b0590 legacy=0x7f59a006b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:30.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.875+0000 7f599f7fe640 1 -- 172.21.15.31:0/3359411923 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a009f250 con 0x7f59a00b4c20 2024-04-15T00:21:30.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.875+0000 7f599f7fe640 1 --2- 172.21.15.31:0/3359411923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59a00b4c20 0x7f59a00af930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5990009dc0 tx=0x7f599002be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1da49521cc8ec8 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:30.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.875+0000 7f599dffb640 1 -- 172.21.15.31:0/3359411923 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5990039070 con 0x7f59a00b4c20 2024-04-15T00:21:30.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.875+0000 7f599dffb640 1 -- 172.21.15.31:0/3359411923 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f599002cc40 con 0x7f59a00b4c20 2024-04-15T00:21:30.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.875+0000 7f599dffb640 1 -- 172.21.15.31:0/3359411923 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5990034440 con 0x7f59a00b4c20 2024-04-15T00:21:30.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.876+0000 7f59a55fa640 1 -- 172.21.15.31:0/3359411923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59a00b4c20 msgr2=0x7f59a00af930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:30.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.876+0000 7f59a55fa640 1 --2- 172.21.15.31:0/3359411923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59a00b4c20 0x7f59a00af930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5990009dc0 tx=0x7f599002be90 comp rx=0 tx=0).stop 2024-04-15T00:21:30.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.876+0000 7f59a55fa640 1 -- 172.21.15.31:0/3359411923 shutdown_connections 2024-04-15T00:21:30.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.876+0000 7f59a55fa640 1 --2- 172.21.15.31:0/3359411923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59a00b4c20 0x7f59a00af930 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:30.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.876+0000 7f59a55fa640 1 -- 172.21.15.31:0/3359411923 >> 172.21.15.31:0/3359411923 conn(0x7f59a00b6640 msgr2=0x7f59a00b6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:30.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.876+0000 7f59a55fa640 1 -- 172.21.15.31:0/3359411923 shutdown_connections 2024-04-15T00:21:30.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.876+0000 7f59a55fa640 1 -- 172.21.15.31:0/3359411923 wait complete. 2024-04-15T00:21:30.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.877+0000 7f59a55fa640 1 Processor -- start 2024-04-15T00:21:30.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.877+0000 7f59a55fa640 1 -- start start 2024-04-15T00:21:30.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.878+0000 7f59a55fa640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59a0067180 0x7f59a01cd990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:30.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.878+0000 7f59a55fa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59a00b0590 0x7f59a01ddfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:30.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.878+0000 7f59a55fa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59a00b4c20 0x7f59a01d0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:30.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.878+0000 7f59a55fa640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f59a00b5a60 con 0x7f59a00b4c20 2024-04-15T00:21:30.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.878+0000 7f59a55fa640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f59a00af1d0 con 0x7f59a00b0590 2024-04-15T00:21:30.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.878+0000 7f59a55fa640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f59a00b5be0 con 0x7f59a0067180 2024-04-15T00:21:30.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.878+0000 7f599f7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59a00b4c20 0x7f59a01d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:30.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.878+0000 7f599f7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59a00b4c20 0x7f59a01d0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52132/0 (socket says 172.21.15.31:52132) 2024-04-15T00:21:30.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.878+0000 7f599f7fe640 1 -- 172.21.15.31:0/279540791 learned_addr learned my addr 172.21.15.31:0/279540791 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:30.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.878+0000 7f599e7fc640 1 --2- 172.21.15.31:0/279540791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59a00b0590 0x7f59a01ddfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:30.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.878+0000 7f599effd640 1 --2- 172.21.15.31:0/279540791 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59a0067180 0x7f59a01cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:30.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.878+0000 7f599f7fe640 1 -- 172.21.15.31:0/279540791 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59a0067180 msgr2=0x7f59a01cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:30.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.878+0000 7f599f7fe640 1 --2- 172.21.15.31:0/279540791 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59a0067180 0x7f59a01cd990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:30.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.878+0000 7f599f7fe640 1 -- 172.21.15.31:0/279540791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59a00b0590 msgr2=0x7f59a01ddfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:30.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.878+0000 7f599f7fe640 1 --2- 172.21.15.31:0/279540791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59a00b0590 0x7f59a01ddfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:30.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.878+0000 7f599f7fe640 1 -- 172.21.15.31:0/279540791 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a01dd520 con 0x7f59a00b4c20 2024-04-15T00:21:30.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.878+0000 7f599f7fe640 1 --2- 172.21.15.31:0/279540791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59a00b4c20 0x7f59a01d0960 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5990037040 tx=0x7f5990004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:30.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.878+0000 7f59877fe640 1 -- 172.21.15.31:0/279540791 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5990044020 con 0x7f59a00b4c20 2024-04-15T00:21:30.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.879+0000 7f59877fe640 1 -- 172.21.15.31:0/279540791 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f599003a040 con 0x7f59a00b4c20 2024-04-15T00:21:30.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.879+0000 7f59a55fa640 1 -- 172.21.15.31:0/279540791 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59a01cfef0 con 0x7f59a00b4c20 2024-04-15T00:21:30.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.879+0000 7f59877fe640 1 -- 172.21.15.31:0/279540791 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5990039050 con 0x7f59a00b4c20 2024-04-15T00:21:30.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.879+0000 7f59a55fa640 1 -- 172.21.15.31:0/279540791 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59a01d0ea0 con 0x7f59a00b4c20 2024-04-15T00:21:30.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.879+0000 7f59a55fa640 1 -- 172.21.15.31:0/279540791 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59a009f7c0 con 0x7f59a00b4c20 2024-04-15T00:21:30.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.880+0000 7f59877fe640 1 -- 172.21.15.31:0/279540791 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f5990003bb0 con 0x7f59a00b4c20 2024-04-15T00:21:30.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.880+0000 7f59877fe640 1 --2- 172.21.15.31:0/279540791 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f598c06b990 0x7f598c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:30.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.880+0000 7f599effd640 1 --2- 172.21.15.31:0/279540791 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f598c06b990 0x7f598c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:30.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.880+0000 7f59877fe640 1 -- 172.21.15.31:0/279540791 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f59900acfe0 con 0x7f59a00b4c20 2024-04-15T00:21:30.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.881+0000 7f599effd640 1 --2- 172.21.15.31:0/279540791 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f598c06b990 0x7f598c06de50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5998000f60 tx=0x7f5998009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:30.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:30.884+0000 7f59877fe640 1 -- 172.21.15.31:0/279540791 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f599004e060 con 0x7f59a00b4c20 2024-04-15T00:21:31.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.066+0000 7f59a55fa640 1 -- 172.21.15.31:0/279540791 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59a004f620 con 0x7f59a00b4c20 2024-04-15T00:21:31.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.067+0000 7f59877fe640 1 -- 172.21.15.31:0/279540791 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7f599007ba00 con 0x7f59a00b4c20 2024-04-15T00:21:31.075 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:21:31.075 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"fsid":"b57c03ab-2810-4ea5-b233-6164468328c0","created":"2024-04-15T00:20:44.073217+0000","modified":"2024-04-15T00:21:12.971956+0000","last_up_change":"2024-04-15T00:20:55.515596+0000","last_in_change":"2024-04-15T00:20:46.364541+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:20:56.423161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:21:06.436169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:21:06.888505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:21:10.610300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b085a2f4-5565-4ccc-a98e-e56180791550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6817","nonce":2355720818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6819","nonce":2355720818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6823","nonce":2355720818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6821","nonce":2355720818}]},"public_addr":"172.21.15.31:6817/2355720818","cluster_addr":"172.21.15.31:6819/2355720818","heartbeat_back_addr":"172.21.15.31:6823/2355720818","heartbeat_front_addr":"172.21.15.31:6821/2355720818","state":["exists","up"]},{"osd":1,"uuid":"0f751557-3f18-464f-8b78-614d19549f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6809","nonce":2705297130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6811","nonce":2705297130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6815","nonce":2705297130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6813","nonce":2705297130}]},"public_addr":"172.21.15.31:6809/2705297130","cluster_addr":"172.21.15.31:6811/2705297130","heartbeat_back_addr":"172.21.15.31:6815/2705297130","heartbeat_front_addr":"172.21.15.31:6813/2705297130","state":["exists","up"]},{"osd":2,"uuid":"17371b09-2bd7-4ef7-926f-e7706319f064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6801","nonce":225061474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6803","nonce":225061474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6807","nonce":225061474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6805","nonce":225061474}]},"public_addr":"172.21.15.31:6801/225061474","cluster_addr":"172.21.15.31:6803/225061474","heartbeat_back_addr":"172.21.15.31:6807/225061474","heartbeat_front_addr":"172.21.15.31:6805/225061474","state":["exists","up"]},{"osd":3,"uuid":"315b6949-f009-4291-9581-aa4912642dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6825","nonce":3722449780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6827","nonce":3722449780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6831","nonce":3722449780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6829","nonce":3722449780}]},"public_addr":"172.21.15.31:6825/3722449780","cluster_addr":"172.21.15.31:6827/3722449780","heartbeat_back_addr":"172.21.15.31:6831/3722449780","heartbeat_front_addr":"172.21.15.31:6829/3722449780","state":["exists","up"]},{"osd":4,"uuid":"e3659369-cc78-4aa8-bd10-a199d4a1569d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6801","nonce":1279970071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6803","nonce":1279970071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6807","nonce":1279970071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6805","nonce":1279970071}]},"public_addr":"172.21.15.50:6801/1279970071","cluster_addr":"172.21.15.50:6803/1279970071","heartbeat_back_addr":"172.21.15.50:6807/1279970071","heartbeat_front_addr":"172.21.15.50:6805/1279970071","state":["exists","up"]},{"osd":5,"uuid":"35c3a4c0-0b45-45d2-85b9-301c347602f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6809","nonce":1589417182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6811","nonce":1589417182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6815","nonce":1589417182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6813","nonce":1589417182}]},"public_addr":"172.21.15.50:6809/1589417182","cluster_addr":"172.21.15.50:6811/1589417182","heartbeat_back_addr":"172.21.15.50:6815/1589417182","heartbeat_front_addr":"172.21.15.50:6813/1589417182","state":["exists","up"]},{"osd":6,"uuid":"20df7a76-245f-4946-9624-6ca9e949227b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6817","nonce":682288274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6819","nonce":682288274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6823","nonce":682288274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6821","nonce":682288274}]},"public_addr":"172.21.15.50:6817/682288274","cluster_addr":"172.21.15.50:6819/682288274","heartbeat_back_addr":"172.21.15.50:6823/682288274","heartbeat_front_addr":"172.21.15.50:6821/682288274","state":["exists","up"]},{"osd":7,"uuid":"95a504b7-e13a-49e6-8484-9dff4d5fc048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6825","nonce":4129060906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6827","nonce":4129060906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6831","nonce":4129060906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6829","nonce":4129060906}]},"public_addr":"172.21.15.50:6825/4129060906","cluster_addr":"172.21.15.50:6827/4129060906","heartbeat_back_addr":"172.21.15.50:6831/4129060906","heartbeat_front_addr":"172.21.15.50:6829/4129060906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.501980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.529961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.540913+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.521396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.448364+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.514136+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.527229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.508950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:21:31.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.069+0000 7f59a55fa640 1 -- 172.21.15.31:0/279540791 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f598c06b990 msgr2=0x7f598c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:31.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.069+0000 7f59a55fa640 1 --2- 172.21.15.31:0/279540791 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f598c06b990 0x7f598c06de50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5998000f60 tx=0x7f5998009040 comp rx=0 tx=0).stop 2024-04-15T00:21:31.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.069+0000 7f59a55fa640 1 -- 172.21.15.31:0/279540791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59a00b4c20 msgr2=0x7f59a01d0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:31.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.069+0000 7f59a55fa640 1 --2- 172.21.15.31:0/279540791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59a00b4c20 0x7f59a01d0960 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5990037040 tx=0x7f5990004a40 comp rx=0 tx=0).stop 2024-04-15T00:21:31.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.069+0000 7f59a55fa640 1 -- 172.21.15.31:0/279540791 shutdown_connections 2024-04-15T00:21:31.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.069+0000 7f59a55fa640 1 --2- 172.21.15.31:0/279540791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59a00b4c20 0x7f59a01d0960 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:31.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.069+0000 7f59a55fa640 1 --2- 172.21.15.31:0/279540791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59a00b0590 0x7f59a01ddfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:31.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.069+0000 7f59a55fa640 1 --2- 172.21.15.31:0/279540791 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f598c06b990 0x7f598c06de50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:31.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.069+0000 7f59a55fa640 1 --2- 172.21.15.31:0/279540791 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59a0067180 0x7f59a01cd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:31.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.069+0000 7f59a55fa640 1 -- 172.21.15.31:0/279540791 >> 172.21.15.31:0/279540791 conn(0x7f59a00b6640 msgr2=0x7f59a006b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:31.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.069+0000 7f59a55fa640 1 -- 172.21.15.31:0/279540791 shutdown_connections 2024-04-15T00:21:31.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.069+0000 7f59a55fa640 1 -- 172.21.15.31:0/279540791 wait complete. 2024-04-15T00:21:31.088 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T00:20:56.423161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T00:21:06.436169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T00:21:06.888505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-15T00:21:10.610300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-15T00:21:31.089 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T00:21:31.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.186+0000 7f1676ad1640 1 Processor -- start 2024-04-15T00:21:31.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.186+0000 7f1676ad1640 1 -- start start 2024-04-15T00:21:31.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.186+0000 7f1676ad1640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f167014b570 0x7f16701414a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:31.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.186+0000 7f1676ad1640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1670072a70 con 0x7f1670072690 2024-04-15T00:21:31.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.186+0000 7f1676ad1640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f167006f1d0 con 0x7f167006fde0 2024-04-15T00:21:31.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.186+0000 7f1676ad1640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f167006efa0 con 0x7f167014b570 2024-04-15T00:21:31.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.187+0000 7f166ffff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f167014b570 0x7f16701414a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:31.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.187+0000 7f166ffff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f167014b570 0x7f16701414a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52138/0 (socket says 172.21.15.31:52138) 2024-04-15T00:21:31.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.187+0000 7f166ffff640 1 -- 172.21.15.31:0/739363197 learned_addr learned my addr 172.21.15.31:0/739363197 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:31.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.187+0000 7f167486d640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1670072690 0x7f167014ae60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:39502/0 (socket says 172.21.15.31:39502) 2024-04-15T00:21:31.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.187+0000 7f166ffff640 1 -- 172.21.15.31:0/739363197 >> v1:172.21.15.50:6789/0 conn(0x7f167006fde0 legacy=0x7f16701419e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:31.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.187+0000 7f166ffff640 1 -- 172.21.15.31:0/739363197 >> v1:172.21.15.31:6789/0 conn(0x7f1670072690 legacy=0x7f167014ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:31.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.187+0000 7f166ffff640 1 -- 172.21.15.31:0/739363197 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f167006f4b0 con 0x7f167014b570 2024-04-15T00:21:31.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.187+0000 7f166f7fe640 1 -- 172.21.15.31:0/739363197 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1954459498 0 0) 0x7f1670072a70 con 0x7f1670072690 2024-04-15T00:21:31.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.188+0000 7f166ffff640 1 --2- 172.21.15.31:0/739363197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f167014b570 0x7f16701414a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f165c009870 tx=0x7f165c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124b4a37d0be709b server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:31.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.188+0000 7f166f7fe640 1 -- 172.21.15.31:0/739363197 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c034070 con 0x7f167014b570 2024-04-15T00:21:31.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.188+0000 7f166f7fe640 1 -- 172.21.15.31:0/739363197 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f165c030860 con 0x7f167014b570 2024-04-15T00:21:31.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.188+0000 7f166f7fe640 1 -- 172.21.15.31:0/739363197 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c030c30 con 0x7f167014b570 2024-04-15T00:21:31.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.188+0000 7f1676ad1640 1 -- 172.21.15.31:0/739363197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f167014b570 msgr2=0x7f16701414a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:31.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.188+0000 7f1676ad1640 1 --2- 172.21.15.31:0/739363197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f167014b570 0x7f16701414a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f165c009870 tx=0x7f165c02b9a0 comp rx=0 tx=0).stop 2024-04-15T00:21:31.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.188+0000 7f1676ad1640 1 -- 172.21.15.31:0/739363197 shutdown_connections 2024-04-15T00:21:31.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.188+0000 7f1676ad1640 1 --2- 172.21.15.31:0/739363197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f167014b570 0x7f16701414a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:31.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.188+0000 7f1676ad1640 1 -- 172.21.15.31:0/739363197 >> 172.21.15.31:0/739363197 conn(0x7f16700b7840 msgr2=0x7f16700b7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:31.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.188+0000 7f1676ad1640 1 -- 172.21.15.31:0/739363197 shutdown_connections 2024-04-15T00:21:31.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.188+0000 7f1676ad1640 1 -- 172.21.15.31:0/739363197 wait complete. 2024-04-15T00:21:31.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.189+0000 7f1676ad1640 1 Processor -- start 2024-04-15T00:21:31.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.189+0000 7f1676ad1640 1 -- start start 2024-04-15T00:21:31.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.190+0000 7f1676ad1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f167006fde0 0x7f167014a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:31.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.190+0000 7f1676ad1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1670072690 0x7f16701473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:31.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.190+0000 7f1676ad1640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f167014b570 0x7f16701dd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:31.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.190+0000 7f1676ad1640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f16700b74a0 con 0x7f167006fde0 2024-04-15T00:21:31.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.190+0000 7f1676ad1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f167006f820 con 0x7f1670072690 2024-04-15T00:21:31.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.190+0000 7f1676ad1640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f16700b7620 con 0x7f167014b570 2024-04-15T00:21:31.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.190+0000 7f167486d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f167006fde0 0x7f167014a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:31.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.190+0000 7f167486d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f167006fde0 0x7f167014a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52142/0 (socket says 172.21.15.31:52142) 2024-04-15T00:21:31.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.190+0000 7f167486d640 1 -- 172.21.15.31:0/1813302922 learned_addr learned my addr 172.21.15.31:0/1813302922 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:31.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.190+0000 7f166ffff640 1 --2- 172.21.15.31:0/1813302922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1670072690 0x7f16701473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:31.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.190+0000 7f167506e640 1 --2- 172.21.15.31:0/1813302922 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f167014b570 0x7f16701dd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:31.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.190+0000 7f167486d640 1 -- 172.21.15.31:0/1813302922 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f167014b570 msgr2=0x7f16701dd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:31.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.190+0000 7f167486d640 1 --2- 172.21.15.31:0/1813302922 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f167014b570 0x7f16701dd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:31.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.190+0000 7f167486d640 1 -- 172.21.15.31:0/1813302922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1670072690 msgr2=0x7f16701473b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:31.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.190+0000 7f167486d640 1 --2- 172.21.15.31:0/1813302922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1670072690 0x7f16701473b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:31.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.190+0000 7f167486d640 1 -- 172.21.15.31:0/1813302922 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1670142390 con 0x7f167006fde0 2024-04-15T00:21:31.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.191+0000 7f167486d640 1 --2- 172.21.15.31:0/1813302922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f167006fde0 0x7f167014a1d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f166400c4d0 tx=0x7f166400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:31.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.191+0000 7f166d7fa640 1 -- 172.21.15.31:0/1813302922 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1664007480 con 0x7f167006fde0 2024-04-15T00:21:31.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.191+0000 7f166d7fa640 1 -- 172.21.15.31:0/1813302922 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16640057a0 con 0x7f167006fde0 2024-04-15T00:21:31.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.191+0000 7f1676ad1640 1 -- 172.21.15.31:0/1813302922 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1670142670 con 0x7f167006fde0 2024-04-15T00:21:31.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.191+0000 7f166d7fa640 1 -- 172.21.15.31:0/1813302922 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1664007620 con 0x7f167006fde0 2024-04-15T00:21:31.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.191+0000 7f1676ad1640 1 -- 172.21.15.31:0/1813302922 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1670146860 con 0x7f167006fde0 2024-04-15T00:21:31.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.192+0000 7f1676ad1640 1 -- 172.21.15.31:0/1813302922 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1670148590 con 0x7f167006fde0 2024-04-15T00:21:31.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.192+0000 7f166d7fa640 1 -- 172.21.15.31:0/1813302922 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f1664005b50 con 0x7f167006fde0 2024-04-15T00:21:31.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.193+0000 7f166d7fa640 1 --2- 172.21.15.31:0/1813302922 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f165406b9c0 0x7f165406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:31.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.193+0000 7f166d7fa640 1 -- 172.21.15.31:0/1813302922 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f166408a710 con 0x7f167006fde0 2024-04-15T00:21:31.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.193+0000 7f166ffff640 1 --2- 172.21.15.31:0/1813302922 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f165406b9c0 0x7f165406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:31.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.193+0000 7f166ffff640 1 --2- 172.21.15.31:0/1813302922 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f165406b9c0 0x7f165406de80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f165c036000 tx=0x7f165c03b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:31.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.197+0000 7f166d7fa640 1 -- 172.21.15.31:0/1813302922 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f16640182b0 con 0x7f167006fde0 2024-04-15T00:21:31.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.376+0000 7f1676ad1640 1 -- 172.21.15.31:0/1813302922 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f167013e300 con 0x7f167006fde0 2024-04-15T00:21:31.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.377+0000 7f166d7fa640 1 -- 172.21.15.31:0/1813302922 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f1664059070 con 0x7f167006fde0 2024-04-15T00:21:31.384 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-15T00:21:31.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.379+0000 7f1676ad1640 1 -- 172.21.15.31:0/1813302922 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f165406b9c0 msgr2=0x7f165406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:31.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.379+0000 7f1676ad1640 1 --2- 172.21.15.31:0/1813302922 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f165406b9c0 0x7f165406de80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f165c036000 tx=0x7f165c03b040 comp rx=0 tx=0).stop 2024-04-15T00:21:31.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.379+0000 7f1676ad1640 1 -- 172.21.15.31:0/1813302922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f167006fde0 msgr2=0x7f167014a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:31.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.379+0000 7f1676ad1640 1 --2- 172.21.15.31:0/1813302922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f167006fde0 0x7f167014a1d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f166400c4d0 tx=0x7f166400c990 comp rx=0 tx=0).stop 2024-04-15T00:21:31.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.379+0000 7f1676ad1640 1 -- 172.21.15.31:0/1813302922 shutdown_connections 2024-04-15T00:21:31.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.379+0000 7f1676ad1640 1 --2- 172.21.15.31:0/1813302922 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f165406b9c0 0x7f165406de80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:31.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.379+0000 7f1676ad1640 1 --2- 172.21.15.31:0/1813302922 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f167014b570 0x7f16701dd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:31.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.379+0000 7f1676ad1640 1 --2- 172.21.15.31:0/1813302922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1670072690 0x7f16701473b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:31.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.379+0000 7f1676ad1640 1 --2- 172.21.15.31:0/1813302922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f167006fde0 0x7f167014a1d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:31.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.379+0000 7f1676ad1640 1 -- 172.21.15.31:0/1813302922 >> 172.21.15.31:0/1813302922 conn(0x7f16700b7840 msgr2=0x7f16700b6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:31.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.379+0000 7f1676ad1640 1 -- 172.21.15.31:0/1813302922 shutdown_connections 2024-04-15T00:21:31.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.379+0000 7f1676ad1640 1 -- 172.21.15.31:0/1813302922 wait complete. 2024-04-15T00:21:31.397 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T00:21:31.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.494+0000 7fcbebe69640 1 Processor -- start 2024-04-15T00:21:31.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.494+0000 7fcbebe69640 1 -- start start 2024-04-15T00:21:31.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.495+0000 7fcbebe69640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcbe40b7800 0x7fcbe41416b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:31.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.495+0000 7fcbebe69640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbe4072c00 con 0x7fcbe4141bf0 2024-04-15T00:21:31.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.495+0000 7fcbebe69640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbe409c150 con 0x7fcbe4072820 2024-04-15T00:21:31.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.495+0000 7fcbebe69640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fcbe409c430 con 0x7fcbe40b7800 2024-04-15T00:21:31.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.495+0000 7fcbea406640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fcbe4141bf0 0x7fcbe4152060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:39508/0 (socket says 172.21.15.31:39508) 2024-04-15T00:21:31.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.495+0000 7fcbea406640 1 -- 172.21.15.31:0/1893422866 learned_addr learned my addr 172.21.15.31:0/1893422866 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:31.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.495+0000 7fcbe9404640 1 --2- 172.21.15.31:0/1893422866 >> v2:172.21.15.50:3300/0 conn(0x7fcbe40b7800 0x7fcbe41416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:31.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.495+0000 7fcbe8c03640 1 -- 172.21.15.31:0/1893422866 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4100483533 0 0) 0x7fcbe4072c00 con 0x7fcbe4141bf0 2024-04-15T00:21:31.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.495+0000 7fcbe8c03640 1 -- 172.21.15.31:0/1893422866 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbd0003520 con 0x7fcbe4141bf0 2024-04-15T00:21:31.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.495+0000 7fcbe8c03640 1 -- 172.21.15.31:0/1893422866 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1381273436 0 0) 0x7fcbe409c150 con 0x7fcbe4072820 2024-04-15T00:21:31.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.495+0000 7fcbe8c03640 1 -- 172.21.15.31:0/1893422866 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbe4072c00 con 0x7fcbe4072820 2024-04-15T00:21:31.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.495+0000 7fcbe8c03640 1 -- 172.21.15.31:0/1893422866 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 719866570 0 0) 0x7fcbd0003520 con 0x7fcbe4141bf0 2024-04-15T00:21:31.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.495+0000 7fcbe8c03640 1 -- 172.21.15.31:0/1893422866 >> v2:172.21.15.50:3300/0 conn(0x7fcbe40b7800 msgr2=0x7fcbe41416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:31.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.495+0000 7fcbe8c03640 1 --2- 172.21.15.31:0/1893422866 >> v2:172.21.15.50:3300/0 conn(0x7fcbe40b7800 0x7fcbe41416b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:31.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.495+0000 7fcbe8c03640 1 -- 172.21.15.31:0/1893422866 >> v1:172.21.15.50:6789/0 conn(0x7fcbe4072820 legacy=0x7fcbe40b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:31.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.495+0000 7fcbe8c03640 1 -- 172.21.15.31:0/1893422866 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe40b3cb0 con 0x7fcbe4141bf0 2024-04-15T00:21:31.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.495+0000 7fcbe8c03640 1 -- 172.21.15.31:0/1893422866 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 697057150 0 0) 0x7fcbdc0019f0 con 0x7fcbe4141bf0 2024-04-15T00:21:31.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.495+0000 7fcbe8c03640 1 -- 172.21.15.31:0/1893422866 >> v1:172.21.15.31:6789/0 conn(0x7fcbe4141bf0 legacy=0x7fcbe4152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:31.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.496+0000 7fcbe8c03640 1 --2- 172.21.15.31:0/1893422866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbd0003b40 0x7fcbd0003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:31.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.496+0000 7fcbe8c03640 1 --2- 172.21.15.31:0/1893422866 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcbd0004800 0x7fcbd0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:31.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.496+0000 7fcbe8c03640 1 --2- 172.21.15.31:0/1893422866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbd00051c0 0x7fcbd000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:31.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.496+0000 7fcbe8c03640 1 -- 172.21.15.31:0/1893422866 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe409c430 con 0x7fcbd0003b40 2024-04-15T00:21:31.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.496+0000 7fcbe8c03640 1 -- 172.21.15.31:0/1893422866 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd000c0f0 con 0x7fcbd00051c0 2024-04-15T00:21:31.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.496+0000 7fcbe8c03640 1 -- 172.21.15.31:0/1893422866 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fcbd000c2f0 con 0x7fcbd0004800 2024-04-15T00:21:31.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.496+0000 7fcbe9404640 1 --2- 172.21.15.31:0/1893422866 >> v2:172.21.15.50:3300/0 conn(0x7fcbe40b7800 0x7fcbe41416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:21:31.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.496+0000 7fcbe9c05640 1 --2- 172.21.15.31:0/1893422866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbd0003b40 0x7fcbd0003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:31.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.496+0000 7fcbea406640 1 --2- 172.21.15.31:0/1893422866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbd00051c0 0x7fcbd000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:31.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.496+0000 7fcbe9404640 1 --2- 172.21.15.31:0/1893422866 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcbd0004800 0x7fcbd0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:31.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.496+0000 7fcbe9c05640 1 -- 172.21.15.31:0/1893422866 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcbd0004800 msgr2=0x7fcbd0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:31.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.496+0000 7fcbe9c05640 1 --2- 172.21.15.31:0/1893422866 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcbd0004800 0x7fcbd0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:31.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.496+0000 7fcbe9c05640 1 -- 172.21.15.31:0/1893422866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbd00051c0 msgr2=0x7fcbd000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:31.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.496+0000 7fcbe9c05640 1 --2- 172.21.15.31:0/1893422866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbd00051c0 0x7fcbd000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:31.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.496+0000 7fcbe9c05640 1 -- 172.21.15.31:0/1893422866 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd0003520 con 0x7fcbd0003b40 2024-04-15T00:21:31.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.496+0000 7fcbea406640 1 -- 172.21.15.31:0/1893422866 reap_dead start 2024-04-15T00:21:31.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.496+0000 7fcbe9404640 1 --2- 172.21.15.31:0/1893422866 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcbd0004800 0x7fcbd0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:31.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.497+0000 7fcbe9c05640 1 --2- 172.21.15.31:0/1893422866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbd0003b40 0x7fcbd0003f40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00018c0 tx=0x7fcbd0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5062b6643fdf7f9b server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:31.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.497+0000 7fcbe8c03640 1 -- 172.21.15.31:0/1893422866 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0037070 con 0x7fcbd0003b40 2024-04-15T00:21:31.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.497+0000 7fcbe8c03640 1 -- 172.21.15.31:0/1893422866 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbe00052f0 con 0x7fcbd0003b40 2024-04-15T00:21:31.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.497+0000 7fcbe8c03640 1 -- 172.21.15.31:0/1893422866 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe00014e0 con 0x7fcbd0003b40 2024-04-15T00:21:31.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.498+0000 7fcbebe69640 1 -- 172.21.15.31:0/1893422866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbd0003b40 msgr2=0x7fcbd0003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:31.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.498+0000 7fcbebe69640 1 --2- 172.21.15.31:0/1893422866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbd0003b40 0x7fcbd0003f40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00018c0 tx=0x7fcbd0005830 comp rx=0 tx=0).stop 2024-04-15T00:21:31.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.498+0000 7fcbebe69640 1 -- 172.21.15.31:0/1893422866 shutdown_connections 2024-04-15T00:21:31.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.498+0000 7fcbebe69640 1 --2- 172.21.15.31:0/1893422866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbd0003b40 0x7fcbd0003f40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:31.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.498+0000 7fcbebe69640 1 -- 172.21.15.31:0/1893422866 >> 172.21.15.31:0/1893422866 conn(0x7fcbe40bce80 msgr2=0x7fcbe40bd290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:31.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.498+0000 7fcbebe69640 1 -- 172.21.15.31:0/1893422866 shutdown_connections 2024-04-15T00:21:31.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.498+0000 7fcbebe69640 1 -- 172.21.15.31:0/1893422866 wait complete. 2024-04-15T00:21:31.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.499+0000 7fcbebe69640 1 Processor -- start 2024-04-15T00:21:31.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.499+0000 7fcbebe69640 1 -- start start 2024-04-15T00:21:31.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.499+0000 7fcbebe69640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcbd0003b40 0x7fcbe4147a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:31.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.499+0000 7fcbebe69640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbe4142d90 0x7fcbe41dd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:31.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.499+0000 7fcbebe69640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbe41dd7f0 0x7fcbe41e04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:31.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.499+0000 7fcbebe69640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe40b8430 con 0x7fcbe41dd7f0 2024-04-15T00:21:31.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.499+0000 7fcbebe69640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe40b82b0 con 0x7fcbe4142d90 2024-04-15T00:21:31.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.499+0000 7fcbebe69640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fcbe40b85b0 con 0x7fcbd0003b40 2024-04-15T00:21:31.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.499+0000 7fcbea406640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbe41dd7f0 0x7fcbe41e04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:31.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.499+0000 7fcbea406640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbe41dd7f0 0x7fcbe41e04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52158/0 (socket says 172.21.15.31:52158) 2024-04-15T00:21:31.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.499+0000 7fcbea406640 1 -- 172.21.15.31:0/1916637835 learned_addr learned my addr 172.21.15.31:0/1916637835 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:31.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.500+0000 7fcbe9404640 1 --2- 172.21.15.31:0/1916637835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbe4142d90 0x7fcbe41dd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:31.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.500+0000 7fcbe9c05640 1 --2- 172.21.15.31:0/1916637835 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcbd0003b40 0x7fcbe4147a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:31.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.500+0000 7fcbea406640 1 -- 172.21.15.31:0/1916637835 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcbd0003b40 msgr2=0x7fcbe4147a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:31.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.500+0000 7fcbea406640 1 --2- 172.21.15.31:0/1916637835 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcbd0003b40 0x7fcbe4147a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:31.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.500+0000 7fcbea406640 1 -- 172.21.15.31:0/1916637835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbe4142d90 msgr2=0x7fcbe41dd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:31.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.500+0000 7fcbea406640 1 --2- 172.21.15.31:0/1916637835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbe4142d90 0x7fcbe41dd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:31.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.500+0000 7fcbea406640 1 -- 172.21.15.31:0/1916637835 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe41434e0 con 0x7fcbe41dd7f0 2024-04-15T00:21:31.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.500+0000 7fcbe9404640 1 --2- 172.21.15.31:0/1916637835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbe4142d90 0x7fcbe41dd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:31.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.500+0000 7fcbea406640 1 --2- 172.21.15.31:0/1916637835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbe41dd7f0 0x7fcbe41e04d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc007670 tx=0x7fcbdc007b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:31.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.500+0000 7fcbda7fc640 1 -- 172.21.15.31:0/1916637835 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc00ab40 con 0x7fcbe41dd7f0 2024-04-15T00:21:31.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.500+0000 7fcbda7fc640 1 -- 172.21.15.31:0/1916637835 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbdc018070 con 0x7fcbe41dd7f0 2024-04-15T00:21:31.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.500+0000 7fcbebe69640 1 -- 172.21.15.31:0/1916637835 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe41ddc70 con 0x7fcbe41dd7f0 2024-04-15T00:21:31.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.500+0000 7fcbda7fc640 1 -- 172.21.15.31:0/1916637835 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc0133f0 con 0x7fcbe41dd7f0 2024-04-15T00:21:31.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.500+0000 7fcbebe69640 1 -- 172.21.15.31:0/1916637835 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe41437c0 con 0x7fcbe41dd7f0 2024-04-15T00:21:31.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.501+0000 7fcbebe69640 1 -- 172.21.15.31:0/1916637835 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbe404f540 con 0x7fcbe41dd7f0 2024-04-15T00:21:31.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.502+0000 7fcbda7fc640 1 -- 172.21.15.31:0/1916637835 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fcbdc013590 con 0x7fcbe41dd7f0 2024-04-15T00:21:31.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.502+0000 7fcbda7fc640 1 --2- 172.21.15.31:0/1916637835 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fcbc806b9c0 0x7fcbc806de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:31.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.502+0000 7fcbda7fc640 1 -- 172.21.15.31:0/1916637835 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fcbdc08b0c0 con 0x7fcbe41dd7f0 2024-04-15T00:21:31.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.502+0000 7fcbe9c05640 1 --2- 172.21.15.31:0/1916637835 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fcbc806b9c0 0x7fcbc806de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:31.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.502+0000 7fcbe9c05640 1 --2- 172.21.15.31:0/1916637835 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fcbc806b9c0 0x7fcbc806de80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0034000 tx=0x7fcbe0009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:31.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.506+0000 7fcbda7fc640 1 -- 172.21.15.31:0/1916637835 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fcbe41ddc70 con 0x7fcbe41dd7f0 2024-04-15T00:21:31.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.689+0000 7fcbebe69640 1 -- 172.21.15.31:0/1916637835 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fcbe41dcf60 con 0x7fcbe41dd7f0 2024-04-15T00:21:31.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.689+0000 7fcbda7fc640 1 -- 172.21.15.31:0/1916637835 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7fcbe41434e0 con 0x7fcbe41dd7f0 2024-04-15T00:21:31.697 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-15T00:21:31.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.691+0000 7fcbebe69640 1 -- 172.21.15.31:0/1916637835 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fcbc806b9c0 msgr2=0x7fcbc806de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:31.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.691+0000 7fcbebe69640 1 --2- 172.21.15.31:0/1916637835 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fcbc806b9c0 0x7fcbc806de80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0034000 tx=0x7fcbe0009030 comp rx=0 tx=0).stop 2024-04-15T00:21:31.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.691+0000 7fcbebe69640 1 -- 172.21.15.31:0/1916637835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbe41dd7f0 msgr2=0x7fcbe41e04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:31.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.691+0000 7fcbebe69640 1 --2- 172.21.15.31:0/1916637835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbe41dd7f0 0x7fcbe41e04d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc007670 tx=0x7fcbdc007b30 comp rx=0 tx=0).stop 2024-04-15T00:21:31.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.691+0000 7fcbebe69640 1 -- 172.21.15.31:0/1916637835 shutdown_connections 2024-04-15T00:21:31.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.691+0000 7fcbebe69640 1 --2- 172.21.15.31:0/1916637835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbe41dd7f0 0x7fcbe41e04d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:31.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.691+0000 7fcbebe69640 1 --2- 172.21.15.31:0/1916637835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbe4142d90 0x7fcbe41dd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:31.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.691+0000 7fcbebe69640 1 --2- 172.21.15.31:0/1916637835 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fcbc806b9c0 0x7fcbc806de80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:31.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.691+0000 7fcbebe69640 1 --2- 172.21.15.31:0/1916637835 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fcbd0003b40 0x7fcbe4147a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:31.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.691+0000 7fcbebe69640 1 -- 172.21.15.31:0/1916637835 >> 172.21.15.31:0/1916637835 conn(0x7fcbe40bce80 msgr2=0x7fcbe413c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:31.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.691+0000 7fcbebe69640 1 -- 172.21.15.31:0/1916637835 shutdown_connections 2024-04-15T00:21:31.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.691+0000 7fcbebe69640 1 -- 172.21.15.31:0/1916637835 wait complete. 2024-04-15T00:21:31.709 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T00:21:31.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.806+0000 7f5959a9d640 1 Processor -- start 2024-04-15T00:21:31.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.806+0000 7f5959a9d640 1 -- start start 2024-04-15T00:21:31.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.807+0000 7f5959a9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f59540b8be0 0x7f5954072570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:31.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.807+0000 7f5959a9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f595414b4c0 0x7f59541449c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:31.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.807+0000 7f5959a9d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5954072c90 con 0x7f59540b80d0 2024-04-15T00:21:31.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.807+0000 7f5959a9d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f595409c0e0 con 0x7f59540b8be0 2024-04-15T00:21:31.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.807+0000 7f5959a9d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f59540b84b0 con 0x7f595414b4c0 2024-04-15T00:21:31.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.807+0000 7f5952ffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f59540b8be0 0x7f5954072570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:31.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.807+0000 7f59537fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f59540b80d0 0x7f595414adb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:39522/0 (socket says 172.21.15.31:39522) 2024-04-15T00:21:31.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.807+0000 7f59537fe640 1 -- 172.21.15.31:0/3358315224 learned_addr learned my addr 172.21.15.31:0/3358315224 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:31.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.807+0000 7f5953fff640 1 --2- 172.21.15.31:0/3358315224 >> v2:172.21.15.50:3300/0 conn(0x7f595414b4c0 0x7f59541449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:31.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.807+0000 7f5952ffd640 1 -- 172.21.15.31:0/3358315224 >> v2:172.21.15.50:3300/0 conn(0x7f595414b4c0 msgr2=0x7f59541449c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:31.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.807+0000 7f5952ffd640 1 --2- 172.21.15.31:0/3358315224 >> v2:172.21.15.50:3300/0 conn(0x7f595414b4c0 0x7f59541449c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:31.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.807+0000 7f5952ffd640 1 -- 172.21.15.31:0/3358315224 >> v1:172.21.15.31:6789/0 conn(0x7f59540b80d0 legacy=0x7f595414adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:31.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.807+0000 7f5952ffd640 1 -- 172.21.15.31:0/3358315224 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f595409c380 con 0x7f59540b8be0 2024-04-15T00:21:31.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.808+0000 7f5952ffd640 1 --2- 172.21.15.31:0/3358315224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59540b8be0 0x7f5954072570 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f59540b7320 tx=0x7f594802b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f243f2f6ccfe36a server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:31.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.808+0000 7f59527fc640 1 -- 172.21.15.31:0/3358315224 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5948038070 con 0x7f59540b8be0 2024-04-15T00:21:31.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.808+0000 7f59527fc640 1 -- 172.21.15.31:0/3358315224 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5948031710 con 0x7f59540b8be0 2024-04-15T00:21:31.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.808+0000 7f59527fc640 1 -- 172.21.15.31:0/3358315224 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5948031ae0 con 0x7f59540b8be0 2024-04-15T00:21:31.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.809+0000 7f5959a9d640 1 -- 172.21.15.31:0/3358315224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59540b8be0 msgr2=0x7f5954072570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:31.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.809+0000 7f5959a9d640 1 --2- 172.21.15.31:0/3358315224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59540b8be0 0x7f5954072570 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f59540b7320 tx=0x7f594802b7b0 comp rx=0 tx=0).stop 2024-04-15T00:21:31.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.809+0000 7f5959a9d640 1 -- 172.21.15.31:0/3358315224 shutdown_connections 2024-04-15T00:21:31.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.809+0000 7f5959a9d640 1 --2- 172.21.15.31:0/3358315224 >> v2:172.21.15.50:3300/0 conn(0x7f595414b4c0 0x7f59541449c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:31.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.809+0000 7f5959a9d640 1 --2- 172.21.15.31:0/3358315224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59540b8be0 0x7f5954072570 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:31.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.809+0000 7f5959a9d640 1 -- 172.21.15.31:0/3358315224 >> 172.21.15.31:0/3358315224 conn(0x7f59540bd020 msgr2=0x7f59540bd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:31.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.809+0000 7f5959a9d640 1 -- 172.21.15.31:0/3358315224 shutdown_connections 2024-04-15T00:21:31.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.809+0000 7f5959a9d640 1 -- 172.21.15.31:0/3358315224 wait complete. 2024-04-15T00:21:31.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.810+0000 7f5959a9d640 1 Processor -- start 2024-04-15T00:21:31.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.810+0000 7f5959a9d640 1 -- start start 2024-04-15T00:21:31.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.811+0000 7f5959a9d640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59540b80d0 0x7f5954145880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:31.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.811+0000 7f5959a9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59540b8be0 0x7f5954146000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:31.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.811+0000 7f5959a9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f595414b4c0 0x7f59541e05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:31.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.811+0000 7f5959a9d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5954145080 con 0x7f595414b4c0 2024-04-15T00:21:31.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.811+0000 7f5959a9d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5954144f00 con 0x7f59540b8be0 2024-04-15T00:21:31.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.811+0000 7f5959a9d640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f5954145200 con 0x7f59540b80d0 2024-04-15T00:21:31.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.811+0000 7f5953fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f595414b4c0 0x7f59541e05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:31.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.811+0000 7f5953fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f595414b4c0 0x7f59541e05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52182/0 (socket says 172.21.15.31:52182) 2024-04-15T00:21:31.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.811+0000 7f5953fff640 1 -- 172.21.15.31:0/2902956676 learned_addr learned my addr 172.21.15.31:0/2902956676 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:31.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.811+0000 7f5952ffd640 1 --2- 172.21.15.31:0/2902956676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59540b8be0 0x7f5954146000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:31.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.811+0000 7f59537fe640 1 --2- 172.21.15.31:0/2902956676 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59540b80d0 0x7f5954145880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:31.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.811+0000 7f5953fff640 1 -- 172.21.15.31:0/2902956676 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59540b80d0 msgr2=0x7f5954145880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:31.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.811+0000 7f5953fff640 1 --2- 172.21.15.31:0/2902956676 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59540b80d0 0x7f5954145880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:31.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.811+0000 7f5953fff640 1 -- 172.21.15.31:0/2902956676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59540b8be0 msgr2=0x7f5954146000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:31.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.811+0000 7f5953fff640 1 --2- 172.21.15.31:0/2902956676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59540b8be0 0x7f5954146000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:31.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.811+0000 7f5953fff640 1 -- 172.21.15.31:0/2902956676 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5954147a40 con 0x7f595414b4c0 2024-04-15T00:21:31.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.811+0000 7f59537fe640 1 --2- 172.21.15.31:0/2902956676 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59540b80d0 0x7f5954145880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:31.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.811+0000 7f5953fff640 1 --2- 172.21.15.31:0/2902956676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f595414b4c0 0x7f59541e05d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f594c007e40 tx=0x7f594c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:31.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.811+0000 7f593bfff640 1 -- 172.21.15.31:0/2902956676 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594c014620 con 0x7f595414b4c0 2024-04-15T00:21:31.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.811+0000 7f593bfff640 1 -- 172.21.15.31:0/2902956676 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f594c019070 con 0x7f595414b4c0 2024-04-15T00:21:31.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.811+0000 7f5959a9d640 1 -- 172.21.15.31:0/2902956676 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59540b4140 con 0x7f595414b4c0 2024-04-15T00:21:31.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.811+0000 7f593bfff640 1 -- 172.21.15.31:0/2902956676 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594c014a20 con 0x7f595414b4c0 2024-04-15T00:21:31.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.812+0000 7f5959a9d640 1 -- 172.21.15.31:0/2902956676 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5954147f90 con 0x7f595414b4c0 2024-04-15T00:21:31.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.812+0000 7f5959a9d640 1 -- 172.21.15.31:0/2902956676 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f595409f730 con 0x7f595414b4c0 2024-04-15T00:21:31.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.813+0000 7f593bfff640 1 -- 172.21.15.31:0/2902956676 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f594c014bc0 con 0x7f595414b4c0 2024-04-15T00:21:31.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.813+0000 7f593bfff640 1 --2- 172.21.15.31:0/2902956676 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f594006b990 0x7f594006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:31.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.813+0000 7f593bfff640 1 -- 172.21.15.31:0/2902956676 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f594c08b360 con 0x7f595414b4c0 2024-04-15T00:21:31.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.813+0000 7f59537fe640 1 --2- 172.21.15.31:0/2902956676 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f594006b990 0x7f594006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:31.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.814+0000 7f59537fe640 1 --2- 172.21.15.31:0/2902956676 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f594006b990 0x7f594006de50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5944000f60 tx=0x7f5944009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:31.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.818+0000 7f593bfff640 1 -- 172.21.15.31:0/2902956676 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f594c059cc0 con 0x7f595414b4c0 2024-04-15T00:21:32.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:31.999+0000 7f5959a9d640 1 -- 172.21.15.31:0/2902956676 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f595404f620 con 0x7f595414b4c0 2024-04-15T00:21:32.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.000+0000 7f593bfff640 1 -- 172.21.15.31:0/2902956676 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f594c0595c0 con 0x7f595414b4c0 2024-04-15T00:21:32.007 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-04-15T00:21:32.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.002+0000 7f5959a9d640 1 -- 172.21.15.31:0/2902956676 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f594006b990 msgr2=0x7f594006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:32.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.002+0000 7f5959a9d640 1 --2- 172.21.15.31:0/2902956676 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f594006b990 0x7f594006de50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5944000f60 tx=0x7f5944009040 comp rx=0 tx=0).stop 2024-04-15T00:21:32.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.002+0000 7f5959a9d640 1 -- 172.21.15.31:0/2902956676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f595414b4c0 msgr2=0x7f59541e05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:32.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.002+0000 7f5959a9d640 1 --2- 172.21.15.31:0/2902956676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f595414b4c0 0x7f59541e05d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f594c007e40 tx=0x7f594c00e4b0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.002+0000 7f5959a9d640 1 -- 172.21.15.31:0/2902956676 shutdown_connections 2024-04-15T00:21:32.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.002+0000 7f5959a9d640 1 --2- 172.21.15.31:0/2902956676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f595414b4c0 0x7f59541e05d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.002+0000 7f5959a9d640 1 --2- 172.21.15.31:0/2902956676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59540b8be0 0x7f5954146000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.002+0000 7f5959a9d640 1 --2- 172.21.15.31:0/2902956676 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f594006b990 0x7f594006de50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.002+0000 7f5959a9d640 1 --2- 172.21.15.31:0/2902956676 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f59540b80d0 0x7f5954145880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.002+0000 7f5959a9d640 1 -- 172.21.15.31:0/2902956676 >> 172.21.15.31:0/2902956676 conn(0x7f59540bd020 msgr2=0x7f59540bd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:32.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.002+0000 7f5959a9d640 1 -- 172.21.15.31:0/2902956676 shutdown_connections 2024-04-15T00:21:32.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.002+0000 7f5959a9d640 1 -- 172.21.15.31:0/2902956676 wait complete. 2024-04-15T00:21:32.020 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-15T00:21:32.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.117+0000 7fc5ac31e640 1 Processor -- start 2024-04-15T00:21:32.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.117+0000 7fc5ac31e640 1 -- start start 2024-04-15T00:21:32.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.117+0000 7fc5ac31e640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc5a4072750 0x7fc5a409bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:32.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.117+0000 7fc5ac31e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc5a409c4d0 0x7fc5a40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:32.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.117+0000 7fc5ac31e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc5a40b8ff0 0x7fc5a414ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:32.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.117+0000 7fc5ac31e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fc5a40b0580 con 0x7fc5a409c4d0 2024-04-15T00:21:32.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.117+0000 7fc5ac31e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc5a4072b30 con 0x7fc5a40b8ff0 2024-04-15T00:21:32.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.117+0000 7fc5ac31e640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fc5a40bad90 con 0x7fc5a4072750 2024-04-15T00:21:32.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.118+0000 7fc5a98b9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc5a409c4d0 0x7fc5a40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:32.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.118+0000 7fc5a98b9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc5a409c4d0 0x7fc5a40b8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52186/0 (socket says 172.21.15.31:52186) 2024-04-15T00:21:32.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.118+0000 7fc5a98b9640 1 -- 172.21.15.31:0/618373487 learned_addr learned my addr 172.21.15.31:0/618373487 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:32.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.118+0000 7fc5aa8bb640 1 --2- 172.21.15.31:0/618373487 >> v2:172.21.15.50:3300/0 conn(0x7fc5a40b8ff0 0x7fc5a414ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:32.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.118+0000 7fc5aa0ba640 1 --2- 172.21.15.31:0/618373487 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc5a4072750 0x7fc5a409bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:32.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.118+0000 7fc5a98b9640 1 -- 172.21.15.31:0/618373487 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc5a4072750 msgr2=0x7fc5a409bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:32.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.118+0000 7fc5a98b9640 1 --2- 172.21.15.31:0/618373487 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc5a4072750 0x7fc5a409bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.118+0000 7fc5a98b9640 1 -- 172.21.15.31:0/618373487 >> v2:172.21.15.50:3300/0 conn(0x7fc5a40b8ff0 msgr2=0x7fc5a414ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:32.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.118+0000 7fc5a98b9640 1 --2- 172.21.15.31:0/618373487 >> v2:172.21.15.50:3300/0 conn(0x7fc5a40b8ff0 0x7fc5a414ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.118+0000 7fc5a98b9640 1 -- 172.21.15.31:0/618373487 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a40bb070 con 0x7fc5a409c4d0 2024-04-15T00:21:32.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.118+0000 7fc5aa0ba640 1 --2- 172.21.15.31:0/618373487 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc5a4072750 0x7fc5a409bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:21:32.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.119+0000 7fc5a98b9640 1 --2- 172.21.15.31:0/618373487 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a409c4d0 0x7fc5a40b8ab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc5a40bbfd0 tx=0x7fc59402b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e9b6096db58984a server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:32.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.119+0000 7fc5a90b8640 1 -- 172.21.15.31:0/618373487 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5940317d0 con 0x7fc5a409c4d0 2024-04-15T00:21:32.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.119+0000 7fc5a90b8640 1 -- 172.21.15.31:0/618373487 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc594037070 con 0x7fc5a409c4d0 2024-04-15T00:21:32.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.119+0000 7fc5a90b8640 1 -- 172.21.15.31:0/618373487 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc594031b90 con 0x7fc5a409c4d0 2024-04-15T00:21:32.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.119+0000 7fc5ac31e640 1 -- 172.21.15.31:0/618373487 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a409c4d0 msgr2=0x7fc5a40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:32.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.119+0000 7fc5ac31e640 1 --2- 172.21.15.31:0/618373487 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a409c4d0 0x7fc5a40b8ab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc5a40bbfd0 tx=0x7fc59402b870 comp rx=0 tx=0).stop 2024-04-15T00:21:32.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.119+0000 7fc5ac31e640 1 -- 172.21.15.31:0/618373487 shutdown_connections 2024-04-15T00:21:32.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.119+0000 7fc5ac31e640 1 --2- 172.21.15.31:0/618373487 >> v2:172.21.15.50:3300/0 conn(0x7fc5a40b8ff0 0x7fc5a414ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.119+0000 7fc5ac31e640 1 --2- 172.21.15.31:0/618373487 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a409c4d0 0x7fc5a40b8ab0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.119+0000 7fc5ac31e640 1 --2- 172.21.15.31:0/618373487 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc5a4072750 0x7fc5a409bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.119+0000 7fc5ac31e640 1 -- 172.21.15.31:0/618373487 >> 172.21.15.31:0/618373487 conn(0x7fc5a40bcef0 msgr2=0x7fc5a40bd300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:32.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.119+0000 7fc5ac31e640 1 -- 172.21.15.31:0/618373487 shutdown_connections 2024-04-15T00:21:32.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.120+0000 7fc5ac31e640 1 -- 172.21.15.31:0/618373487 wait complete. 2024-04-15T00:21:32.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.120+0000 7fc5ac31e640 1 Processor -- start 2024-04-15T00:21:32.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.121+0000 7fc5ac31e640 1 -- start start 2024-04-15T00:21:32.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.121+0000 7fc5ac31e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5a4072750 0x7fc5a41e05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:32.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.121+0000 7fc5ac31e640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc5a409c4d0 0x7fc5a4142da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:32.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.121+0000 7fc5ac31e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a40b8ff0 0x7fc5a41432e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:32.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.121+0000 7fc5ac31e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a4074530 con 0x7fc5a40b8ff0 2024-04-15T00:21:32.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.121+0000 7fc5ac31e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a41478f0 con 0x7fc5a4072750 2024-04-15T00:21:32.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.121+0000 7fc5ac31e640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fc5a40b9470 con 0x7fc5a409c4d0 2024-04-15T00:21:32.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.121+0000 7fc5aa8bb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a40b8ff0 0x7fc5a41432e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:32.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.121+0000 7fc5aa8bb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a40b8ff0 0x7fc5a41432e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52196/0 (socket says 172.21.15.31:52196) 2024-04-15T00:21:32.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.121+0000 7fc5aa8bb640 1 -- 172.21.15.31:0/2212439805 learned_addr learned my addr 172.21.15.31:0/2212439805 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:32.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.121+0000 7fc5aa0ba640 1 --2- 172.21.15.31:0/2212439805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5a4072750 0x7fc5a41e05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:32.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.121+0000 7fc5a98b9640 1 --2- 172.21.15.31:0/2212439805 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc5a409c4d0 0x7fc5a4142da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:32.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.121+0000 7fc5aa8bb640 1 -- 172.21.15.31:0/2212439805 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc5a409c4d0 msgr2=0x7fc5a4142da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:32.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.121+0000 7fc5aa8bb640 1 --2- 172.21.15.31:0/2212439805 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc5a409c4d0 0x7fc5a4142da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.121+0000 7fc5aa8bb640 1 -- 172.21.15.31:0/2212439805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5a4072750 msgr2=0x7fc5a41e05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:32.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.121+0000 7fc5aa8bb640 1 --2- 172.21.15.31:0/2212439805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5a4072750 0x7fc5a41e05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.121+0000 7fc5aa8bb640 1 -- 172.21.15.31:0/2212439805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a41cfe90 con 0x7fc5a40b8ff0 2024-04-15T00:21:32.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.122+0000 7fc5aa0ba640 1 --2- 172.21.15.31:0/2212439805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5a4072750 0x7fc5a41e05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:32.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.122+0000 7fc5aa8bb640 1 --2- 172.21.15.31:0/2212439805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a40b8ff0 0x7fc5a41432e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc59c007e40 tx=0x7fc59c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:32.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.122+0000 7fc59affd640 1 -- 172.21.15.31:0/2212439805 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc59c014620 con 0x7fc5a40b8ff0 2024-04-15T00:21:32.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.122+0000 7fc59affd640 1 -- 172.21.15.31:0/2212439805 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc59c019070 con 0x7fc5a40b8ff0 2024-04-15T00:21:32.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.122+0000 7fc5ac31e640 1 -- 172.21.15.31:0/2212439805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5a41d0170 con 0x7fc5a40b8ff0 2024-04-15T00:21:32.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.122+0000 7fc59affd640 1 -- 172.21.15.31:0/2212439805 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc59c014a20 con 0x7fc5a40b8ff0 2024-04-15T00:21:32.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.122+0000 7fc5ac31e640 1 -- 172.21.15.31:0/2212439805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5a41cdb10 con 0x7fc5a40b8ff0 2024-04-15T00:21:32.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.123+0000 7fc5ac31e640 1 -- 172.21.15.31:0/2212439805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5a409d020 con 0x7fc5a40b8ff0 2024-04-15T00:21:32.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.123+0000 7fc59affd640 1 -- 172.21.15.31:0/2212439805 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc59c014bc0 con 0x7fc5a40b8ff0 2024-04-15T00:21:32.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.124+0000 7fc59affd640 1 --2- 172.21.15.31:0/2212439805 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc58806b990 0x7fc58806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:32.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.124+0000 7fc59affd640 1 -- 172.21.15.31:0/2212439805 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc59c08b380 con 0x7fc5a40b8ff0 2024-04-15T00:21:32.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.124+0000 7fc5aa0ba640 1 --2- 172.21.15.31:0/2212439805 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc58806b990 0x7fc58806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:32.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.124+0000 7fc5aa0ba640 1 --2- 172.21.15.31:0/2212439805 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc58806b990 0x7fc58806de50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc5a000a990 tx=0x7fc5a0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:32.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.128+0000 7fc59affd640 1 -- 172.21.15.31:0/2212439805 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc5a409d020 con 0x7fc5a40b8ff0 2024-04-15T00:21:32.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.309+0000 7fc5ac31e640 1 -- 172.21.15.31:0/2212439805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fc5a404f540 con 0x7fc5a40b8ff0 2024-04-15T00:21:32.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.309+0000 7fc59affd640 1 -- 172.21.15.31:0/2212439805 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7fc5a41cfe90 con 0x7fc5a40b8ff0 2024-04-15T00:21:32.317 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-15T00:21:32.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.312+0000 7fc5ac31e640 1 -- 172.21.15.31:0/2212439805 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc58806b990 msgr2=0x7fc58806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:32.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.312+0000 7fc5ac31e640 1 --2- 172.21.15.31:0/2212439805 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc58806b990 0x7fc58806de50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc5a000a990 tx=0x7fc5a0008040 comp rx=0 tx=0).stop 2024-04-15T00:21:32.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.312+0000 7fc5ac31e640 1 -- 172.21.15.31:0/2212439805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a40b8ff0 msgr2=0x7fc5a41432e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:32.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.312+0000 7fc5ac31e640 1 --2- 172.21.15.31:0/2212439805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a40b8ff0 0x7fc5a41432e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc59c007e40 tx=0x7fc59c00e4b0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.312+0000 7fc5ac31e640 1 -- 172.21.15.31:0/2212439805 shutdown_connections 2024-04-15T00:21:32.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.312+0000 7fc5ac31e640 1 --2- 172.21.15.31:0/2212439805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a40b8ff0 0x7fc5a41432e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.312+0000 7fc5ac31e640 1 --2- 172.21.15.31:0/2212439805 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc58806b990 0x7fc58806de50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.312+0000 7fc5ac31e640 1 --2- 172.21.15.31:0/2212439805 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc5a409c4d0 0x7fc5a4142da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.312+0000 7fc5ac31e640 1 --2- 172.21.15.31:0/2212439805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5a4072750 0x7fc5a41e05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.312+0000 7fc5ac31e640 1 -- 172.21.15.31:0/2212439805 >> 172.21.15.31:0/2212439805 conn(0x7fc5a40bcef0 msgr2=0x7fc5a409c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:32.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.312+0000 7fc5ac31e640 1 -- 172.21.15.31:0/2212439805 shutdown_connections 2024-04-15T00:21:32.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.312+0000 7fc5ac31e640 1 -- 172.21.15.31:0/2212439805 wait complete. 2024-04-15T00:21:32.330 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T00:21:32.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.424+0000 7fc03211e640 1 Processor -- start 2024-04-15T00:21:32.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.424+0000 7fc03211e640 1 -- start start 2024-04-15T00:21:32.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.424+0000 7fc03211e640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc02c0b56b0 0x7fc02c148080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:32.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.424+0000 7fc03211e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc02c0b6f30 0x7fc02c1520f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:32.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.424+0000 7fc03211e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc02c06cc20 con 0x7fc02c0b5a90 2024-04-15T00:21:32.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.424+0000 7fc03211e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fc02c147bf0 con 0x7fc02c0b6f30 2024-04-15T00:21:32.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.424+0000 7fc03211e640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fc02c06bcf0 con 0x7fc02c0b56b0 2024-04-15T00:21:32.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.424+0000 7fc02bfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc02c0b6f30 0x7fc02c1520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:32.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.424+0000 7fc02bfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc02c0b6f30 0x7fc02c1520f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52206/0 (socket says 172.21.15.31:52206) 2024-04-15T00:21:32.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.424+0000 7fc02bfff640 1 -- 172.21.15.31:0/3264285590 learned_addr learned my addr 172.21.15.31:0/3264285590 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:32.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.425+0000 7fc02b7fe640 1 --2- 172.21.15.31:0/3264285590 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc02c0b56b0 0x7fc02c148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:32.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.425+0000 7fc02bfff640 1 -- 172.21.15.31:0/3264285590 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc02c0b56b0 msgr2=0x7fc02c148080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:32.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.425+0000 7fc02bfff640 1 --2- 172.21.15.31:0/3264285590 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc02c0b56b0 0x7fc02c148080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.425+0000 7fc02bfff640 1 -- 172.21.15.31:0/3264285590 >> v1:172.21.15.50:6789/0 conn(0x7fc02c0b5a90 legacy=0x7fc02c0b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:32.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.425+0000 7fc02bfff640 1 -- 172.21.15.31:0/3264285590 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc02c147880 con 0x7fc02c0b6f30 2024-04-15T00:21:32.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.425+0000 7fc02bfff640 1 --2- 172.21.15.31:0/3264285590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc02c0b6f30 0x7fc02c1520f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc024009e50 tx=0x7fc02402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d134c0e67bd219 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:32.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.426+0000 7fc02a7fc640 1 -- 172.21.15.31:0/3264285590 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02402c9e0 con 0x7fc02c0b6f30 2024-04-15T00:21:32.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.426+0000 7fc02a7fc640 1 -- 172.21.15.31:0/3264285590 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc02402cb80 con 0x7fc02c0b6f30 2024-04-15T00:21:32.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.426+0000 7fc02a7fc640 1 -- 172.21.15.31:0/3264285590 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0240343f0 con 0x7fc02c0b6f30 2024-04-15T00:21:32.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.426+0000 7fc03211e640 1 -- 172.21.15.31:0/3264285590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc02c0b6f30 msgr2=0x7fc02c1520f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:32.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.426+0000 7fc03211e640 1 --2- 172.21.15.31:0/3264285590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc02c0b6f30 0x7fc02c1520f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc024009e50 tx=0x7fc02402be40 comp rx=0 tx=0).stop 2024-04-15T00:21:32.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.426+0000 7fc03211e640 1 -- 172.21.15.31:0/3264285590 shutdown_connections 2024-04-15T00:21:32.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.426+0000 7fc03211e640 1 --2- 172.21.15.31:0/3264285590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc02c0b6f30 0x7fc02c1520f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.426+0000 7fc03211e640 1 --2- 172.21.15.31:0/3264285590 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc02c0b56b0 0x7fc02c148080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.426+0000 7fc03211e640 1 -- 172.21.15.31:0/3264285590 >> 172.21.15.31:0/3264285590 conn(0x7fc02c0b77b0 msgr2=0x7fc02c0b7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:32.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.426+0000 7fc03211e640 1 -- 172.21.15.31:0/3264285590 shutdown_connections 2024-04-15T00:21:32.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.426+0000 7fc03211e640 1 -- 172.21.15.31:0/3264285590 wait complete. 2024-04-15T00:21:32.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.427+0000 7fc03211e640 1 Processor -- start 2024-04-15T00:21:32.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.427+0000 7fc03211e640 1 -- start start 2024-04-15T00:21:32.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.428+0000 7fc03211e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc02c0b56b0 0x7fc02c14b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:32.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.428+0000 7fc03211e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc02c0b5a90 0x7fc02c148f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:32.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.428+0000 7fc03211e640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc02c0b6f30 0x7fc02c13ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:32.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.428+0000 7fc03211e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c0b6240 con 0x7fc02c0b56b0 2024-04-15T00:21:32.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.428+0000 7fc03211e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c0b60c0 con 0x7fc02c0b5a90 2024-04-15T00:21:32.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.428+0000 7fc03211e640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fc02c06d050 con 0x7fc02c0b6f30 2024-04-15T00:21:32.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.428+0000 7fc02b7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc02c0b56b0 0x7fc02c14b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:32.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.428+0000 7fc02b7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc02c0b56b0 0x7fc02c14b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52214/0 (socket says 172.21.15.31:52214) 2024-04-15T00:21:32.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.428+0000 7fc02b7fe640 1 -- 172.21.15.31:0/1362523187 learned_addr learned my addr 172.21.15.31:0/1362523187 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:32.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.428+0000 7fc02affd640 1 --2- 172.21.15.31:0/1362523187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc02c0b5a90 0x7fc02c148f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:32.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.428+0000 7fc02bfff640 1 --2- 172.21.15.31:0/1362523187 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc02c0b6f30 0x7fc02c13ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:32.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.428+0000 7fc02b7fe640 1 -- 172.21.15.31:0/1362523187 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc02c0b6f30 msgr2=0x7fc02c13ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:32.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.428+0000 7fc02b7fe640 1 --2- 172.21.15.31:0/1362523187 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc02c0b6f30 0x7fc02c13ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.428+0000 7fc02b7fe640 1 -- 172.21.15.31:0/1362523187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc02c0b5a90 msgr2=0x7fc02c148f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:32.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.428+0000 7fc02b7fe640 1 --2- 172.21.15.31:0/1362523187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc02c0b5a90 0x7fc02c148f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.428+0000 7fc02b7fe640 1 -- 172.21.15.31:0/1362523187 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc02c14ab10 con 0x7fc02c0b56b0 2024-04-15T00:21:32.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.429+0000 7fc02b7fe640 1 --2- 172.21.15.31:0/1362523187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc02c0b56b0 0x7fc02c14b580 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc01c00d620 tx=0x7fc01c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:32.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.429+0000 7fc013fff640 1 -- 172.21.15.31:0/1362523187 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01c00b620 con 0x7fc02c0b56b0 2024-04-15T00:21:32.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.429+0000 7fc013fff640 1 -- 172.21.15.31:0/1362523187 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc01c019070 con 0x7fc02c0b56b0 2024-04-15T00:21:32.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.429+0000 7fc03211e640 1 -- 172.21.15.31:0/1362523187 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc02c14adf0 con 0x7fc02c0b56b0 2024-04-15T00:21:32.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.429+0000 7fc013fff640 1 -- 172.21.15.31:0/1362523187 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01c00ba00 con 0x7fc02c0b56b0 2024-04-15T00:21:32.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.429+0000 7fc03211e640 1 -- 172.21.15.31:0/1362523187 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc02c144aa0 con 0x7fc02c0b56b0 2024-04-15T00:21:32.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.430+0000 7fc03211e640 1 -- 172.21.15.31:0/1362523187 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc02c14bc00 con 0x7fc02c0b56b0 2024-04-15T00:21:32.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.430+0000 7fc013fff640 1 -- 172.21.15.31:0/1362523187 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc01c00bba0 con 0x7fc02c0b56b0 2024-04-15T00:21:32.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.430+0000 7fc013fff640 1 --2- 172.21.15.31:0/1362523187 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc01806b9c0 0x7fc01806de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:32.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.431+0000 7fc013fff640 1 -- 172.21.15.31:0/1362523187 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc01c08aec0 con 0x7fc02c0b56b0 2024-04-15T00:21:32.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.431+0000 7fc02affd640 1 --2- 172.21.15.31:0/1362523187 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc01806b9c0 0x7fc01806de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:32.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.431+0000 7fc02affd640 1 --2- 172.21.15.31:0/1362523187 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc01806b9c0 0x7fc01806de80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc02c144440 tx=0x7fc020009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:32.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.435+0000 7fc013fff640 1 -- 172.21.15.31:0/1362523187 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc01c059820 con 0x7fc02c0b56b0 2024-04-15T00:21:32.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.657+0000 7fc03211e640 1 -- 172.21.15.31:0/1362523187 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc02c1483a0 con 0x7fc02c0b56b0 2024-04-15T00:21:32.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.657+0000 7fc013fff640 1 -- 172.21.15.31:0/1362523187 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3520 (secure 0 0 0) 0x7fc01c059120 con 0x7fc02c0b56b0 2024-04-15T00:21:32.665 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:21:32.665 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/921487249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":921487249},{"type":"v1","addr":"172.21.15.50:6833","nonce":921487249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T00:21:07.925196+0000","modified":"2024-04-15T00:21:23.993707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/93464605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":93464605},{"type":"v1","addr":"172.21.15.31:6835","nonce":93464605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-04-15T00:21:32.665 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-04-15T00:21:32.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.659+0000 7fc03211e640 1 -- 172.21.15.31:0/1362523187 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc01806b9c0 msgr2=0x7fc01806de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:32.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.659+0000 7fc03211e640 1 --2- 172.21.15.31:0/1362523187 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc01806b9c0 0x7fc01806de80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc02c144440 tx=0x7fc020009040 comp rx=0 tx=0).stop 2024-04-15T00:21:32.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.659+0000 7fc03211e640 1 -- 172.21.15.31:0/1362523187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc02c0b56b0 msgr2=0x7fc02c14b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:32.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.659+0000 7fc03211e640 1 --2- 172.21.15.31:0/1362523187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc02c0b56b0 0x7fc02c14b580 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc01c00d620 tx=0x7fc01c00dae0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.659+0000 7fc03211e640 1 -- 172.21.15.31:0/1362523187 shutdown_connections 2024-04-15T00:21:32.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.659+0000 7fc03211e640 1 --2- 172.21.15.31:0/1362523187 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc01806b9c0 0x7fc01806de80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.659+0000 7fc03211e640 1 --2- 172.21.15.31:0/1362523187 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc02c0b6f30 0x7fc02c13ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.659+0000 7fc03211e640 1 --2- 172.21.15.31:0/1362523187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc02c0b5a90 0x7fc02c148f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.659+0000 7fc03211e640 1 --2- 172.21.15.31:0/1362523187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc02c0b56b0 0x7fc02c14b580 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.659+0000 7fc03211e640 1 -- 172.21.15.31:0/1362523187 >> 172.21.15.31:0/1362523187 conn(0x7fc02c0b77b0 msgr2=0x7fc02c1467f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:32.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.659+0000 7fc03211e640 1 -- 172.21.15.31:0/1362523187 shutdown_connections 2024-04-15T00:21:32.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.659+0000 7fc03211e640 1 -- 172.21.15.31:0/1362523187 wait complete. 2024-04-15T00:21:32.678 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:21:32.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.772+0000 7f0341c36640 1 Processor -- start 2024-04-15T00:21:32.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.772+0000 7f0341c36640 1 -- start start 2024-04-15T00:21:32.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.772+0000 7f0341c36640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f033c06e1d0 0x7f033c0b1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:32.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.772+0000 7f0341c36640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f033c072a70 con 0x7f033c072690 2024-04-15T00:21:32.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.772+0000 7f0341c36640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f033c0b6c90 con 0x7f033c0b6800 2024-04-15T00:21:32.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.773+0000 7f0341c36640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f033c06ebe0 con 0x7f033c06e1d0 2024-04-15T00:21:32.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.773+0000 7f033affd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f033c06e1d0 0x7f033c0b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:32.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.773+0000 7f033b7fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f033c072690 0x7f033c09fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55486/0 (socket says 172.21.15.31:55486) 2024-04-15T00:21:32.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.773+0000 7f033b7fe640 1 -- 172.21.15.31:0/2143544666 learned_addr learned my addr 172.21.15.31:0/2143544666 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:32.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.773+0000 7f033affd640 1 -- 172.21.15.31:0/2143544666 >> v1:172.21.15.50:6789/0 conn(0x7f033c0b6800 legacy=0x7f033c14fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:32.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.773+0000 7f033affd640 1 -- 172.21.15.31:0/2143544666 >> v1:172.21.15.31:6789/0 conn(0x7f033c072690 legacy=0x7f033c09fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:32.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.773+0000 7f033affd640 1 -- 172.21.15.31:0/2143544666 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033c06eec0 con 0x7f033c06e1d0 2024-04-15T00:21:32.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.774+0000 7f033affd640 1 --2- 172.21.15.31:0/2143544666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f033c06e1d0 0x7f033c0b1770 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f03300097a0 tx=0x7f033002b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34d8c4ba3388925 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:32.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.774+0000 7f033a7fc640 1 -- 172.21.15.31:0/2143544666 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0330037070 con 0x7f033c06e1d0 2024-04-15T00:21:32.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.774+0000 7f033a7fc640 1 -- 172.21.15.31:0/2143544666 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0330030710 con 0x7f033c06e1d0 2024-04-15T00:21:32.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.774+0000 7f033a7fc640 1 -- 172.21.15.31:0/2143544666 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0330030ae0 con 0x7f033c06e1d0 2024-04-15T00:21:32.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.774+0000 7f0341c36640 1 -- 172.21.15.31:0/2143544666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f033c06e1d0 msgr2=0x7f033c0b1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:32.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.774+0000 7f0341c36640 1 --2- 172.21.15.31:0/2143544666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f033c06e1d0 0x7f033c0b1770 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f03300097a0 tx=0x7f033002b680 comp rx=0 tx=0).stop 2024-04-15T00:21:32.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.774+0000 7f0341c36640 1 -- 172.21.15.31:0/2143544666 shutdown_connections 2024-04-15T00:21:32.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.774+0000 7f0341c36640 1 --2- 172.21.15.31:0/2143544666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f033c06e1d0 0x7f033c0b1770 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.774+0000 7f0341c36640 1 -- 172.21.15.31:0/2143544666 >> 172.21.15.31:0/2143544666 conn(0x7f033c0b7840 msgr2=0x7f033c0b7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:32.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.774+0000 7f0341c36640 1 -- 172.21.15.31:0/2143544666 shutdown_connections 2024-04-15T00:21:32.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.774+0000 7f0341c36640 1 -- 172.21.15.31:0/2143544666 wait complete. 2024-04-15T00:21:32.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.775+0000 7f0341c36640 1 Processor -- start 2024-04-15T00:21:32.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.776+0000 7f0341c36640 1 -- start start 2024-04-15T00:21:32.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.776+0000 7f0341c36640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f033c06e1d0 0x7f033c09f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:32.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.776+0000 7f0341c36640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f033c072690 0x7f033c1e08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:32.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.776+0000 7f0341c36640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f033c13aef0 0x7f033c1e0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:32.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.776+0000 7f0341c36640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f033c0b75d0 con 0x7f033c072690 2024-04-15T00:21:32.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.776+0000 7f0341c36640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f033c0b7450 con 0x7f033c13aef0 2024-04-15T00:21:32.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.776+0000 7f0341c36640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f033c0b1cb0 con 0x7f033c06e1d0 2024-04-15T00:21:32.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.776+0000 7f033affd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f033c072690 0x7f033c1e08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:32.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.776+0000 7f033affd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f033c072690 0x7f033c1e08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35698/0 (socket says 172.21.15.31:35698) 2024-04-15T00:21:32.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.776+0000 7f033affd640 1 -- 172.21.15.31:0/985142999 learned_addr learned my addr 172.21.15.31:0/985142999 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:32.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.776+0000 7f033bfff640 1 --2- 172.21.15.31:0/985142999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f033c13aef0 0x7f033c1e0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:32.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.776+0000 7f033b7fe640 1 --2- 172.21.15.31:0/985142999 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f033c06e1d0 0x7f033c09f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:32.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.777+0000 7f033affd640 1 -- 172.21.15.31:0/985142999 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f033c06e1d0 msgr2=0x7f033c09f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:32.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.777+0000 7f033affd640 1 --2- 172.21.15.31:0/985142999 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f033c06e1d0 0x7f033c09f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.777+0000 7f033affd640 1 -- 172.21.15.31:0/985142999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f033c13aef0 msgr2=0x7f033c1e0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:32.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.777+0000 7f033affd640 1 --2- 172.21.15.31:0/985142999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f033c13aef0 0x7f033c1e0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.777+0000 7f033affd640 1 -- 172.21.15.31:0/985142999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033c13b3d0 con 0x7f033c072690 2024-04-15T00:21:32.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.777+0000 7f033bfff640 1 --2- 172.21.15.31:0/985142999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f033c13aef0 0x7f033c1e0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:32.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.777+0000 7f033affd640 1 --2- 172.21.15.31:0/985142999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f033c072690 0x7f033c1e08c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f03300098c0 tx=0x7f03300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:32.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.777+0000 7f0323fff640 1 -- 172.21.15.31:0/985142999 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0330042070 con 0x7f033c072690 2024-04-15T00:21:32.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.777+0000 7f0323fff640 1 -- 172.21.15.31:0/985142999 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0330032a40 con 0x7f033c072690 2024-04-15T00:21:32.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.777+0000 7f0341c36640 1 -- 172.21.15.31:0/985142999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f033c13b6b0 con 0x7f033c072690 2024-04-15T00:21:32.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.777+0000 7f0323fff640 1 -- 172.21.15.31:0/985142999 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0330037040 con 0x7f033c072690 2024-04-15T00:21:32.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.777+0000 7f0341c36640 1 -- 172.21.15.31:0/985142999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f033c13a540 con 0x7f033c072690 2024-04-15T00:21:32.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.778+0000 7f0341c36640 1 -- 172.21.15.31:0/985142999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f033c04f620 con 0x7f033c072690 2024-04-15T00:21:32.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.778+0000 7f0323fff640 1 -- 172.21.15.31:0/985142999 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f0330045070 con 0x7f033c072690 2024-04-15T00:21:32.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.779+0000 7f0323fff640 1 --2- 172.21.15.31:0/985142999 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f032806b990 0x7f032806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:32.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.779+0000 7f033b7fe640 1 --2- 172.21.15.31:0/985142999 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f032806b990 0x7f032806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:32.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.779+0000 7f0323fff640 1 -- 172.21.15.31:0/985142999 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f03300ac9c0 con 0x7f033c072690 2024-04-15T00:21:32.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.779+0000 7f033b7fe640 1 --2- 172.21.15.31:0/985142999 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f032806b990 0x7f032806de50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f033c148870 tx=0x7f032c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:32.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.783+0000 7f0323fff640 1 -- 172.21.15.31:0/985142999 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f03300aee20 con 0x7f033c072690 2024-04-15T00:21:32.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.964+0000 7f0341c36640 1 -- 172.21.15.31:0/985142999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f033c04f620 con 0x7f033c072690 2024-04-15T00:21:32.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.965+0000 7f0323fff640 1 -- 172.21.15.31:0/985142999 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7f033007b2a0 con 0x7f033c072690 2024-04-15T00:21:32.973 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:21:32.973 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"fsid":"b57c03ab-2810-4ea5-b233-6164468328c0","created":"2024-04-15T00:20:44.073217+0000","modified":"2024-04-15T00:21:12.971956+0000","last_up_change":"2024-04-15T00:20:55.515596+0000","last_in_change":"2024-04-15T00:20:46.364541+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:20:56.423161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:21:06.436169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:21:06.888505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:21:10.610300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b085a2f4-5565-4ccc-a98e-e56180791550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6817","nonce":2355720818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6819","nonce":2355720818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6823","nonce":2355720818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6821","nonce":2355720818}]},"public_addr":"172.21.15.31:6817/2355720818","cluster_addr":"172.21.15.31:6819/2355720818","heartbeat_back_addr":"172.21.15.31:6823/2355720818","heartbeat_front_addr":"172.21.15.31:6821/2355720818","state":["exists","up"]},{"osd":1,"uuid":"0f751557-3f18-464f-8b78-614d19549f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6809","nonce":2705297130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6811","nonce":2705297130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6815","nonce":2705297130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6813","nonce":2705297130}]},"public_addr":"172.21.15.31:6809/2705297130","cluster_addr":"172.21.15.31:6811/2705297130","heartbeat_back_addr":"172.21.15.31:6815/2705297130","heartbeat_front_addr":"172.21.15.31:6813/2705297130","state":["exists","up"]},{"osd":2,"uuid":"17371b09-2bd7-4ef7-926f-e7706319f064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6801","nonce":225061474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6803","nonce":225061474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6807","nonce":225061474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6805","nonce":225061474}]},"public_addr":"172.21.15.31:6801/225061474","cluster_addr":"172.21.15.31:6803/225061474","heartbeat_back_addr":"172.21.15.31:6807/225061474","heartbeat_front_addr":"172.21.15.31:6805/225061474","state":["exists","up"]},{"osd":3,"uuid":"315b6949-f009-4291-9581-aa4912642dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6825","nonce":3722449780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6827","nonce":3722449780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6831","nonce":3722449780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6829","nonce":3722449780}]},"public_addr":"172.21.15.31:6825/3722449780","cluster_addr":"172.21.15.31:6827/3722449780","heartbeat_back_addr":"172.21.15.31:6831/3722449780","heartbeat_front_addr":"172.21.15.31:6829/3722449780","state":["exists","up"]},{"osd":4,"uuid":"e3659369-cc78-4aa8-bd10-a199d4a1569d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6801","nonce":1279970071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6803","nonce":1279970071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6807","nonce":1279970071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6805","nonce":1279970071}]},"public_addr":"172.21.15.50:6801/1279970071","cluster_addr":"172.21.15.50:6803/1279970071","heartbeat_back_addr":"172.21.15.50:6807/1279970071","heartbeat_front_addr":"172.21.15.50:6805/1279970071","state":["exists","up"]},{"osd":5,"uuid":"35c3a4c0-0b45-45d2-85b9-301c347602f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6809","nonce":1589417182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6811","nonce":1589417182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6815","nonce":1589417182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6813","nonce":1589417182}]},"public_addr":"172.21.15.50:6809/1589417182","cluster_addr":"172.21.15.50:6811/1589417182","heartbeat_back_addr":"172.21.15.50:6815/1589417182","heartbeat_front_addr":"172.21.15.50:6813/1589417182","state":["exists","up"]},{"osd":6,"uuid":"20df7a76-245f-4946-9624-6ca9e949227b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6817","nonce":682288274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6819","nonce":682288274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6823","nonce":682288274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6821","nonce":682288274}]},"public_addr":"172.21.15.50:6817/682288274","cluster_addr":"172.21.15.50:6819/682288274","heartbeat_back_addr":"172.21.15.50:6823/682288274","heartbeat_front_addr":"172.21.15.50:6821/682288274","state":["exists","up"]},{"osd":7,"uuid":"95a504b7-e13a-49e6-8484-9dff4d5fc048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6825","nonce":4129060906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6827","nonce":4129060906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6831","nonce":4129060906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6829","nonce":4129060906}]},"public_addr":"172.21.15.50:6825/4129060906","cluster_addr":"172.21.15.50:6827/4129060906","heartbeat_back_addr":"172.21.15.50:6831/4129060906","heartbeat_front_addr":"172.21.15.50:6829/4129060906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.501980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.529961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.540913+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.521396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.448364+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.514136+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.527229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.508950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:21:32.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.967+0000 7f0341c36640 1 -- 172.21.15.31:0/985142999 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f032806b990 msgr2=0x7f032806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:32.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.967+0000 7f0341c36640 1 --2- 172.21.15.31:0/985142999 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f032806b990 0x7f032806de50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f033c148870 tx=0x7f032c009040 comp rx=0 tx=0).stop 2024-04-15T00:21:32.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.967+0000 7f0341c36640 1 -- 172.21.15.31:0/985142999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f033c072690 msgr2=0x7f033c1e08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:32.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.967+0000 7f0341c36640 1 --2- 172.21.15.31:0/985142999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f033c072690 0x7f033c1e08c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f03300098c0 tx=0x7f03300046c0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.967+0000 7f0341c36640 1 -- 172.21.15.31:0/985142999 shutdown_connections 2024-04-15T00:21:32.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.967+0000 7f0341c36640 1 --2- 172.21.15.31:0/985142999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f033c13aef0 0x7f033c1e0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.967+0000 7f0341c36640 1 --2- 172.21.15.31:0/985142999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f033c072690 0x7f033c1e08c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.967+0000 7f0341c36640 1 --2- 172.21.15.31:0/985142999 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f032806b990 0x7f032806de50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.967+0000 7f0341c36640 1 --2- 172.21.15.31:0/985142999 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f033c06e1d0 0x7f033c09f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:32.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.967+0000 7f0341c36640 1 -- 172.21.15.31:0/985142999 >> 172.21.15.31:0/985142999 conn(0x7f033c0b7840 msgr2=0x7f033c0b9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:32.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.967+0000 7f0341c36640 1 -- 172.21.15.31:0/985142999 shutdown_connections 2024-04-15T00:21:32.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:32.967+0000 7f0341c36640 1 -- 172.21.15.31:0/985142999 wait complete. 2024-04-15T00:21:32.986 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T00:20:56.423161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T00:21:06.436169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T00:21:06.888505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-15T00:21:10.610300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-15T00:21:32.986 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T00:21:33.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.083+0000 7f9ff5fc8640 1 Processor -- start 2024-04-15T00:21:33.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.083+0000 7f9ff5fc8640 1 -- start start 2024-04-15T00:21:33.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.084+0000 7f9ff5fc8640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ff00b56b0 0x7f9ff0148080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:33.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.084+0000 7f9ff5fc8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9ff00b5a90 0x7f9ff00b6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:33.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.084+0000 7f9ff5fc8640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ff006cc20 con 0x7f9ff006c6d0 2024-04-15T00:21:33.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.084+0000 7f9ff5fc8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f9ff0147bf0 con 0x7f9ff00b5a90 2024-04-15T00:21:33.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.084+0000 7f9ff5fc8640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f9ff006bcf0 con 0x7f9ff00b56b0 2024-04-15T00:21:33.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.084+0000 7f9feeffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9ff00b5a90 0x7f9ff00b6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:33.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.084+0000 7f9feeffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9ff00b5a90 0x7f9ff00b6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35706/0 (socket says 172.21.15.31:35706) 2024-04-15T00:21:33.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.084+0000 7f9feffff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9ff006c6d0 0x7f9ff014ad60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55496/0 (socket says 172.21.15.31:55496) 2024-04-15T00:21:33.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.084+0000 7f9feeffd640 1 -- 172.21.15.31:0/3827703991 learned_addr learned my addr 172.21.15.31:0/3827703991 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:33.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.084+0000 7f9fef7fe640 1 --2- 172.21.15.31:0/3827703991 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ff00b56b0 0x7f9ff0148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:33.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.084+0000 7f9feeffd640 1 -- 172.21.15.31:0/3827703991 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ff00b56b0 msgr2=0x7f9ff0148080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:33.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.084+0000 7f9feeffd640 1 --2- 172.21.15.31:0/3827703991 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ff00b56b0 0x7f9ff0148080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:33.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.084+0000 7f9feeffd640 1 -- 172.21.15.31:0/3827703991 >> v1:172.21.15.31:6789/0 conn(0x7f9ff006c6d0 legacy=0x7f9ff014ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:33.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.084+0000 7f9feeffd640 1 -- 172.21.15.31:0/3827703991 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff0147880 con 0x7f9ff00b5a90 2024-04-15T00:21:33.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.084+0000 7f9fee7fc640 1 -- 172.21.15.31:0/3827703991 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2621944878 0 0) 0x7f9ff006cc20 con 0x7f9ff006c6d0 2024-04-15T00:21:33.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.084+0000 7f9fef7fe640 1 --2- 172.21.15.31:0/3827703991 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ff00b56b0 0x7f9ff0148080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:33.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.085+0000 7f9feeffd640 1 --2- 172.21.15.31:0/3827703991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ff00b5a90 0x7f9ff00b6820 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4009870 tx=0x7f9fe402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f12e514a6b15f31 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:33.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.085+0000 7f9fee7fc640 1 -- 172.21.15.31:0/3827703991 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe40317c0 con 0x7f9ff00b5a90 2024-04-15T00:21:33.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.085+0000 7f9fee7fc640 1 -- 172.21.15.31:0/3827703991 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fe4037070 con 0x7f9ff00b5a90 2024-04-15T00:21:33.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.085+0000 7f9fee7fc640 1 -- 172.21.15.31:0/3827703991 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4031b80 con 0x7f9ff00b5a90 2024-04-15T00:21:33.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.086+0000 7f9ff5fc8640 1 -- 172.21.15.31:0/3827703991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ff00b5a90 msgr2=0x7f9ff00b6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:33.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.086+0000 7f9ff5fc8640 1 --2- 172.21.15.31:0/3827703991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ff00b5a90 0x7f9ff00b6820 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4009870 tx=0x7f9fe402b860 comp rx=0 tx=0).stop 2024-04-15T00:21:33.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.086+0000 7f9ff5fc8640 1 -- 172.21.15.31:0/3827703991 shutdown_connections 2024-04-15T00:21:33.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.086+0000 7f9ff5fc8640 1 --2- 172.21.15.31:0/3827703991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ff00b5a90 0x7f9ff00b6820 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:33.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.086+0000 7f9ff5fc8640 1 --2- 172.21.15.31:0/3827703991 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ff00b56b0 0x7f9ff0148080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:33.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.086+0000 7f9ff5fc8640 1 -- 172.21.15.31:0/3827703991 >> 172.21.15.31:0/3827703991 conn(0x7f9ff00b77b0 msgr2=0x7f9ff00b7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:33.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.086+0000 7f9ff5fc8640 1 -- 172.21.15.31:0/3827703991 shutdown_connections 2024-04-15T00:21:33.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.086+0000 7f9ff5fc8640 1 -- 172.21.15.31:0/3827703991 wait complete. 2024-04-15T00:21:33.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.087+0000 7f9ff5fc8640 1 Processor -- start 2024-04-15T00:21:33.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.087+0000 7f9ff5fc8640 1 -- start start 2024-04-15T00:21:33.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.087+0000 7f9ff5fc8640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ff006c6d0 0x7f9ff00b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:33.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.087+0000 7f9ff5fc8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ff00b56b0 0x7f9ff00b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:33.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.087+0000 7f9ff5fc8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ff00b5a90 0x7f9ff00b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:33.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.087+0000 7f9ff5fc8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff00b6240 con 0x7f9ff00b56b0 2024-04-15T00:21:33.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.087+0000 7f9ff5fc8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff00b60c0 con 0x7f9ff00b5a90 2024-04-15T00:21:33.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.087+0000 7f9ff5fc8640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f9ff006d050 con 0x7f9ff006c6d0 2024-04-15T00:21:33.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.088+0000 7f9feeffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ff00b56b0 0x7f9ff00b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:33.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.088+0000 7f9feeffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ff00b56b0 0x7f9ff00b28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35712/0 (socket says 172.21.15.31:35712) 2024-04-15T00:21:33.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.088+0000 7f9feeffd640 1 -- 172.21.15.31:0/2257162931 learned_addr learned my addr 172.21.15.31:0/2257162931 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:33.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.088+0000 7f9feffff640 1 --2- 172.21.15.31:0/2257162931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ff00b5a90 0x7f9ff00b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:33.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.088+0000 7f9fef7fe640 1 --2- 172.21.15.31:0/2257162931 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ff006c6d0 0x7f9ff00b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:33.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.088+0000 7f9feeffd640 1 -- 172.21.15.31:0/2257162931 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ff006c6d0 msgr2=0x7f9ff00b4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:33.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.088+0000 7f9feeffd640 1 --2- 172.21.15.31:0/2257162931 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ff006c6d0 0x7f9ff00b4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:33.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.088+0000 7f9feeffd640 1 -- 172.21.15.31:0/2257162931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ff00b5a90 msgr2=0x7f9ff00b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:33.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.088+0000 7f9feeffd640 1 --2- 172.21.15.31:0/2257162931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ff00b5a90 0x7f9ff00b2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:33.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.088+0000 7f9feeffd640 1 -- 172.21.15.31:0/2257162931 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff00b4500 con 0x7f9ff00b56b0 2024-04-15T00:21:33.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.088+0000 7f9fef7fe640 1 --2- 172.21.15.31:0/2257162931 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ff006c6d0 0x7f9ff00b4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:33.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.088+0000 7f9feeffd640 1 --2- 172.21.15.31:0/2257162931 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ff00b56b0 0x7f9ff00b28d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9fe40090b0 tx=0x7f9fe40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:33.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.088+0000 7f9fd7fff640 1 -- 172.21.15.31:0/2257162931 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4032860 con 0x7f9ff00b56b0 2024-04-15T00:21:33.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.088+0000 7f9fd7fff640 1 -- 172.21.15.31:0/2257162931 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fe4032a40 con 0x7f9ff00b56b0 2024-04-15T00:21:33.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.088+0000 7f9ff5fc8640 1 -- 172.21.15.31:0/2257162931 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ff00b4220 con 0x7f9ff00b56b0 2024-04-15T00:21:33.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.088+0000 7f9fd7fff640 1 -- 172.21.15.31:0/2257162931 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4032e30 con 0x7f9ff00b56b0 2024-04-15T00:21:33.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.088+0000 7f9ff5fc8640 1 -- 172.21.15.31:0/2257162931 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ff0144920 con 0x7f9ff00b56b0 2024-04-15T00:21:33.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.089+0000 7f9ff5fc8640 1 -- 172.21.15.31:0/2257162931 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ff004f620 con 0x7f9ff00b56b0 2024-04-15T00:21:33.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.090+0000 7f9fd7fff640 1 -- 172.21.15.31:0/2257162931 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f9fe404c060 con 0x7f9ff00b56b0 2024-04-15T00:21:33.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.090+0000 7f9fd7fff640 1 --2- 172.21.15.31:0/2257162931 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f9fdc06b9c0 0x7f9fdc06de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:33.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.090+0000 7f9fef7fe640 1 --2- 172.21.15.31:0/2257162931 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f9fdc06b9c0 0x7f9fdc06de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:33.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.090+0000 7f9fd7fff640 1 -- 172.21.15.31:0/2257162931 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9fe40ac670 con 0x7f9ff00b56b0 2024-04-15T00:21:33.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.091+0000 7f9fef7fe640 1 --2- 172.21.15.31:0/2257162931 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f9fdc06b9c0 0x7f9fdc06de80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0006fd0 tx=0x7f9fe0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:33.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.094+0000 7f9fd7fff640 1 -- 172.21.15.31:0/2257162931 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9ff00b4500 con 0x7f9ff00b56b0 2024-04-15T00:21:33.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.273+0000 7f9ff5fc8640 1 -- 172.21.15.31:0/2257162931 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9ff01474c0 con 0x7f9ff00b56b0 2024-04-15T00:21:33.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.273+0000 7f9fd7fff640 1 -- 172.21.15.31:0/2257162931 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f9fe4040070 con 0x7f9ff00b56b0 2024-04-15T00:21:33.281 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-15T00:21:33.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.275+0000 7f9ff5fc8640 1 -- 172.21.15.31:0/2257162931 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f9fdc06b9c0 msgr2=0x7f9fdc06de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:33.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.275+0000 7f9ff5fc8640 1 --2- 172.21.15.31:0/2257162931 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f9fdc06b9c0 0x7f9fdc06de80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0006fd0 tx=0x7f9fe0008040 comp rx=0 tx=0).stop 2024-04-15T00:21:33.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.275+0000 7f9ff5fc8640 1 -- 172.21.15.31:0/2257162931 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ff00b56b0 msgr2=0x7f9ff00b28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:33.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.275+0000 7f9ff5fc8640 1 --2- 172.21.15.31:0/2257162931 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ff00b56b0 0x7f9ff00b28d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9fe40090b0 tx=0x7f9fe40046c0 comp rx=0 tx=0).stop 2024-04-15T00:21:33.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.275+0000 7f9ff5fc8640 1 -- 172.21.15.31:0/2257162931 shutdown_connections 2024-04-15T00:21:33.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.275+0000 7f9ff5fc8640 1 --2- 172.21.15.31:0/2257162931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ff00b5a90 0x7f9ff00b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:33.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.275+0000 7f9ff5fc8640 1 --2- 172.21.15.31:0/2257162931 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ff00b56b0 0x7f9ff00b28d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:33.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.275+0000 7f9ff5fc8640 1 --2- 172.21.15.31:0/2257162931 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f9fdc06b9c0 0x7f9fdc06de80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:33.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.275+0000 7f9ff5fc8640 1 --2- 172.21.15.31:0/2257162931 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f9ff006c6d0 0x7f9ff00b4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:33.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.275+0000 7f9ff5fc8640 1 -- 172.21.15.31:0/2257162931 >> 172.21.15.31:0/2257162931 conn(0x7f9ff00b77b0 msgr2=0x7f9ff013faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:33.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.275+0000 7f9ff5fc8640 1 -- 172.21.15.31:0/2257162931 shutdown_connections 2024-04-15T00:21:33.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.275+0000 7f9ff5fc8640 1 -- 172.21.15.31:0/2257162931 wait complete. 2024-04-15T00:21:33.293 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T00:21:33.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.390+0000 7fde31608640 1 Processor -- start 2024-04-15T00:21:33.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.390+0000 7fde31608640 1 -- start start 2024-04-15T00:21:33.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.391+0000 7fde31608640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde2c072660 0x7fde2c14ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:33.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.391+0000 7fde31608640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fde2c147f60 0x7fde2c141840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:33.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.391+0000 7fde31608640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde2c06e7d0 con 0x7fde2c1413c0 2024-04-15T00:21:33.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.391+0000 7fde31608640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fde2c06ea40 con 0x7fde2c147f60 2024-04-15T00:21:33.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.391+0000 7fde31608640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fde2c072a40 con 0x7fde2c072660 2024-04-15T00:21:33.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.391+0000 7fde2b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fde2c147f60 0x7fde2c141840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:33.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.391+0000 7fde2affd640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde2c072660 0x7fde2c14ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:33.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.391+0000 7fde2b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fde2c147f60 0x7fde2c141840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.31:41192/0 (socket says 172.21.15.31:41192) 2024-04-15T00:21:33.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.391+0000 7fde2a7fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fde2c1413c0 0x7fde2c147850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.31:53304/0 (socket says 172.21.15.31:53304) 2024-04-15T00:21:33.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.391+0000 7fde2b7fe640 1 -- 172.21.15.31:0/3534223678 learned_addr learned my addr 172.21.15.31:0/3534223678 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:33.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.391+0000 7fde2affd640 1 --2- 172.21.15.31:0/3534223678 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde2c072660 0x7fde2c14ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.31:60218/0 (socket says 172.21.15.31:60218) 2024-04-15T00:21:33.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.392+0000 7fde2b7fe640 1 -- 172.21.15.31:0/3534223678 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde2c072660 msgr2=0x7fde2c14ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:33.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.392+0000 7fde2b7fe640 1 --2- 172.21.15.31:0/3534223678 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde2c072660 0x7fde2c14ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:33.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.392+0000 7fde2b7fe640 1 -- 172.21.15.31:0/3534223678 >> v1:172.21.15.50:6789/0 conn(0x7fde2c1413c0 legacy=0x7fde2c147850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:33.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.392+0000 7fde2b7fe640 1 -- 172.21.15.31:0/3534223678 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde2c14b420 con 0x7fde2c147f60 2024-04-15T00:21:33.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.392+0000 7fde29ffb640 1 -- 172.21.15.31:0/3534223678 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2828557111 0 0) 0x7fde2c06e7d0 con 0x7fde2c1413c0 2024-04-15T00:21:33.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.392+0000 7fde2b7fe640 1 --2- 172.21.15.31:0/3534223678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde2c147f60 0x7fde2c141840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fde24009e50 tx=0x7fde2402bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55348d3b0577620d server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:33.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.393+0000 7fde29ffb640 1 -- 172.21.15.31:0/3534223678 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2402ca70 con 0x7fde2c147f60 2024-04-15T00:21:33.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.393+0000 7fde29ffb640 1 -- 172.21.15.31:0/3534223678 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde2402cc10 con 0x7fde2c147f60 2024-04-15T00:21:33.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.393+0000 7fde29ffb640 1 -- 172.21.15.31:0/3534223678 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde240343f0 con 0x7fde2c147f60 2024-04-15T00:21:33.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.393+0000 7fde31608640 1 -- 172.21.15.31:0/3534223678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde2c147f60 msgr2=0x7fde2c141840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:33.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.393+0000 7fde31608640 1 --2- 172.21.15.31:0/3534223678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde2c147f60 0x7fde2c141840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fde24009e50 tx=0x7fde2402bed0 comp rx=0 tx=0).stop 2024-04-15T00:21:33.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.393+0000 7fde31608640 1 -- 172.21.15.31:0/3534223678 shutdown_connections 2024-04-15T00:21:33.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.393+0000 7fde31608640 1 --2- 172.21.15.31:0/3534223678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde2c147f60 0x7fde2c141840 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:33.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.393+0000 7fde31608640 1 --2- 172.21.15.31:0/3534223678 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde2c072660 0x7fde2c14ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:33.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.393+0000 7fde31608640 1 -- 172.21.15.31:0/3534223678 >> 172.21.15.31:0/3534223678 conn(0x7fde2c0b7840 msgr2=0x7fde2c0b7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:33.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.393+0000 7fde31608640 1 -- 172.21.15.31:0/3534223678 shutdown_connections 2024-04-15T00:21:33.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.393+0000 7fde31608640 1 -- 172.21.15.31:0/3534223678 wait complete. 2024-04-15T00:21:33.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.394+0000 7fde31608640 1 Processor -- start 2024-04-15T00:21:33.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.394+0000 7fde31608640 1 -- start start 2024-04-15T00:21:33.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.395+0000 7fde31608640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde2c072660 0x7fde2c1e0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:33.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.395+0000 7fde31608640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde2c1413c0 0x7fde2c1e0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:33.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.395+0000 7fde31608640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde2c147f60 0x7fde2c13f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:33.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.395+0000 7fde31608640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fde2c14b070 con 0x7fde2c1413c0 2024-04-15T00:21:33.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.395+0000 7fde31608640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fde2c14b9e0 con 0x7fde2c147f60 2024-04-15T00:21:33.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.395+0000 7fde31608640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fde2c0b4cb0 con 0x7fde2c072660 2024-04-15T00:21:33.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.395+0000 7fde2a7fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde2c1413c0 0x7fde2c1e0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:33.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.395+0000 7fde2a7fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde2c1413c0 0x7fde2c1e0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35726/0 (socket says 172.21.15.31:35726) 2024-04-15T00:21:33.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.395+0000 7fde2a7fc640 1 -- 172.21.15.31:0/415896621 learned_addr learned my addr 172.21.15.31:0/415896621 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:33.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.395+0000 7fde2b7fe640 1 --2- 172.21.15.31:0/415896621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde2c147f60 0x7fde2c13f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:33.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.395+0000 7fde2affd640 1 --2- 172.21.15.31:0/415896621 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde2c072660 0x7fde2c1e0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:33.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.395+0000 7fde2a7fc640 1 -- 172.21.15.31:0/415896621 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde2c072660 msgr2=0x7fde2c1e0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:33.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.395+0000 7fde2a7fc640 1 --2- 172.21.15.31:0/415896621 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde2c072660 0x7fde2c1e0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:33.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.395+0000 7fde2a7fc640 1 -- 172.21.15.31:0/415896621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde2c147f60 msgr2=0x7fde2c13f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:33.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.395+0000 7fde2a7fc640 1 --2- 172.21.15.31:0/415896621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde2c147f60 0x7fde2c13f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:33.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.395+0000 7fde2a7fc640 1 -- 172.21.15.31:0/415896621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde2c0b3470 con 0x7fde2c1413c0 2024-04-15T00:21:33.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.396+0000 7fde2a7fc640 1 --2- 172.21.15.31:0/415896621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde2c1413c0 0x7fde2c1e0680 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fde2000c4d0 tx=0x7fde2000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:33.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.396+0000 7fde137fe640 1 -- 172.21.15.31:0/415896621 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde20018070 con 0x7fde2c1413c0 2024-04-15T00:21:33.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.396+0000 7fde137fe640 1 -- 172.21.15.31:0/415896621 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde20007500 con 0x7fde2c1413c0 2024-04-15T00:21:33.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.396+0000 7fde31608640 1 -- 172.21.15.31:0/415896621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde2c0b1e10 con 0x7fde2c1413c0 2024-04-15T00:21:33.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.396+0000 7fde137fe640 1 -- 172.21.15.31:0/415896621 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde20004a20 con 0x7fde2c1413c0 2024-04-15T00:21:33.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.396+0000 7fde31608640 1 -- 172.21.15.31:0/415896621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde2c144fe0 con 0x7fde2c1413c0 2024-04-15T00:21:33.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.397+0000 7fde31608640 1 -- 172.21.15.31:0/415896621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde2c0b2330 con 0x7fde2c1413c0 2024-04-15T00:21:33.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.397+0000 7fde137fe640 1 -- 172.21.15.31:0/415896621 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fde20004bc0 con 0x7fde2c1413c0 2024-04-15T00:21:33.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.398+0000 7fde137fe640 1 --2- 172.21.15.31:0/415896621 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fde1806b990 0x7fde1806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:33.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.398+0000 7fde137fe640 1 -- 172.21.15.31:0/415896621 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fde20089f20 con 0x7fde2c1413c0 2024-04-15T00:21:33.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.398+0000 7fde2affd640 1 --2- 172.21.15.31:0/415896621 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fde1806b990 0x7fde1806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:33.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.398+0000 7fde2affd640 1 --2- 172.21.15.31:0/415896621 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fde1806b990 0x7fde1806de50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fde1c009ad0 tx=0x7fde1c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:33.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.402+0000 7fde137fe640 1 -- 172.21.15.31:0/415896621 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fde2c0b2330 con 0x7fde2c1413c0 2024-04-15T00:21:33.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.585+0000 7fde31608640 1 -- 172.21.15.31:0/415896621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fde2c04f540 con 0x7fde2c1413c0 2024-04-15T00:21:33.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.586+0000 7fde137fe640 1 -- 172.21.15.31:0/415896621 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7fde20058770 con 0x7fde2c1413c0 2024-04-15T00:21:33.593 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-15T00:21:33.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.588+0000 7fde31608640 1 -- 172.21.15.31:0/415896621 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fde1806b990 msgr2=0x7fde1806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:33.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.588+0000 7fde31608640 1 --2- 172.21.15.31:0/415896621 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fde1806b990 0x7fde1806de50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fde1c009ad0 tx=0x7fde1c008040 comp rx=0 tx=0).stop 2024-04-15T00:21:33.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.588+0000 7fde31608640 1 -- 172.21.15.31:0/415896621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde2c1413c0 msgr2=0x7fde2c1e0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:33.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.588+0000 7fde31608640 1 --2- 172.21.15.31:0/415896621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde2c1413c0 0x7fde2c1e0680 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fde2000c4d0 tx=0x7fde2000c990 comp rx=0 tx=0).stop 2024-04-15T00:21:33.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.588+0000 7fde31608640 1 -- 172.21.15.31:0/415896621 shutdown_connections 2024-04-15T00:21:33.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.588+0000 7fde31608640 1 --2- 172.21.15.31:0/415896621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde2c147f60 0x7fde2c13f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:33.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.588+0000 7fde31608640 1 --2- 172.21.15.31:0/415896621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde2c1413c0 0x7fde2c1e0680 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:33.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.588+0000 7fde31608640 1 --2- 172.21.15.31:0/415896621 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fde1806b990 0x7fde1806de50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:33.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.588+0000 7fde31608640 1 --2- 172.21.15.31:0/415896621 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fde2c072660 0x7fde2c1e0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:33.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.588+0000 7fde31608640 1 -- 172.21.15.31:0/415896621 >> 172.21.15.31:0/415896621 conn(0x7fde2c0b7840 msgr2=0x7fde2c069090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:33.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.588+0000 7fde31608640 1 -- 172.21.15.31:0/415896621 shutdown_connections 2024-04-15T00:21:33.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.588+0000 7fde31608640 1 -- 172.21.15.31:0/415896621 wait complete. 2024-04-15T00:21:33.606 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T00:21:33.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.703+0000 7f1197155640 1 Processor -- start 2024-04-15T00:21:33.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.703+0000 7f1197155640 1 -- start start 2024-04-15T00:21:33.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.703+0000 7f1197155640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f119006e1d0 0x7f11900b1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:33.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.703+0000 7f1197155640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f11900b6800 0x7f119014fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:33.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.703+0000 7f1197155640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1190072a70 con 0x7f1190072690 2024-04-15T00:21:33.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.703+0000 7f1197155640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f11900b6c90 con 0x7f11900b6800 2024-04-15T00:21:33.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.703+0000 7f1197155640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f119006ebe0 con 0x7f119006e1d0 2024-04-15T00:21:33.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.704+0000 7f11956f2640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f11900b6800 0x7f119014fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:33.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.704+0000 7f1194ef1640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1190072690 0x7f119009fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55498/0 (socket says 172.21.15.31:55498) 2024-04-15T00:21:33.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.704+0000 7f11956f2640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f11900b6800 0x7f119014fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35738/0 (socket says 172.21.15.31:35738) 2024-04-15T00:21:33.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.704+0000 7f1194ef1640 1 -- 172.21.15.31:0/4021488870 learned_addr learned my addr 172.21.15.31:0/4021488870 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:33.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.704+0000 7f118ffff640 1 --2- 172.21.15.31:0/4021488870 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f119006e1d0 0x7f11900b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:33.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.704+0000 7f11956f2640 1 -- 172.21.15.31:0/4021488870 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f119006e1d0 msgr2=0x7f11900b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:33.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.704+0000 7f11956f2640 1 --2- 172.21.15.31:0/4021488870 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f119006e1d0 0x7f11900b1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:33.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.704+0000 7f11956f2640 1 -- 172.21.15.31:0/4021488870 >> v1:172.21.15.31:6789/0 conn(0x7f1190072690 legacy=0x7f119009fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:33.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.704+0000 7f11956f2640 1 -- 172.21.15.31:0/4021488870 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119006eec0 con 0x7f11900b6800 2024-04-15T00:21:33.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.704+0000 7f118f7fe640 1 -- 172.21.15.31:0/4021488870 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3227371088 0 0) 0x7f1190072a70 con 0x7f1190072690 2024-04-15T00:21:33.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.704+0000 7f118ffff640 1 --2- 172.21.15.31:0/4021488870 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f119006e1d0 0x7f11900b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:21:33.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.705+0000 7f11956f2640 1 --2- 172.21.15.31:0/4021488870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11900b6800 0x7f119014fdf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1188009d90 tx=0x7f118802be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900f05dfd45bb210 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:33.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.705+0000 7f118f7fe640 1 -- 172.21.15.31:0/4021488870 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1188039070 con 0x7f11900b6800 2024-04-15T00:21:33.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.705+0000 7f118f7fe640 1 -- 172.21.15.31:0/4021488870 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f118802cbc0 con 0x7f11900b6800 2024-04-15T00:21:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.705+0000 7f118f7fe640 1 -- 172.21.15.31:0/4021488870 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1188034440 con 0x7f11900b6800 2024-04-15T00:21:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.705+0000 7f1197155640 1 -- 172.21.15.31:0/4021488870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11900b6800 msgr2=0x7f119014fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.705+0000 7f1197155640 1 --2- 172.21.15.31:0/4021488870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11900b6800 0x7f119014fdf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1188009d90 tx=0x7f118802be10 comp rx=0 tx=0).stop 2024-04-15T00:21:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.705+0000 7f1197155640 1 -- 172.21.15.31:0/4021488870 shutdown_connections 2024-04-15T00:21:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.705+0000 7f1197155640 1 --2- 172.21.15.31:0/4021488870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11900b6800 0x7f119014fdf0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.705+0000 7f1197155640 1 --2- 172.21.15.31:0/4021488870 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f119006e1d0 0x7f11900b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.705+0000 7f1197155640 1 -- 172.21.15.31:0/4021488870 >> 172.21.15.31:0/4021488870 conn(0x7f11900b7840 msgr2=0x7f11900b7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.705+0000 7f1197155640 1 -- 172.21.15.31:0/4021488870 shutdown_connections 2024-04-15T00:21:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.705+0000 7f1197155640 1 -- 172.21.15.31:0/4021488870 wait complete. 2024-04-15T00:21:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.706+0000 7f1197155640 1 Processor -- start 2024-04-15T00:21:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.706+0000 7f1197155640 1 -- start start 2024-04-15T00:21:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.707+0000 7f1197155640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f119006e1d0 0x7f11900b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.707+0000 7f1197155640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1190072690 0x7f11900b3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.707+0000 7f1197155640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1190141f90 0x7f119013eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.707+0000 7f1197155640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f11900b75d0 con 0x7f1190141f90 2024-04-15T00:21:33.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.707+0000 7f1197155640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f11900b7450 con 0x7f1190072690 2024-04-15T00:21:33.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.707+0000 7f1197155640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f11900b1cb0 con 0x7f119006e1d0 2024-04-15T00:21:33.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.707+0000 7f11956f2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1190141f90 0x7f119013eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:33.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.707+0000 7f11956f2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1190141f90 0x7f119013eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35754/0 (socket says 172.21.15.31:35754) 2024-04-15T00:21:33.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.707+0000 7f11956f2640 1 -- 172.21.15.31:0/494790840 learned_addr learned my addr 172.21.15.31:0/494790840 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:33.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.707+0000 7f118ffff640 1 --2- 172.21.15.31:0/494790840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1190072690 0x7f11900b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:33.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.707+0000 7f1194ef1640 1 --2- 172.21.15.31:0/494790840 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f119006e1d0 0x7f11900b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:33.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.708+0000 7f11956f2640 1 -- 172.21.15.31:0/494790840 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f119006e1d0 msgr2=0x7f11900b4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:33.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.708+0000 7f11956f2640 1 --2- 172.21.15.31:0/494790840 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f119006e1d0 0x7f11900b4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:33.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.708+0000 7f11956f2640 1 -- 172.21.15.31:0/494790840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1190072690 msgr2=0x7f11900b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:33.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.708+0000 7f11956f2640 1 --2- 172.21.15.31:0/494790840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1190072690 0x7f11900b3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:33.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.708+0000 7f11956f2640 1 -- 172.21.15.31:0/494790840 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11900b3950 con 0x7f1190141f90 2024-04-15T00:21:33.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.708+0000 7f118ffff640 1 --2- 172.21.15.31:0/494790840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1190072690 0x7f11900b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:21:33.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.708+0000 7f1194ef1640 1 --2- 172.21.15.31:0/494790840 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f119006e1d0 0x7f11900b4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:21:33.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.708+0000 7f11956f2640 1 --2- 172.21.15.31:0/494790840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1190141f90 0x7f119013eae0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1188009d90 tx=0x7f1188004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:33.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.708+0000 7f118d7fa640 1 -- 172.21.15.31:0/494790840 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1188039050 con 0x7f1190141f90 2024-04-15T00:21:33.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.708+0000 7f118d7fa640 1 -- 172.21.15.31:0/494790840 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1188045070 con 0x7f1190141f90 2024-04-15T00:21:33.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.708+0000 7f1197155640 1 -- 172.21.15.31:0/494790840 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1190142960 con 0x7f1190141f90 2024-04-15T00:21:33.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.708+0000 7f118d7fa640 1 -- 172.21.15.31:0/494790840 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118803e830 con 0x7f1190141f90 2024-04-15T00:21:33.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.708+0000 7f1197155640 1 -- 172.21.15.31:0/494790840 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11901db320 con 0x7f1190141f90 2024-04-15T00:21:33.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.709+0000 7f1197155640 1 -- 172.21.15.31:0/494790840 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f119004f620 con 0x7f1190141f90 2024-04-15T00:21:33.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.709+0000 7f118d7fa640 1 -- 172.21.15.31:0/494790840 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f118803e9d0 con 0x7f1190141f90 2024-04-15T00:21:33.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.710+0000 7f118d7fa640 1 --2- 172.21.15.31:0/494790840 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f117406b990 0x7f117406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:33.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.710+0000 7f1194ef1640 1 --2- 172.21.15.31:0/494790840 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f117406b990 0x7f117406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:33.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.710+0000 7f118d7fa640 1 -- 172.21.15.31:0/494790840 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f11880ad910 con 0x7f1190141f90 2024-04-15T00:21:33.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.710+0000 7f1194ef1640 1 --2- 172.21.15.31:0/494790840 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f117406b990 0x7f117406de50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f11840016f0 tx=0x7f1184009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:33.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.714+0000 7f118d7fa640 1 -- 172.21.15.31:0/494790840 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f118807c390 con 0x7f1190141f90 2024-04-15T00:21:33.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.894+0000 7f1197155640 1 -- 172.21.15.31:0/494790840 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f11900b9a30 con 0x7f1190141f90 2024-04-15T00:21:33.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.894+0000 7f118d7fa640 1 -- 172.21.15.31:0/494790840 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f118807bc90 con 0x7f1190141f90 2024-04-15T00:21:33.902 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-04-15T00:21:33.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.896+0000 7f1197155640 1 -- 172.21.15.31:0/494790840 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f117406b990 msgr2=0x7f117406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:33.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.896+0000 7f1197155640 1 --2- 172.21.15.31:0/494790840 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f117406b990 0x7f117406de50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f11840016f0 tx=0x7f1184009040 comp rx=0 tx=0).stop 2024-04-15T00:21:33.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.896+0000 7f1197155640 1 -- 172.21.15.31:0/494790840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1190141f90 msgr2=0x7f119013eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:33.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.896+0000 7f1197155640 1 --2- 172.21.15.31:0/494790840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1190141f90 0x7f119013eae0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1188009d90 tx=0x7f1188004a40 comp rx=0 tx=0).stop 2024-04-15T00:21:33.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.896+0000 7f1197155640 1 -- 172.21.15.31:0/494790840 shutdown_connections 2024-04-15T00:21:33.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.896+0000 7f1197155640 1 --2- 172.21.15.31:0/494790840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1190141f90 0x7f119013eae0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:33.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.896+0000 7f1197155640 1 --2- 172.21.15.31:0/494790840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1190072690 0x7f11900b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:33.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.896+0000 7f1197155640 1 --2- 172.21.15.31:0/494790840 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f117406b990 0x7f117406de50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:33.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.896+0000 7f1197155640 1 --2- 172.21.15.31:0/494790840 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f119006e1d0 0x7f11900b4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:33.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.896+0000 7f1197155640 1 -- 172.21.15.31:0/494790840 >> 172.21.15.31:0/494790840 conn(0x7f11900b7840 msgr2=0x7f119006f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:33.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.896+0000 7f1197155640 1 -- 172.21.15.31:0/494790840 shutdown_connections 2024-04-15T00:21:33.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:33.896+0000 7f1197155640 1 -- 172.21.15.31:0/494790840 wait complete. 2024-04-15T00:21:33.914 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-15T00:21:34.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.011+0000 7fdf4f1c8640 1 Processor -- start 2024-04-15T00:21:34.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.011+0000 7fdf4f1c8640 1 -- start start 2024-04-15T00:21:34.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.012+0000 7fdf4f1c8640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf480729b0 0x7fdf48147880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:34.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.012+0000 7fdf4f1c8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdf4806c960 0x7fdf480b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:34.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.012+0000 7fdf4f1c8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf4806cdf0 con 0x7fdf48072d90 2024-04-15T00:21:34.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.012+0000 7fdf4f1c8640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fdf4806c210 con 0x7fdf4806c960 2024-04-15T00:21:34.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.012+0000 7fdf4f1c8640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fdf4806c4d0 con 0x7fdf480729b0 2024-04-15T00:21:34.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.012+0000 7fdf4d765640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdf4806c960 0x7fdf480b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:34.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.012+0000 7fdf4cf64640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf480729b0 0x7fdf48147880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:34.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.012+0000 7fdf47fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdf48072d90 0x7fdf480b6720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.31:53320/0 (socket says 172.21.15.31:53320) 2024-04-15T00:21:34.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.012+0000 7fdf47fff640 1 -- 172.21.15.31:0/4172840671 learned_addr learned my addr 172.21.15.31:0/4172840671 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:34.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.012+0000 7fdf4cf64640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf480729b0 0x7fdf48147880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.31:60250/0 (socket says 172.21.15.31:60250) 2024-04-15T00:21:34.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.012+0000 7fdf4d765640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdf4806c960 0x7fdf480b5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.31:41214/0 (socket says 172.21.15.31:41214) 2024-04-15T00:21:34.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.012+0000 7fdf4cf64640 1 -- 172.21.15.31:0/4172840671 >> v2:172.21.15.50:3300/0 conn(0x7fdf4806c960 msgr2=0x7fdf480b5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:34.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.012+0000 7fdf4cf64640 1 --2- 172.21.15.31:0/4172840671 >> v2:172.21.15.50:3300/0 conn(0x7fdf4806c960 0x7fdf480b5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.012+0000 7fdf4cf64640 1 -- 172.21.15.31:0/4172840671 >> v1:172.21.15.50:6789/0 conn(0x7fdf48072d90 legacy=0x7fdf480b6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:34.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.012+0000 7fdf4cf64640 1 -- 172.21.15.31:0/4172840671 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf4806baa0 con 0x7fdf480729b0 2024-04-15T00:21:34.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.012+0000 7fdf4d765640 1 --2- 172.21.15.31:0/4172840671 >> v2:172.21.15.50:3300/0 conn(0x7fdf4806c960 0x7fdf480b5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:21:34.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.013+0000 7fdf4cf64640 1 --2- 172.21.15.31:0/4172840671 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf480729b0 0x7fdf48147880 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdf4806c650 tx=0x7fdf4002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8e63322feb92017 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:34.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.013+0000 7fdf477fe640 1 -- 172.21.15.31:0/4172840671 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf40035020 con 0x7fdf480729b0 2024-04-15T00:21:34.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.013+0000 7fdf477fe640 1 -- 172.21.15.31:0/4172840671 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf40031800 con 0x7fdf480729b0 2024-04-15T00:21:34.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.013+0000 7fdf477fe640 1 -- 172.21.15.31:0/4172840671 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf40031bd0 con 0x7fdf480729b0 2024-04-15T00:21:34.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.014+0000 7fdf4f1c8640 1 -- 172.21.15.31:0/4172840671 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf480729b0 msgr2=0x7fdf48147880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:34.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.014+0000 7fdf4f1c8640 1 --2- 172.21.15.31:0/4172840671 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf480729b0 0x7fdf48147880 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdf4806c650 tx=0x7fdf4002b8a0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.014+0000 7fdf4f1c8640 1 -- 172.21.15.31:0/4172840671 shutdown_connections 2024-04-15T00:21:34.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.014+0000 7fdf4f1c8640 1 --2- 172.21.15.31:0/4172840671 >> v2:172.21.15.50:3300/0 conn(0x7fdf4806c960 0x7fdf480b5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.014+0000 7fdf4f1c8640 1 --2- 172.21.15.31:0/4172840671 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf480729b0 0x7fdf48147880 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.014+0000 7fdf4f1c8640 1 -- 172.21.15.31:0/4172840671 >> 172.21.15.31:0/4172840671 conn(0x7fdf480bacb0 msgr2=0x7fdf480bb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:34.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.014+0000 7fdf4f1c8640 1 -- 172.21.15.31:0/4172840671 shutdown_connections 2024-04-15T00:21:34.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.014+0000 7fdf4f1c8640 1 -- 172.21.15.31:0/4172840671 wait complete. 2024-04-15T00:21:34.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.015+0000 7fdf4f1c8640 1 Processor -- start 2024-04-15T00:21:34.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.015+0000 7fdf4f1c8640 1 -- start start 2024-04-15T00:21:34.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.016+0000 7fdf4f1c8640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf4806c960 0x7fdf480b1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:34.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.016+0000 7fdf4f1c8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf480729b0 0x7fdf48142a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:34.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.016+0000 7fdf4f1c8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf48072d90 0x7fdf481e0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:34.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.016+0000 7fdf4f1c8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4806b670 con 0x7fdf480729b0 2024-04-15T00:21:34.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.016+0000 7fdf4f1c8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdf480b62d0 con 0x7fdf48072d90 2024-04-15T00:21:34.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.016+0000 7fdf4f1c8640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fdf48145310 con 0x7fdf4806c960 2024-04-15T00:21:34.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.016+0000 7fdf47fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf480729b0 0x7fdf48142a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:34.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.016+0000 7fdf47fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf480729b0 0x7fdf48142a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35768/0 (socket says 172.21.15.31:35768) 2024-04-15T00:21:34.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.016+0000 7fdf47fff640 1 -- 172.21.15.31:0/789919864 learned_addr learned my addr 172.21.15.31:0/789919864 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:34.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.016+0000 7fdf4d765640 1 --2- 172.21.15.31:0/789919864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf48072d90 0x7fdf481e0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:34.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.016+0000 7fdf4cf64640 1 --2- 172.21.15.31:0/789919864 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf4806c960 0x7fdf480b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:34.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.016+0000 7fdf47fff640 1 -- 172.21.15.31:0/789919864 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf4806c960 msgr2=0x7fdf480b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:34.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.016+0000 7fdf47fff640 1 --2- 172.21.15.31:0/789919864 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf4806c960 0x7fdf480b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.016+0000 7fdf47fff640 1 -- 172.21.15.31:0/789919864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf48072d90 msgr2=0x7fdf481e0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:34.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.016+0000 7fdf47fff640 1 --2- 172.21.15.31:0/789919864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf48072d90 0x7fdf481e0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.016+0000 7fdf47fff640 1 -- 172.21.15.31:0/789919864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf481431f0 con 0x7fdf480729b0 2024-04-15T00:21:34.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.016+0000 7fdf47fff640 1 --2- 172.21.15.31:0/789919864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf480729b0 0x7fdf48142a90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdf3800ca70 tx=0x7fdf3800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:34.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.017+0000 7fdf457fa640 1 -- 172.21.15.31:0/789919864 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf38017070 con 0x7fdf480729b0 2024-04-15T00:21:34.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.017+0000 7fdf457fa640 1 -- 172.21.15.31:0/789919864 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf3800ab70 con 0x7fdf480729b0 2024-04-15T00:21:34.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.017+0000 7fdf4f1c8640 1 -- 172.21.15.31:0/789919864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf4813eba0 con 0x7fdf480729b0 2024-04-15T00:21:34.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.017+0000 7fdf457fa640 1 -- 172.21.15.31:0/789919864 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf38012400 con 0x7fdf480729b0 2024-04-15T00:21:34.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.017+0000 7fdf4f1c8640 1 -- 172.21.15.31:0/789919864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf480b4e10 con 0x7fdf480729b0 2024-04-15T00:21:34.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.018+0000 7fdf4f1c8640 1 -- 172.21.15.31:0/789919864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf48074de0 con 0x7fdf480729b0 2024-04-15T00:21:34.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.018+0000 7fdf457fa640 1 -- 172.21.15.31:0/789919864 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fdf3801a070 con 0x7fdf480729b0 2024-04-15T00:21:34.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.018+0000 7fdf457fa640 1 --2- 172.21.15.31:0/789919864 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fdf2806b990 0x7fdf2806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:34.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.019+0000 7fdf4cf64640 1 --2- 172.21.15.31:0/789919864 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fdf2806b990 0x7fdf2806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:34.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.019+0000 7fdf457fa640 1 -- 172.21.15.31:0/789919864 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fdf3808a7d0 con 0x7fdf480729b0 2024-04-15T00:21:34.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.019+0000 7fdf4cf64640 1 --2- 172.21.15.31:0/789919864 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fdf2806b990 0x7fdf2806de50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdf40036000 tx=0x7fdf40008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:34.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.023+0000 7fdf457fa640 1 -- 172.21.15.31:0/789919864 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fdf38059130 con 0x7fdf480729b0 2024-04-15T00:21:34.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.203+0000 7fdf4f1c8640 1 -- 172.21.15.31:0/789919864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fdf4804f540 con 0x7fdf480729b0 2024-04-15T00:21:34.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.203+0000 7fdf457fa640 1 -- 172.21.15.31:0/789919864 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7fdf38058a30 con 0x7fdf480729b0 2024-04-15T00:21:34.211 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-15T00:21:34.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.205+0000 7fdf4f1c8640 1 -- 172.21.15.31:0/789919864 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fdf2806b990 msgr2=0x7fdf2806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:34.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.205+0000 7fdf4f1c8640 1 --2- 172.21.15.31:0/789919864 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fdf2806b990 0x7fdf2806de50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdf40036000 tx=0x7fdf40008030 comp rx=0 tx=0).stop 2024-04-15T00:21:34.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.205+0000 7fdf4f1c8640 1 -- 172.21.15.31:0/789919864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf480729b0 msgr2=0x7fdf48142a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:34.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.205+0000 7fdf4f1c8640 1 --2- 172.21.15.31:0/789919864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf480729b0 0x7fdf48142a90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdf3800ca70 tx=0x7fdf3800cf30 comp rx=0 tx=0).stop 2024-04-15T00:21:34.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.205+0000 7fdf4f1c8640 1 -- 172.21.15.31:0/789919864 shutdown_connections 2024-04-15T00:21:34.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.205+0000 7fdf4f1c8640 1 --2- 172.21.15.31:0/789919864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf48072d90 0x7fdf481e0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.205+0000 7fdf4f1c8640 1 --2- 172.21.15.31:0/789919864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf480729b0 0x7fdf48142a90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.205+0000 7fdf4f1c8640 1 --2- 172.21.15.31:0/789919864 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fdf2806b990 0x7fdf2806de50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.205+0000 7fdf4f1c8640 1 --2- 172.21.15.31:0/789919864 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdf4806c960 0x7fdf480b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.205+0000 7fdf4f1c8640 1 -- 172.21.15.31:0/789919864 >> 172.21.15.31:0/789919864 conn(0x7fdf480bacb0 msgr2=0x7fdf480bb090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:34.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.205+0000 7fdf4f1c8640 1 -- 172.21.15.31:0/789919864 shutdown_connections 2024-04-15T00:21:34.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.205+0000 7fdf4f1c8640 1 -- 172.21.15.31:0/789919864 wait complete. 2024-04-15T00:21:34.224 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T00:21:34.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.318+0000 7f7d18e2d640 1 Processor -- start 2024-04-15T00:21:34.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.318+0000 7f7d18e2d640 1 -- start start 2024-04-15T00:21:34.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.319+0000 7f7d18e2d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d140baef0 0x7f7d14147670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:34.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.319+0000 7f7d18e2d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7d1414b8e0 0x7f7d140b9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:34.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.319+0000 7f7d18e2d640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d140b8bf0 0x7f7d14072600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:34.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.319+0000 7f7d18e2d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f7d140bb2d0 con 0x7f7d1414b8e0 2024-04-15T00:21:34.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.319+0000 7f7d18e2d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f7d14147bb0 con 0x7f7d140baef0 2024-04-15T00:21:34.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.319+0000 7f7d18e2d640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f7d1414ae00 con 0x7f7d140b8bf0 2024-04-15T00:21:34.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.319+0000 7f7d11d9b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7d1414b8e0 0x7f7d140b9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:34.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.319+0000 7f7d11d9b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7d1414b8e0 0x7f7d140b9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35776/0 (socket says 172.21.15.31:35776) 2024-04-15T00:21:34.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.319+0000 7f7d11d9b640 1 -- 172.21.15.31:0/618389949 learned_addr learned my addr 172.21.15.31:0/618389949 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:34.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.319+0000 7f7d1259c640 1 --2- 172.21.15.31:0/618389949 >> v2:172.21.15.50:3300/0 conn(0x7f7d140baef0 0x7f7d14147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:34.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.319+0000 7f7d12d9d640 1 --2- 172.21.15.31:0/618389949 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d140b8bf0 0x7f7d14072600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:34.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.319+0000 7f7d11d9b640 1 -- 172.21.15.31:0/618389949 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d140b8bf0 msgr2=0x7f7d14072600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:34.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.319+0000 7f7d11d9b640 1 --2- 172.21.15.31:0/618389949 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d140b8bf0 0x7f7d14072600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.319+0000 7f7d11d9b640 1 -- 172.21.15.31:0/618389949 >> v2:172.21.15.50:3300/0 conn(0x7f7d140baef0 msgr2=0x7f7d14147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:34.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.319+0000 7f7d11d9b640 1 --2- 172.21.15.31:0/618389949 >> v2:172.21.15.50:3300/0 conn(0x7f7d140baef0 0x7f7d14147670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.319+0000 7f7d11d9b640 1 -- 172.21.15.31:0/618389949 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d1414b0e0 con 0x7f7d1414b8e0 2024-04-15T00:21:34.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.319+0000 7f7d12d9d640 1 --2- 172.21.15.31:0/618389949 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d140b8bf0 0x7f7d14072600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:21:34.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.320+0000 7f7d11d9b640 1 --2- 172.21.15.31:0/618389949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d1414b8e0 0x7f7d140b9a10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7d140736a0 tx=0x7f7cfc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78cc136e58f0ed98 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:34.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.320+0000 7f7d1159a640 1 -- 172.21.15.31:0/618389949 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc02e070 con 0x7f7d1414b8e0 2024-04-15T00:21:34.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.320+0000 7f7d1159a640 1 -- 172.21.15.31:0/618389949 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cfc037070 con 0x7f7d1414b8e0 2024-04-15T00:21:34.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.320+0000 7f7d1159a640 1 -- 172.21.15.31:0/618389949 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc031a00 con 0x7f7d1414b8e0 2024-04-15T00:21:34.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.321+0000 7f7d18e2d640 1 -- 172.21.15.31:0/618389949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d1414b8e0 msgr2=0x7f7d140b9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:34.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.321+0000 7f7d18e2d640 1 --2- 172.21.15.31:0/618389949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d1414b8e0 0x7f7d140b9a10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7d140736a0 tx=0x7f7cfc02b880 comp rx=0 tx=0).stop 2024-04-15T00:21:34.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.321+0000 7f7d18e2d640 1 -- 172.21.15.31:0/618389949 shutdown_connections 2024-04-15T00:21:34.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.321+0000 7f7d18e2d640 1 --2- 172.21.15.31:0/618389949 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d140b8bf0 0x7f7d14072600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.321+0000 7f7d18e2d640 1 --2- 172.21.15.31:0/618389949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d1414b8e0 0x7f7d140b9a10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.321+0000 7f7d18e2d640 1 --2- 172.21.15.31:0/618389949 >> v2:172.21.15.50:3300/0 conn(0x7f7d140baef0 0x7f7d14147670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.321+0000 7f7d18e2d640 1 -- 172.21.15.31:0/618389949 >> 172.21.15.31:0/618389949 conn(0x7f7d1409ed70 msgr2=0x7f7d1409f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:34.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.321+0000 7f7d18e2d640 1 -- 172.21.15.31:0/618389949 shutdown_connections 2024-04-15T00:21:34.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.321+0000 7f7d18e2d640 1 -- 172.21.15.31:0/618389949 wait complete. 2024-04-15T00:21:34.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.322+0000 7f7d18e2d640 1 Processor -- start 2024-04-15T00:21:34.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.322+0000 7f7d18e2d640 1 -- start start 2024-04-15T00:21:34.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.323+0000 7f7d18e2d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d140b8bf0 0x7f7d141442f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:34.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.323+0000 7f7d18e2d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d140baef0 0x7f7d141dd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:34.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.323+0000 7f7d18e2d640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d1414b8e0 0x7f7d141dd630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:34.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.323+0000 7f7d18e2d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7d140ba0d0 con 0x7f7d140baef0 2024-04-15T00:21:34.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.323+0000 7f7d18e2d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7d140b9f50 con 0x7f7d140b8bf0 2024-04-15T00:21:34.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.323+0000 7f7d18e2d640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f7d140b9040 con 0x7f7d1414b8e0 2024-04-15T00:21:34.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.323+0000 7f7d11d9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d140baef0 0x7f7d141dd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:34.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.323+0000 7f7d11d9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d140baef0 0x7f7d141dd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35784/0 (socket says 172.21.15.31:35784) 2024-04-15T00:21:34.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.323+0000 7f7d11d9b640 1 -- 172.21.15.31:0/167161540 learned_addr learned my addr 172.21.15.31:0/167161540 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:34.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.323+0000 7f7d1259c640 1 --2- 172.21.15.31:0/167161540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d140b8bf0 0x7f7d141442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:34.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.323+0000 7f7d12d9d640 1 --2- 172.21.15.31:0/167161540 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d1414b8e0 0x7f7d141dd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:34.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.323+0000 7f7d11d9b640 1 -- 172.21.15.31:0/167161540 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d1414b8e0 msgr2=0x7f7d141dd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:34.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.323+0000 7f7d11d9b640 1 --2- 172.21.15.31:0/167161540 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d1414b8e0 0x7f7d141dd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.323+0000 7f7d11d9b640 1 -- 172.21.15.31:0/167161540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d140b8bf0 msgr2=0x7f7d141442f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:34.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.323+0000 7f7d11d9b640 1 --2- 172.21.15.31:0/167161540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d140b8bf0 0x7f7d141442f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.323+0000 7f7d11d9b640 1 -- 172.21.15.31:0/167161540 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d14145230 con 0x7f7d140baef0 2024-04-15T00:21:34.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.323+0000 7f7d11d9b640 1 --2- 172.21.15.31:0/167161540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d140baef0 0x7f7d141dd0f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc000c00 tx=0x7f7cfc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:34.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.323+0000 7f7d0affd640 1 -- 172.21.15.31:0/167161540 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc032670 con 0x7f7d140baef0 2024-04-15T00:21:34.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.324+0000 7f7d0affd640 1 -- 172.21.15.31:0/167161540 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cfc032850 con 0x7f7d140baef0 2024-04-15T00:21:34.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.324+0000 7f7d18e2d640 1 -- 172.21.15.31:0/167161540 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d141d1d40 con 0x7f7d140baef0 2024-04-15T00:21:34.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.324+0000 7f7d0affd640 1 -- 172.21.15.31:0/167161540 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc032c40 con 0x7f7d140baef0 2024-04-15T00:21:34.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.324+0000 7f7d18e2d640 1 -- 172.21.15.31:0/167161540 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d141d0aa0 con 0x7f7d140baef0 2024-04-15T00:21:34.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.325+0000 7f7d18e2d640 1 -- 172.21.15.31:0/167161540 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d1404f620 con 0x7f7d140baef0 2024-04-15T00:21:34.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.325+0000 7f7d0affd640 1 -- 172.21.15.31:0/167161540 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f7cfc04c060 con 0x7f7d140baef0 2024-04-15T00:21:34.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.326+0000 7f7d0affd640 1 --2- 172.21.15.31:0/167161540 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f7cf406b990 0x7f7cf406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:34.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.326+0000 7f7d1259c640 1 --2- 172.21.15.31:0/167161540 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f7cf406b990 0x7f7cf406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:34.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.326+0000 7f7d0affd640 1 -- 172.21.15.31:0/167161540 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7cfc0ac4b0 con 0x7f7d140baef0 2024-04-15T00:21:34.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.326+0000 7f7d1259c640 1 --2- 172.21.15.31:0/167161540 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f7cf406b990 0x7f7cf406de50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c006fd0 tx=0x7f7d0c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:34.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.330+0000 7f7d0affd640 1 -- 172.21.15.31:0/167161540 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7cfc040070 con 0x7f7d140baef0 2024-04-15T00:21:34.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.551+0000 7f7d18e2d640 1 -- 172.21.15.31:0/167161540 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d141d1a60 con 0x7f7d140baef0 2024-04-15T00:21:34.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.551+0000 7f7d0affd640 1 -- 172.21.15.31:0/167161540 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3520 (secure 0 0 0) 0x7f7cfc07a720 con 0x7f7d140baef0 2024-04-15T00:21:34.559 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:21:34.559 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/921487249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":921487249},{"type":"v1","addr":"172.21.15.50:6833","nonce":921487249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T00:21:07.925196+0000","modified":"2024-04-15T00:21:23.993707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/93464605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":93464605},{"type":"v1","addr":"172.21.15.31:6835","nonce":93464605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-04-15T00:21:34.559 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-04-15T00:21:34.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.553+0000 7f7d18e2d640 1 -- 172.21.15.31:0/167161540 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f7cf406b990 msgr2=0x7f7cf406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:34.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.553+0000 7f7d18e2d640 1 --2- 172.21.15.31:0/167161540 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f7cf406b990 0x7f7cf406de50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c006fd0 tx=0x7f7d0c008040 comp rx=0 tx=0).stop 2024-04-15T00:21:34.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.553+0000 7f7d18e2d640 1 -- 172.21.15.31:0/167161540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d140baef0 msgr2=0x7f7d141dd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:34.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.553+0000 7f7d18e2d640 1 --2- 172.21.15.31:0/167161540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d140baef0 0x7f7d141dd0f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc000c00 tx=0x7f7cfc0046c0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.553+0000 7f7d18e2d640 1 -- 172.21.15.31:0/167161540 shutdown_connections 2024-04-15T00:21:34.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.553+0000 7f7d18e2d640 1 --2- 172.21.15.31:0/167161540 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f7cf406b990 0x7f7cf406de50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.553+0000 7f7d18e2d640 1 --2- 172.21.15.31:0/167161540 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7d1414b8e0 0x7f7d141dd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.553+0000 7f7d18e2d640 1 --2- 172.21.15.31:0/167161540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d140baef0 0x7f7d141dd0f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.553+0000 7f7d18e2d640 1 --2- 172.21.15.31:0/167161540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d140b8bf0 0x7f7d141442f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.553+0000 7f7d18e2d640 1 -- 172.21.15.31:0/167161540 >> 172.21.15.31:0/167161540 conn(0x7f7d1409ed70 msgr2=0x7f7d140bd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:34.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.553+0000 7f7d18e2d640 1 -- 172.21.15.31:0/167161540 shutdown_connections 2024-04-15T00:21:34.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.553+0000 7f7d18e2d640 1 -- 172.21.15.31:0/167161540 wait complete. 2024-04-15T00:21:34.571 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:21:34.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.666+0000 7f78ac1c8640 1 Processor -- start 2024-04-15T00:21:34.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.666+0000 7f78ac1c8640 1 -- start start 2024-04-15T00:21:34.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.667+0000 7f78ac1c8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f78a40b8be0 0x7f78a4072570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:34.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.667+0000 7f78ac1c8640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78a414b4c0 0x7f78a41449c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:34.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.667+0000 7f78ac1c8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78a4072c90 con 0x7f78a40b80d0 2024-04-15T00:21:34.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.667+0000 7f78ac1c8640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f78a409c0e0 con 0x7f78a40b8be0 2024-04-15T00:21:34.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.667+0000 7f78ac1c8640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f78a40b84b0 con 0x7f78a414b4c0 2024-04-15T00:21:34.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.667+0000 7f78aa765640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78a414b4c0 0x7f78a41449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:34.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.667+0000 7f78a9763640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f78a40b8be0 0x7f78a4072570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:34.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.667+0000 7f78a9f64640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f78a40b80d0 0x7f78a414adb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.31:53330/0 (socket says 172.21.15.31:53330) 2024-04-15T00:21:34.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.667+0000 7f78a9f64640 1 -- 172.21.15.31:0/2089358148 learned_addr learned my addr 172.21.15.31:0/2089358148 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:34.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.667+0000 7f78aa765640 1 -- 172.21.15.31:0/2089358148 >> v2:172.21.15.50:3300/0 conn(0x7f78a40b8be0 msgr2=0x7f78a4072570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:34.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.667+0000 7f78aa765640 1 --2- 172.21.15.31:0/2089358148 >> v2:172.21.15.50:3300/0 conn(0x7f78a40b8be0 0x7f78a4072570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.667+0000 7f78aa765640 1 -- 172.21.15.31:0/2089358148 >> v1:172.21.15.50:6789/0 conn(0x7f78a40b80d0 legacy=0x7f78a414adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:34.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.667+0000 7f78aa765640 1 -- 172.21.15.31:0/2089358148 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a409c380 con 0x7f78a414b4c0 2024-04-15T00:21:34.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.668+0000 7f78aa765640 1 --2- 172.21.15.31:0/2089358148 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78a414b4c0 0x7f78a41449c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f789c009d90 tx=0x7f789c02bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=451eafe2aee2d81 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:34.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.670+0000 7f78a8f62640 1 -- 172.21.15.31:0/2089358148 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c039070 con 0x7f78a414b4c0 2024-04-15T00:21:34.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.670+0000 7f78a8f62640 1 -- 172.21.15.31:0/2089358148 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f789c02cb30 con 0x7f78a414b4c0 2024-04-15T00:21:34.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.670+0000 7f78a8f62640 1 -- 172.21.15.31:0/2089358148 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c034440 con 0x7f78a414b4c0 2024-04-15T00:21:34.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.671+0000 7f78ac1c8640 1 -- 172.21.15.31:0/2089358148 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78a414b4c0 msgr2=0x7f78a41449c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:34.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.671+0000 7f78ac1c8640 1 --2- 172.21.15.31:0/2089358148 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78a414b4c0 0x7f78a41449c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f789c009d90 tx=0x7f789c02bd80 comp rx=0 tx=0).stop 2024-04-15T00:21:34.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.671+0000 7f78ac1c8640 1 -- 172.21.15.31:0/2089358148 shutdown_connections 2024-04-15T00:21:34.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.671+0000 7f78ac1c8640 1 --2- 172.21.15.31:0/2089358148 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78a414b4c0 0x7f78a41449c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.671+0000 7f78ac1c8640 1 --2- 172.21.15.31:0/2089358148 >> v2:172.21.15.50:3300/0 conn(0x7f78a40b8be0 0x7f78a4072570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.671+0000 7f78ac1c8640 1 -- 172.21.15.31:0/2089358148 >> 172.21.15.31:0/2089358148 conn(0x7f78a40bd020 msgr2=0x7f78a40bd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:34.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.671+0000 7f78ac1c8640 1 -- 172.21.15.31:0/2089358148 shutdown_connections 2024-04-15T00:21:34.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.671+0000 7f78ac1c8640 1 -- 172.21.15.31:0/2089358148 wait complete. 2024-04-15T00:21:34.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.672+0000 7f78ac1c8640 1 Processor -- start 2024-04-15T00:21:34.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.672+0000 7f78ac1c8640 1 -- start start 2024-04-15T00:21:34.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.672+0000 7f78ac1c8640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78a40b80d0 0x7f78a4146300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:34.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.672+0000 7f78ac1c8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78a40b8be0 0x7f78a41dd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:34.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.672+0000 7f78ac1c8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78a414b4c0 0x7f78a40b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:34.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.672+0000 7f78ac1c8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f78a4145080 con 0x7f78a40b8be0 2024-04-15T00:21:34.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.672+0000 7f78ac1c8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f78a4144f00 con 0x7f78a414b4c0 2024-04-15T00:21:34.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.672+0000 7f78ac1c8640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f78a4145200 con 0x7f78a40b80d0 2024-04-15T00:21:34.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.673+0000 7f78a9763640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78a40b8be0 0x7f78a41dd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:34.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.673+0000 7f78a9763640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78a40b8be0 0x7f78a41dd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35796/0 (socket says 172.21.15.31:35796) 2024-04-15T00:21:34.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.673+0000 7f78a9763640 1 -- 172.21.15.31:0/2289508893 learned_addr learned my addr 172.21.15.31:0/2289508893 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:34.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.673+0000 7f78a9f64640 1 --2- 172.21.15.31:0/2289508893 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78a40b80d0 0x7f78a4146300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:34.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.673+0000 7f78aa765640 1 --2- 172.21.15.31:0/2289508893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78a414b4c0 0x7f78a40b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:34.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.673+0000 7f78a9763640 1 -- 172.21.15.31:0/2289508893 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78a40b80d0 msgr2=0x7f78a4146300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:34.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.673+0000 7f78a9763640 1 --2- 172.21.15.31:0/2289508893 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78a40b80d0 0x7f78a4146300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.673+0000 7f78a9763640 1 -- 172.21.15.31:0/2289508893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78a414b4c0 msgr2=0x7f78a40b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:34.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.673+0000 7f78a9763640 1 --2- 172.21.15.31:0/2289508893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78a414b4c0 0x7f78a40b6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.673+0000 7f78a9763640 1 -- 172.21.15.31:0/2289508893 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a4147cd0 con 0x7f78a40b8be0 2024-04-15T00:21:34.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.673+0000 7f78a9763640 1 --2- 172.21.15.31:0/2289508893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78a40b8be0 0x7f78a41dd350 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f789400e9b0 tx=0x7f789400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:34.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.673+0000 7f789a7fc640 1 -- 172.21.15.31:0/2289508893 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7894017070 con 0x7f78a40b8be0 2024-04-15T00:21:34.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.673+0000 7f789a7fc640 1 -- 172.21.15.31:0/2289508893 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f789400c9a0 con 0x7f78a40b8be0 2024-04-15T00:21:34.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.673+0000 7f78ac1c8640 1 -- 172.21.15.31:0/2289508893 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78a41dd890 con 0x7f78a40b8be0 2024-04-15T00:21:34.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.673+0000 7f789a7fc640 1 -- 172.21.15.31:0/2289508893 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789400cd90 con 0x7f78a40b8be0 2024-04-15T00:21:34.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.673+0000 7f78ac1c8640 1 -- 172.21.15.31:0/2289508893 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78a40b2740 con 0x7f78a40b8be0 2024-04-15T00:21:34.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.674+0000 7f78ac1c8640 1 -- 172.21.15.31:0/2289508893 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78a40bd920 con 0x7f78a40b8be0 2024-04-15T00:21:34.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.675+0000 7f789a7fc640 1 -- 172.21.15.31:0/2289508893 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f789401a070 con 0x7f78a40b8be0 2024-04-15T00:21:34.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.675+0000 7f789a7fc640 1 --2- 172.21.15.31:0/2289508893 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f788806b990 0x7f788806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:34.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.675+0000 7f789a7fc640 1 -- 172.21.15.31:0/2289508893 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f789408ab30 con 0x7f78a40b8be0 2024-04-15T00:21:34.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.675+0000 7f78a9f64640 1 --2- 172.21.15.31:0/2289508893 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f788806b990 0x7f788806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:34.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.676+0000 7f78a9f64640 1 --2- 172.21.15.31:0/2289508893 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f788806b990 0x7f788806de50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f78a41d3d00 tx=0x7f78a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:34.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.679+0000 7f789a7fc640 1 -- 172.21.15.31:0/2289508893 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f78a4147cd0 con 0x7f78a40b8be0 2024-04-15T00:21:34.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.860+0000 7f78ac1c8640 1 -- 172.21.15.31:0/2289508893 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f78a40a2d90 con 0x7f78a40b8be0 2024-04-15T00:21:34.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.862+0000 7f789a7fc640 1 -- 172.21.15.31:0/2289508893 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7f7894059490 con 0x7f78a40b8be0 2024-04-15T00:21:34.869 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:21:34.869 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"fsid":"b57c03ab-2810-4ea5-b233-6164468328c0","created":"2024-04-15T00:20:44.073217+0000","modified":"2024-04-15T00:21:12.971956+0000","last_up_change":"2024-04-15T00:20:55.515596+0000","last_in_change":"2024-04-15T00:20:46.364541+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:20:56.423161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:21:06.436169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:21:06.888505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:21:10.610300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b085a2f4-5565-4ccc-a98e-e56180791550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6817","nonce":2355720818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6819","nonce":2355720818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6823","nonce":2355720818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6821","nonce":2355720818}]},"public_addr":"172.21.15.31:6817/2355720818","cluster_addr":"172.21.15.31:6819/2355720818","heartbeat_back_addr":"172.21.15.31:6823/2355720818","heartbeat_front_addr":"172.21.15.31:6821/2355720818","state":["exists","up"]},{"osd":1,"uuid":"0f751557-3f18-464f-8b78-614d19549f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6809","nonce":2705297130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6811","nonce":2705297130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6815","nonce":2705297130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6813","nonce":2705297130}]},"public_addr":"172.21.15.31:6809/2705297130","cluster_addr":"172.21.15.31:6811/2705297130","heartbeat_back_addr":"172.21.15.31:6815/2705297130","heartbeat_front_addr":"172.21.15.31:6813/2705297130","state":["exists","up"]},{"osd":2,"uuid":"17371b09-2bd7-4ef7-926f-e7706319f064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6801","nonce":225061474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6803","nonce":225061474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6807","nonce":225061474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6805","nonce":225061474}]},"public_addr":"172.21.15.31:6801/225061474","cluster_addr":"172.21.15.31:6803/225061474","heartbeat_back_addr":"172.21.15.31:6807/225061474","heartbeat_front_addr":"172.21.15.31:6805/225061474","state":["exists","up"]},{"osd":3,"uuid":"315b6949-f009-4291-9581-aa4912642dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6825","nonce":3722449780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6827","nonce":3722449780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6831","nonce":3722449780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6829","nonce":3722449780}]},"public_addr":"172.21.15.31:6825/3722449780","cluster_addr":"172.21.15.31:6827/3722449780","heartbeat_back_addr":"172.21.15.31:6831/3722449780","heartbeat_front_addr":"172.21.15.31:6829/3722449780","state":["exists","up"]},{"osd":4,"uuid":"e3659369-cc78-4aa8-bd10-a199d4a1569d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6801","nonce":1279970071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6803","nonce":1279970071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6807","nonce":1279970071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6805","nonce":1279970071}]},"public_addr":"172.21.15.50:6801/1279970071","cluster_addr":"172.21.15.50:6803/1279970071","heartbeat_back_addr":"172.21.15.50:6807/1279970071","heartbeat_front_addr":"172.21.15.50:6805/1279970071","state":["exists","up"]},{"osd":5,"uuid":"35c3a4c0-0b45-45d2-85b9-301c347602f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6809","nonce":1589417182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6811","nonce":1589417182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6815","nonce":1589417182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6813","nonce":1589417182}]},"public_addr":"172.21.15.50:6809/1589417182","cluster_addr":"172.21.15.50:6811/1589417182","heartbeat_back_addr":"172.21.15.50:6815/1589417182","heartbeat_front_addr":"172.21.15.50:6813/1589417182","state":["exists","up"]},{"osd":6,"uuid":"20df7a76-245f-4946-9624-6ca9e949227b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6817","nonce":682288274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6819","nonce":682288274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6823","nonce":682288274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6821","nonce":682288274}]},"public_addr":"172.21.15.50:6817/682288274","cluster_addr":"172.21.15.50:6819/682288274","heartbeat_back_addr":"172.21.15.50:6823/682288274","heartbeat_front_addr":"172.21.15.50:6821/682288274","state":["exists","up"]},{"osd":7,"uuid":"95a504b7-e13a-49e6-8484-9dff4d5fc048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6825","nonce":4129060906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6827","nonce":4129060906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6831","nonce":4129060906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6829","nonce":4129060906}]},"public_addr":"172.21.15.50:6825/4129060906","cluster_addr":"172.21.15.50:6827/4129060906","heartbeat_back_addr":"172.21.15.50:6831/4129060906","heartbeat_front_addr":"172.21.15.50:6829/4129060906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.501980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.529961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.540913+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.521396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.448364+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.514136+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.527229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.508950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:21:34.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.864+0000 7f78ac1c8640 1 -- 172.21.15.31:0/2289508893 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f788806b990 msgr2=0x7f788806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:34.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.864+0000 7f78ac1c8640 1 --2- 172.21.15.31:0/2289508893 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f788806b990 0x7f788806de50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f78a41d3d00 tx=0x7f78a0009040 comp rx=0 tx=0).stop 2024-04-15T00:21:34.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.864+0000 7f78ac1c8640 1 -- 172.21.15.31:0/2289508893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78a40b8be0 msgr2=0x7f78a41dd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:34.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.864+0000 7f78ac1c8640 1 --2- 172.21.15.31:0/2289508893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78a40b8be0 0x7f78a41dd350 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f789400e9b0 tx=0x7f789400ee70 comp rx=0 tx=0).stop 2024-04-15T00:21:34.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.864+0000 7f78ac1c8640 1 -- 172.21.15.31:0/2289508893 shutdown_connections 2024-04-15T00:21:34.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.864+0000 7f78ac1c8640 1 --2- 172.21.15.31:0/2289508893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78a414b4c0 0x7f78a40b6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.864+0000 7f78ac1c8640 1 --2- 172.21.15.31:0/2289508893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78a40b8be0 0x7f78a41dd350 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.864+0000 7f78ac1c8640 1 --2- 172.21.15.31:0/2289508893 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f788806b990 0x7f788806de50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.864+0000 7f78ac1c8640 1 --2- 172.21.15.31:0/2289508893 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f78a40b80d0 0x7f78a4146300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.864+0000 7f78ac1c8640 1 -- 172.21.15.31:0/2289508893 >> 172.21.15.31:0/2289508893 conn(0x7f78a40bd020 msgr2=0x7f78a40b9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:34.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.864+0000 7f78ac1c8640 1 -- 172.21.15.31:0/2289508893 shutdown_connections 2024-04-15T00:21:34.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.864+0000 7f78ac1c8640 1 -- 172.21.15.31:0/2289508893 wait complete. 2024-04-15T00:21:34.883 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T00:21:34.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.978+0000 7fa3a91cc640 1 Processor -- start 2024-04-15T00:21:34.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.978+0000 7fa3a91cc640 1 -- start start 2024-04-15T00:21:34.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.979+0000 7fa3a91cc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa3a414b8e0 0x7fa3a40b9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:34.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.979+0000 7fa3a91cc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa3a40b8bf0 0x7fa3a4151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:34.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.979+0000 7fa3a91cc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3a40bb2d0 con 0x7fa3a40baef0 2024-04-15T00:21:34.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.979+0000 7fa3a91cc640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fa3a414ae00 con 0x7fa3a40b8bf0 2024-04-15T00:21:34.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.979+0000 7fa3a91cc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fa3a414b0e0 con 0x7fa3a414b8e0 2024-04-15T00:21:34.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.979+0000 7fa3a359e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa3a40b8bf0 0x7fa3a4151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:34.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.979+0000 7fa3a359e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa3a40b8bf0 0x7fa3a4151ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35802/0 (socket says 172.21.15.31:35802) 2024-04-15T00:21:34.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.979+0000 7fa3a359e640 1 -- 172.21.15.31:0/4019014761 learned_addr learned my addr 172.21.15.31:0/4019014761 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:34.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.979+0000 7fa3a259c640 1 --2- 172.21.15.31:0/4019014761 >> v2:172.21.15.50:3300/0 conn(0x7fa3a414b8e0 0x7fa3a40b9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:34.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.979+0000 7fa3a359e640 1 -- 172.21.15.31:0/4019014761 >> v2:172.21.15.50:3300/0 conn(0x7fa3a414b8e0 msgr2=0x7fa3a40b9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:34.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.979+0000 7fa3a359e640 1 --2- 172.21.15.31:0/4019014761 >> v2:172.21.15.50:3300/0 conn(0x7fa3a414b8e0 0x7fa3a40b9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.979+0000 7fa3a359e640 1 -- 172.21.15.31:0/4019014761 >> v1:172.21.15.50:6789/0 conn(0x7fa3a40baef0 legacy=0x7fa3a4147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:34.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.979+0000 7fa3a359e640 1 -- 172.21.15.31:0/4019014761 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a40bcbb0 con 0x7fa3a40b8bf0 2024-04-15T00:21:34.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.980+0000 7fa3a359e640 1 --2- 172.21.15.31:0/4019014761 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3a40b8bf0 0x7fa3a4151ff0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa3a40737c0 tx=0x7fa39402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56310ab202a78c76 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:34.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.980+0000 7fa3a1d9b640 1 -- 172.21.15.31:0/4019014761 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39402ca80 con 0x7fa3a40b8bf0 2024-04-15T00:21:34.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.980+0000 7fa3a1d9b640 1 -- 172.21.15.31:0/4019014761 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa39402cc20 con 0x7fa3a40b8bf0 2024-04-15T00:21:34.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.980+0000 7fa3a1d9b640 1 -- 172.21.15.31:0/4019014761 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3940343f0 con 0x7fa3a40b8bf0 2024-04-15T00:21:34.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.981+0000 7fa3a91cc640 1 -- 172.21.15.31:0/4019014761 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3a40b8bf0 msgr2=0x7fa3a4151ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:34.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.981+0000 7fa3a91cc640 1 --2- 172.21.15.31:0/4019014761 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3a40b8bf0 0x7fa3a4151ff0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa3a40737c0 tx=0x7fa39402bee0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.981+0000 7fa3a91cc640 1 -- 172.21.15.31:0/4019014761 shutdown_connections 2024-04-15T00:21:34.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.981+0000 7fa3a91cc640 1 --2- 172.21.15.31:0/4019014761 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3a40b8bf0 0x7fa3a4151ff0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.981+0000 7fa3a91cc640 1 --2- 172.21.15.31:0/4019014761 >> v2:172.21.15.50:3300/0 conn(0x7fa3a414b8e0 0x7fa3a40b9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.981+0000 7fa3a91cc640 1 -- 172.21.15.31:0/4019014761 >> 172.21.15.31:0/4019014761 conn(0x7fa3a409ed70 msgr2=0x7fa3a409f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:34.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.981+0000 7fa3a91cc640 1 -- 172.21.15.31:0/4019014761 shutdown_connections 2024-04-15T00:21:34.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.981+0000 7fa3a91cc640 1 -- 172.21.15.31:0/4019014761 wait complete. 2024-04-15T00:21:34.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.982+0000 7fa3a91cc640 1 Processor -- start 2024-04-15T00:21:34.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.982+0000 7fa3a91cc640 1 -- start start 2024-04-15T00:21:34.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.983+0000 7fa3a91cc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3a40b8bf0 0x7fa3a41e0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:34.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.983+0000 7fa3a91cc640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3a40baef0 0x7fa3a41d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:34.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.983+0000 7fa3a91cc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a414b8e0 0x7fa3a4143a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:34.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.983+0000 7fa3a91cc640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a40b9180 con 0x7fa3a40b8bf0 2024-04-15T00:21:34.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.983+0000 7fa3a91cc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a40b9000 con 0x7fa3a414b8e0 2024-04-15T00:21:34.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.983+0000 7fa3a91cc640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fa3a40b9300 con 0x7fa3a40baef0 2024-04-15T00:21:34.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.983+0000 7fa3a2d9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3a40b8bf0 0x7fa3a41e0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:34.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.983+0000 7fa3a2d9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3a40b8bf0 0x7fa3a41e0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35808/0 (socket says 172.21.15.31:35808) 2024-04-15T00:21:34.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.983+0000 7fa3a2d9d640 1 -- 172.21.15.31:0/741291993 learned_addr learned my addr 172.21.15.31:0/741291993 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:34.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.983+0000 7fa3a359e640 1 --2- 172.21.15.31:0/741291993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a414b8e0 0x7fa3a4143a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:34.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.983+0000 7fa3a259c640 1 --2- 172.21.15.31:0/741291993 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3a40baef0 0x7fa3a41d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:34.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.983+0000 7fa3a2d9d640 1 -- 172.21.15.31:0/741291993 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3a40baef0 msgr2=0x7fa3a41d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:34.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.983+0000 7fa3a2d9d640 1 --2- 172.21.15.31:0/741291993 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3a40baef0 0x7fa3a41d14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.983+0000 7fa3a2d9d640 1 -- 172.21.15.31:0/741291993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a414b8e0 msgr2=0x7fa3a4143a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:34.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.983+0000 7fa3a2d9d640 1 --2- 172.21.15.31:0/741291993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a414b8e0 0x7fa3a4143a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:34.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.983+0000 7fa3a2d9d640 1 -- 172.21.15.31:0/741291993 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a41e02e0 con 0x7fa3a40b8bf0 2024-04-15T00:21:34.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.983+0000 7fa3a2d9d640 1 --2- 172.21.15.31:0/741291993 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3a40b8bf0 0x7fa3a41e0dc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00c430 tx=0x7fa39c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:34.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.983+0000 7fa39b7fe640 1 -- 172.21.15.31:0/741291993 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39c0052d0 con 0x7fa3a40b8bf0 2024-04-15T00:21:34.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.983+0000 7fa39b7fe640 1 -- 172.21.15.31:0/741291993 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa39c005490 con 0x7fa3a40b8bf0 2024-04-15T00:21:34.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.983+0000 7fa3a91cc640 1 -- 172.21.15.31:0/741291993 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3a41e05c0 con 0x7fa3a40b8bf0 2024-04-15T00:21:34.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.983+0000 7fa39b7fe640 1 -- 172.21.15.31:0/741291993 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39c007260 con 0x7fa3a40b8bf0 2024-04-15T00:21:34.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.983+0000 7fa3a91cc640 1 -- 172.21.15.31:0/741291993 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3a41d3410 con 0x7fa3a40b8bf0 2024-04-15T00:21:34.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.984+0000 7fa3a91cc640 1 -- 172.21.15.31:0/741291993 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3a404f620 con 0x7fa3a40b8bf0 2024-04-15T00:21:34.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.985+0000 7fa39b7fe640 1 -- 172.21.15.31:0/741291993 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fa39c007400 con 0x7fa3a40b8bf0 2024-04-15T00:21:34.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.985+0000 7fa39b7fe640 1 --2- 172.21.15.31:0/741291993 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fa38406b990 0x7fa38406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:34.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.986+0000 7fa39b7fe640 1 -- 172.21.15.31:0/741291993 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa39c089ff0 con 0x7fa3a40b8bf0 2024-04-15T00:21:34.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.985+0000 7fa3a259c640 1 --2- 172.21.15.31:0/741291993 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fa38406b990 0x7fa38406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:34.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.986+0000 7fa3a259c640 1 --2- 172.21.15.31:0/741291993 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fa38406b990 0x7fa38406de50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa3a41474e0 tx=0x7fa38c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:34.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:34.990+0000 7fa39b7fe640 1 -- 172.21.15.31:0/741291993 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa39c058280 con 0x7fa3a40b8bf0 2024-04-15T00:21:35.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.209+0000 7fa3a91cc640 1 -- 172.21.15.31:0/741291993 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3a4149410 con 0x7fa3a40b8bf0 2024-04-15T00:21:35.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.210+0000 7fa39b7fe640 1 -- 172.21.15.31:0/741291993 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3520 (secure 0 0 0) 0x7fa39c05c320 con 0x7fa3a40b8bf0 2024-04-15T00:21:35.217 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:21:35.218 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/921487249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":921487249},{"type":"v1","addr":"172.21.15.50:6833","nonce":921487249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T00:21:07.925196+0000","modified":"2024-04-15T00:21:23.993707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/93464605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":93464605},{"type":"v1","addr":"172.21.15.31:6835","nonce":93464605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-04-15T00:21:35.218 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-04-15T00:21:35.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.212+0000 7fa3a91cc640 1 -- 172.21.15.31:0/741291993 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fa38406b990 msgr2=0x7fa38406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:35.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.212+0000 7fa3a91cc640 1 --2- 172.21.15.31:0/741291993 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fa38406b990 0x7fa38406de50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa3a41474e0 tx=0x7fa38c008040 comp rx=0 tx=0).stop 2024-04-15T00:21:35.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.212+0000 7fa3a91cc640 1 -- 172.21.15.31:0/741291993 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3a40b8bf0 msgr2=0x7fa3a41e0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:35.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.212+0000 7fa3a91cc640 1 --2- 172.21.15.31:0/741291993 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3a40b8bf0 0x7fa3a41e0dc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00c430 tx=0x7fa39c00c8f0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.212+0000 7fa3a91cc640 1 -- 172.21.15.31:0/741291993 shutdown_connections 2024-04-15T00:21:35.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.212+0000 7fa3a91cc640 1 --2- 172.21.15.31:0/741291993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a414b8e0 0x7fa3a4143a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.212+0000 7fa3a91cc640 1 --2- 172.21.15.31:0/741291993 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fa38406b990 0x7fa38406de50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.212+0000 7fa3a91cc640 1 --2- 172.21.15.31:0/741291993 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fa3a40baef0 0x7fa3a41d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.212+0000 7fa3a91cc640 1 --2- 172.21.15.31:0/741291993 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3a40b8bf0 0x7fa3a41e0dc0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.212+0000 7fa3a91cc640 1 -- 172.21.15.31:0/741291993 >> 172.21.15.31:0/741291993 conn(0x7fa3a409ed70 msgr2=0x7fa3a409bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:35.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.212+0000 7fa3a91cc640 1 -- 172.21.15.31:0/741291993 shutdown_connections 2024-04-15T00:21:35.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.212+0000 7fa3a91cc640 1 -- 172.21.15.31:0/741291993 wait complete. 2024-04-15T00:21:35.431 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-15T00:21:07.925196+0000', 'modified': '2024-04-15T00:21:23.993707+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4272': {'gid': 4272, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6835/93464605', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6834', 'nonce': 93464605}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 93464605}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4272, 'qdb_cluster': [4272]} 2024-04-15T00:21:35.432 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-15T00:21:35.432 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-15T00:21:35.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.527+0000 7f04d211e640 1 Processor -- start 2024-04-15T00:21:35.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.528+0000 7f04d211e640 1 -- start start 2024-04-15T00:21:35.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.528+0000 7f04d211e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f04cc0b80d0 0x7f04cc072570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:35.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.528+0000 7f04d211e640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04cc14b4c0 0x7f04cc1449c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:35.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.528+0000 7f04d211e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04cc072c90 con 0x7f04cc0b8be0 2024-04-15T00:21:35.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.528+0000 7f04d211e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f04cc09c0e0 con 0x7f04cc0b80d0 2024-04-15T00:21:35.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.528+0000 7f04d211e640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f04cc0b84b0 con 0x7f04cc14b4c0 2024-04-15T00:21:35.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.528+0000 7f04cb7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f04cc0b80d0 0x7f04cc072570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:35.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.528+0000 7f04cb7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f04cc0b80d0 0x7f04cc072570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35818/0 (socket says 172.21.15.31:35818) 2024-04-15T00:21:35.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.528+0000 7f04cb7fe640 1 -- 172.21.15.31:0/1377153485 learned_addr learned my addr 172.21.15.31:0/1377153485 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:35.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.528+0000 7f04cbfff640 1 --2- 172.21.15.31:0/1377153485 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04cc14b4c0 0x7f04cc1449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:35.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.529+0000 7f04cb7fe640 1 -- 172.21.15.31:0/1377153485 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04cc14b4c0 msgr2=0x7f04cc1449c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:35.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.529+0000 7f04cb7fe640 1 --2- 172.21.15.31:0/1377153485 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04cc14b4c0 0x7f04cc1449c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.529+0000 7f04cb7fe640 1 -- 172.21.15.31:0/1377153485 >> v1:172.21.15.50:6789/0 conn(0x7f04cc0b8be0 legacy=0x7f04cc14adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:35.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.529+0000 7f04cb7fe640 1 -- 172.21.15.31:0/1377153485 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04cc09c380 con 0x7f04cc0b80d0 2024-04-15T00:21:35.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.529+0000 7f04cbfff640 1 --2- 172.21.15.31:0/1377153485 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04cc14b4c0 0x7f04cc1449c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:21:35.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.529+0000 7f04cb7fe640 1 --2- 172.21.15.31:0/1377153485 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04cc0b80d0 0x7f04cc072570 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f04bc009870 tx=0x7f04bc02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b14acd2889e28e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:35.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.529+0000 7f04ca7fc640 1 -- 172.21.15.31:0/1377153485 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc0317c0 con 0x7f04cc0b80d0 2024-04-15T00:21:35.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.530+0000 7f04ca7fc640 1 -- 172.21.15.31:0/1377153485 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04bc037070 con 0x7f04cc0b80d0 2024-04-15T00:21:35.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.530+0000 7f04ca7fc640 1 -- 172.21.15.31:0/1377153485 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc031b80 con 0x7f04cc0b80d0 2024-04-15T00:21:35.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.530+0000 7f04d211e640 1 -- 172.21.15.31:0/1377153485 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04cc0b80d0 msgr2=0x7f04cc072570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:35.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.530+0000 7f04d211e640 1 --2- 172.21.15.31:0/1377153485 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04cc0b80d0 0x7f04cc072570 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f04bc009870 tx=0x7f04bc02b860 comp rx=0 tx=0).stop 2024-04-15T00:21:35.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.530+0000 7f04d211e640 1 -- 172.21.15.31:0/1377153485 shutdown_connections 2024-04-15T00:21:35.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.530+0000 7f04d211e640 1 --2- 172.21.15.31:0/1377153485 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04cc14b4c0 0x7f04cc1449c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.530+0000 7f04d211e640 1 --2- 172.21.15.31:0/1377153485 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04cc0b80d0 0x7f04cc072570 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.530+0000 7f04d211e640 1 -- 172.21.15.31:0/1377153485 >> 172.21.15.31:0/1377153485 conn(0x7f04cc0bd020 msgr2=0x7f04cc0bd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:35.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.530+0000 7f04d211e640 1 -- 172.21.15.31:0/1377153485 shutdown_connections 2024-04-15T00:21:35.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.530+0000 7f04d211e640 1 -- 172.21.15.31:0/1377153485 wait complete. 2024-04-15T00:21:35.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.531+0000 7f04d211e640 1 Processor -- start 2024-04-15T00:21:35.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.531+0000 7f04d211e640 1 -- start start 2024-04-15T00:21:35.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.532+0000 7f04d211e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04cc0b80d0 0x7f04cc0b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:35.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.532+0000 7f04d211e640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04cc0b8be0 0x7f04cc1470e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:35.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.532+0000 7f04d211e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04cc14b4c0 0x7f04cc147620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:35.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.532+0000 7f04d211e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc145080 con 0x7f04cc0b80d0 2024-04-15T00:21:35.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.532+0000 7f04d211e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc144f00 con 0x7f04cc14b4c0 2024-04-15T00:21:35.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.532+0000 7f04d211e640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f04cc145200 con 0x7f04cc0b8be0 2024-04-15T00:21:35.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.532+0000 7f04cb7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04cc0b80d0 0x7f04cc0b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:35.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.532+0000 7f04cb7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04cc0b80d0 0x7f04cc0b2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35832/0 (socket says 172.21.15.31:35832) 2024-04-15T00:21:35.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.532+0000 7f04cb7fe640 1 -- 172.21.15.31:0/69052429 learned_addr learned my addr 172.21.15.31:0/69052429 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:35.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.532+0000 7f04cbfff640 1 --2- 172.21.15.31:0/69052429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04cc14b4c0 0x7f04cc147620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:35.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.532+0000 7f04caffd640 1 --2- 172.21.15.31:0/69052429 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04cc0b8be0 0x7f04cc1470e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:35.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.532+0000 7f04cb7fe640 1 -- 172.21.15.31:0/69052429 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04cc0b8be0 msgr2=0x7f04cc1470e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:35.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.532+0000 7f04cb7fe640 1 --2- 172.21.15.31:0/69052429 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04cc0b8be0 0x7f04cc1470e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.532+0000 7f04cb7fe640 1 -- 172.21.15.31:0/69052429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04cc14b4c0 msgr2=0x7f04cc147620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:35.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.532+0000 7f04cb7fe640 1 --2- 172.21.15.31:0/69052429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04cc14b4c0 0x7f04cc147620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.532+0000 7f04cb7fe640 1 -- 172.21.15.31:0/69052429 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04cc09fe40 con 0x7f04cc0b80d0 2024-04-15T00:21:35.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.532+0000 7f04caffd640 1 --2- 172.21.15.31:0/69052429 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04cc0b8be0 0x7f04cc1470e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:21:35.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.532+0000 7f04cb7fe640 1 --2- 172.21.15.31:0/69052429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04cc0b80d0 0x7f04cc0b2e70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f04bc02b8a0 tx=0x7f04bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:35.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.533+0000 7f04b3fff640 1 -- 172.21.15.31:0/69052429 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc032860 con 0x7f04cc0b80d0 2024-04-15T00:21:35.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.533+0000 7f04b3fff640 1 -- 172.21.15.31:0/69052429 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04bc032a00 con 0x7f04cc0b80d0 2024-04-15T00:21:35.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.533+0000 7f04d211e640 1 -- 172.21.15.31:0/69052429 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04cc146c30 con 0x7f04cc0b80d0 2024-04-15T00:21:35.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.533+0000 7f04b3fff640 1 -- 172.21.15.31:0/69052429 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc032df0 con 0x7f04cc0b80d0 2024-04-15T00:21:35.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.533+0000 7f04d211e640 1 -- 172.21.15.31:0/69052429 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04cc0b0a40 con 0x7f04cc0b80d0 2024-04-15T00:21:35.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.534+0000 7f04b3fff640 1 -- 172.21.15.31:0/69052429 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f04bc04c060 con 0x7f04cc0b80d0 2024-04-15T00:21:35.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.535+0000 7f04b3fff640 1 --2- 172.21.15.31:0/69052429 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f04b806b990 0x7f04b806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:35.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.535+0000 7f04b3fff640 1 -- 172.21.15.31:0/69052429 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f04bc0ac930 con 0x7f04cc0b80d0 2024-04-15T00:21:35.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.535+0000 7f04caffd640 1 --2- 172.21.15.31:0/69052429 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f04b806b990 0x7f04b806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:35.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.535+0000 7f04caffd640 1 --2- 172.21.15.31:0/69052429 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f04b806b990 0x7f04b806de50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f04cc146ae0 tx=0x7f04c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:35.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.535+0000 7f04d4fef740 1 Processor -- start 2024-04-15T00:21:35.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.536+0000 7f04d4fef740 1 -- start start 2024-04-15T00:21:35.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.536+0000 7f04d4fef740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559dd835f060 0x559dd838e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:35.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.536+0000 7f04d4fef740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559dd838eac0 0x559dd8387520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:35.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.536+0000 7f04d4fef740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559dd8387a60 0x559dd8387ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:35.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.536+0000 7f04d4fef740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559dd82c3f80 con 0x559dd835f060 2024-04-15T00:21:35.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.536+0000 7f04d4fef740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559dd826c9a0 con 0x559dd8387a60 2024-04-15T00:21:35.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.536+0000 7f04d4fef740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x559dd82bff30 con 0x559dd838eac0 2024-04-15T00:21:35.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.536+0000 7f04cb7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559dd835f060 0x559dd838e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:35.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.536+0000 7f04cb7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559dd835f060 0x559dd838e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35836/0 (socket says 172.21.15.31:35836) 2024-04-15T00:21:35.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.536+0000 7f04cb7fe640 1 -- 172.21.15.31:0/1572697977 learned_addr learned my addr 172.21.15.31:0/1572697977 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:35.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.537+0000 7f04cb7fe640 1 -- 172.21.15.31:0/1572697977 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559dd838eac0 msgr2=0x559dd8387520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:35.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.537+0000 7f04cb7fe640 1 --2- 172.21.15.31:0/1572697977 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559dd838eac0 0x559dd8387520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.537+0000 7f04cb7fe640 1 -- 172.21.15.31:0/1572697977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559dd8387a60 msgr2=0x559dd8387ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:35.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.537+0000 7f04cb7fe640 1 --2- 172.21.15.31:0/1572697977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559dd8387a60 0x559dd8387ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.537+0000 7f04cb7fe640 1 -- 172.21.15.31:0/1572697977 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dd828d480 con 0x559dd835f060 2024-04-15T00:21:35.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.537+0000 7f04cb7fe640 1 --2- 172.21.15.31:0/1572697977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559dd835f060 0x559dd838e580 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f04bc07abd0 tx=0x7f04bc03e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=679cfa66c78487a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:35.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.537+0000 7f04b17fa640 1 -- 172.21.15.31:0/1572697977 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc07ece0 con 0x559dd835f060 2024-04-15T00:21:35.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.537+0000 7f04b17fa640 1 -- 172.21.15.31:0/1572697977 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04bc037020 con 0x559dd835f060 2024-04-15T00:21:35.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.537+0000 7f04b17fa640 1 -- 172.21.15.31:0/1572697977 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc083510 con 0x559dd835f060 2024-04-15T00:21:35.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.537+0000 7f04d4fef740 1 -- 172.21.15.31:0/1572697977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559dd835f060 msgr2=0x559dd838e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:35.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.537+0000 7f04d4fef740 1 --2- 172.21.15.31:0/1572697977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559dd835f060 0x559dd838e580 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f04bc07abd0 tx=0x7f04bc03e000 comp rx=0 tx=0).stop 2024-04-15T00:21:35.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.538+0000 7f04d4fef740 1 -- 172.21.15.31:0/1572697977 shutdown_connections 2024-04-15T00:21:35.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.538+0000 7f04d4fef740 1 --2- 172.21.15.31:0/1572697977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559dd8387a60 0x559dd8387ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.538+0000 7f04d4fef740 1 --2- 172.21.15.31:0/1572697977 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559dd838eac0 0x559dd8387520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.538+0000 7f04d4fef740 1 --2- 172.21.15.31:0/1572697977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559dd835f060 0x559dd838e580 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.538+0000 7f04d4fef740 1 -- 172.21.15.31:0/1572697977 >> 172.21.15.31:0/1572697977 conn(0x559dd835c630 msgr2=0x559dd835e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:35.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.538+0000 7f04d4fef740 1 -- 172.21.15.31:0/1572697977 shutdown_connections 2024-04-15T00:21:35.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.538+0000 7f04d4fef740 1 -- 172.21.15.31:0/1572697977 wait complete. 2024-04-15T00:21:35.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.538+0000 7f04d4fef740 1 -- start start 2024-04-15T00:21:35.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.538+0000 7f04d4fef740 1 Processor -- start 2024-04-15T00:21:35.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.539+0000 7f04d4fef740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559dd8387a60 0x559dd8384610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:35.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.539+0000 7f04d4fef740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559dd838eac0 0x559dd83a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:35.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.539+0000 7f04d4fef740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559dd838b880 0x559dd83a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:35.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.539+0000 7f04d4fef740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559dd82bff30 con 0x559dd838b880 2024-04-15T00:21:35.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.539+0000 7f04d4fef740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559dd827ff40 con 0x559dd838eac0 2024-04-15T00:21:35.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.539+0000 7f04d4fef740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x559dd82c3f80 con 0x559dd8387a60 2024-04-15T00:21:35.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.539+0000 7f04d4fef740 10 client.0 _ll_register_callbacks cb 0x559dd827a9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-15T00:21:35.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.539+0000 7f04cbfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559dd838b880 0x559dd83a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:35.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.539+0000 7f04cbfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559dd838b880 0x559dd83a1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35850/0 (socket says 172.21.15.31:35850) 2024-04-15T00:21:35.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.539+0000 7f04cbfff640 1 -- 172.21.15.31:0/676249940 learned_addr learned my addr 172.21.15.31:0/676249940 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:35.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.539+0000 7f04caffd640 1 --2- 172.21.15.31:0/676249940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559dd838eac0 0x559dd83a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:35.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.539+0000 7f04cb7fe640 1 --2- 172.21.15.31:0/676249940 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559dd8387a60 0x559dd8384610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:35.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.539+0000 7f04cbfff640 1 -- 172.21.15.31:0/676249940 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559dd8387a60 msgr2=0x559dd8384610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:35.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.539+0000 7f04cbfff640 1 --2- 172.21.15.31:0/676249940 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559dd8387a60 0x559dd8384610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.539+0000 7f04cbfff640 1 -- 172.21.15.31:0/676249940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559dd838eac0 msgr2=0x559dd83a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:35.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.539+0000 7f04cbfff640 1 --2- 172.21.15.31:0/676249940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559dd838eac0 0x559dd83a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.539+0000 7f04cbfff640 1 -- 172.21.15.31:0/676249940 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559dd7fd82d0 con 0x559dd838b880 2024-04-15T00:21:35.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.539+0000 7f04cbfff640 1 --2- 172.21.15.31:0/676249940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559dd838b880 0x559dd83a1de0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f04c400eb10 tx=0x7f04c400c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2116b2e3ae1ac580 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:35.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.539+0000 7f04aa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-04-15T00:21:35.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.540+0000 7f04aa7fc640 1 -- 172.21.15.31:0/676249940 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c400a410 con 0x559dd838b880 2024-04-15T00:21:35.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.540+0000 7f04aa7fc640 1 -- 172.21.15.31:0/676249940 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f04c400a5b0 con 0x559dd838b880 2024-04-15T00:21:35.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.540+0000 7f04d4fef740 1 -- 172.21.15.31:0/676249940 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04bc037020 con 0x559dd838b880 2024-04-15T00:21:35.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.540+0000 7f04aa7fc640 1 -- 172.21.15.31:0/676249940 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f04c4022050 con 0x559dd838b880 2024-04-15T00:21:35.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.540+0000 7f04d4fef740 10 client.4833 fetch_fsmap learned FSMap version 8 2024-04-15T00:21:35.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.540+0000 7f04d4fef740 1 -- 172.21.15.31:0/676249940 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x559dd80a26b0 con 0x559dd838b880 2024-04-15T00:21:35.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.540+0000 7f04aa7fc640 1 -- 172.21.15.31:0/676249940 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04bc037020 con 0x559dd838b880 2024-04-15T00:21:35.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.540+0000 7f04aa7fc640 1 -- 172.21.15.31:0/676249940 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 8) ==== 2292+0+0 (secure 0 0 0) 0x7f04c4025020 con 0x559dd838b880 2024-04-15T00:21:35.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.540+0000 7f04d4fef740 10 client.4833 fetch_fsmap finished waiting for FSMap version 8 2024-04-15T00:21:35.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.540+0000 7f04d4fef740 10 client.4833 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-15T00:21:35.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.540+0000 7f04d4fef740 20 client.4833 populate_metadata read hostname 'smithi031' 2024-04-15T00:21:35.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.540+0000 7f04d4fef740 1 --2- 172.21.15.31:0/676249940 >> [v2:172.21.15.31:6834/93464605,v1:172.21.15.31:6835/93464605] conn(0x559dd8381040 0x559dd8381420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:35.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.540+0000 7f04d4fef740 4 client.4833 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-15T00:21:35.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.540+0000 7f04d4fef740 1 -- 172.21.15.31:0/676249940 --> [v2:172.21.15.31:6834/93464605,v1:172.21.15.31:6835/93464605] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559dd82d14c0 con 0x559dd8381040 2024-04-15T00:21:35.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.540+0000 7f04cb7fe640 1 --2- 172.21.15.31:0/676249940 >> [v2:172.21.15.31:6834/93464605,v1:172.21.15.31:6835/93464605] conn(0x559dd8381040 0x559dd8381420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:35.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.541+0000 7f04aa7fc640 10 client.4833 ms_handle_connect on v2:172.21.15.31:6834/93464605 2024-04-15T00:21:35.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.541+0000 7f04cb7fe640 1 --2- 172.21.15.31:0/676249940 >> [v2:172.21.15.31:6834/93464605,v1:172.21.15.31:6835/93464605] conn(0x559dd8381040 0x559dd8381420 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9106ef3f78710729 server_cookie=7c3437f71fbd9bb1 in_seq=0 out_seq=0 2024-04-15T00:21:35.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.541+0000 7f04aa7fc640 1 -- 172.21.15.31:0/676249940 <== mds.0 v2:172.21.15.31:6834/93464605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559dd82d14c0 con 0x559dd8381040 2024-04-15T00:21:35.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.541+0000 7f04aa7fc640 10 client.4833 handle_command_reply: tid=0 2024-04-15T00:21:35.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.541+0000 7f04d4fef740 1 client.4833 shutdown 2024-04-15T00:21:35.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.541+0000 7f04d4fef740 1 -- 172.21.15.31:0/676249940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559dd838b880 msgr2=0x559dd83a1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:35.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.541+0000 7f04d4fef740 1 --2- 172.21.15.31:0/676249940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559dd838b880 0x559dd83a1de0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f04c400eb10 tx=0x7f04c400c3c0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.541+0000 7f04d4fef740 1 -- 172.21.15.31:0/676249940 shutdown_connections 2024-04-15T00:21:35.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.541+0000 7f04d4fef740 1 --2- 172.21.15.31:0/676249940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559dd838b880 0x559dd83a1de0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.541+0000 7f04d4fef740 1 --2- 172.21.15.31:0/676249940 >> [v2:172.21.15.31:6834/93464605,v1:172.21.15.31:6835/93464605] conn(0x559dd8381040 0x559dd8381420 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.541+0000 7f04d4fef740 1 --2- 172.21.15.31:0/676249940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559dd838eac0 0x559dd83a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.541+0000 7f04d4fef740 1 --2- 172.21.15.31:0/676249940 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559dd8387a60 0x559dd8384610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.541+0000 7f04d4fef740 1 -- 172.21.15.31:0/676249940 >> 172.21.15.31:0/676249940 conn(0x559dd835f060 msgr2=0x559dd8359680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:35.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.541+0000 7f04aa7fc640 0 client.4833 ms_handle_reset on v2:172.21.15.31:6834/93464605 2024-04-15T00:21:35.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.541+0000 7f04d4fef740 1 -- 172.21.15.31:0/676249940 shutdown_connections 2024-04-15T00:21:35.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.541+0000 7f04d4fef740 1 -- 172.21.15.31:0/676249940 wait complete. 2024-04-15T00:21:35.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.542+0000 7f04d4fef740 20 client.4833 trim_cache size 0 max 16384 2024-04-15T00:21:35.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.560+0000 7f04d4fef740 1 Processor -- start 2024-04-15T00:21:35.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.560+0000 7f04d4fef740 1 -- start start 2024-04-15T00:21:35.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.560+0000 7f04d4fef740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559dd8387a60 0x559dd8359870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:35.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.560+0000 7f04d4fef740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559dd838b880 0x559dd838aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:35.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.560+0000 7f04d4fef740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559dd838eac0 0x559dd83b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:35.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.560+0000 7f04d4fef740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc1eb070 con 0x559dd8387a60 2024-04-15T00:21:35.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.560+0000 7f04d4fef740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc1ea210 con 0x559dd838b880 2024-04-15T00:21:35.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.560+0000 7f04d4fef740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x559dd826c9a0 con 0x559dd838eac0 2024-04-15T00:21:35.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.560+0000 7f04cb7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559dd8387a60 0x559dd8359870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:35.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.560+0000 7f04cb7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559dd8387a60 0x559dd8359870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35854/0 (socket says 172.21.15.31:35854) 2024-04-15T00:21:35.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.560+0000 7f04cb7fe640 1 -- 172.21.15.31:0/2094231851 learned_addr learned my addr 172.21.15.31:0/2094231851 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:35.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.561+0000 7f04cbfff640 1 --2- 172.21.15.31:0/2094231851 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559dd838eac0 0x559dd83b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:35.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.561+0000 7f04caffd640 1 --2- 172.21.15.31:0/2094231851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559dd838b880 0x559dd838aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:35.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.561+0000 7f04cb7fe640 1 -- 172.21.15.31:0/2094231851 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559dd838eac0 msgr2=0x559dd83b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:35.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.561+0000 7f04cb7fe640 1 --2- 172.21.15.31:0/2094231851 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559dd838eac0 0x559dd83b21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.561+0000 7f04cb7fe640 1 -- 172.21.15.31:0/2094231851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559dd838b880 msgr2=0x559dd838aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:35.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.561+0000 7f04cb7fe640 1 --2- 172.21.15.31:0/2094231851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559dd838b880 0x559dd838aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.561+0000 7f04cb7fe640 1 -- 172.21.15.31:0/2094231851 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dd838c860 con 0x559dd8387a60 2024-04-15T00:21:35.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.561+0000 7f04cbfff640 1 --2- 172.21.15.31:0/2094231851 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559dd838eac0 0x559dd83b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:35.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.561+0000 7f04caffd640 1 --2- 172.21.15.31:0/2094231851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559dd838b880 0x559dd838aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:21:35.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.561+0000 7f04cb7fe640 1 --2- 172.21.15.31:0/2094231851 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559dd8387a60 0x559dd8359870 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f04bc0aac00 tx=0x7f04bc07d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d297bade84992ed server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:35.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.561+0000 7f04b0ff9640 1 -- 172.21.15.31:0/2094231851 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc07ece0 con 0x559dd8387a60 2024-04-15T00:21:35.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.561+0000 7f04b0ff9640 1 -- 172.21.15.31:0/2094231851 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04bc037040 con 0x559dd8387a60 2024-04-15T00:21:35.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.561+0000 7f04b0ff9640 1 -- 172.21.15.31:0/2094231851 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc0810b0 con 0x559dd8387a60 2024-04-15T00:21:35.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.562+0000 7f04d4fef740 1 -- 172.21.15.31:0/2094231851 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559dd8387a60 msgr2=0x559dd8359870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:35.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.562+0000 7f04d4fef740 1 --2- 172.21.15.31:0/2094231851 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559dd8387a60 0x559dd8359870 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f04bc0aac00 tx=0x7f04bc07d000 comp rx=0 tx=0).stop 2024-04-15T00:21:35.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.562+0000 7f04d4fef740 1 -- 172.21.15.31:0/2094231851 shutdown_connections 2024-04-15T00:21:35.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.562+0000 7f04d4fef740 1 --2- 172.21.15.31:0/2094231851 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559dd838eac0 0x559dd83b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.562+0000 7f04d4fef740 1 --2- 172.21.15.31:0/2094231851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559dd838b880 0x559dd838aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.562+0000 7f04d4fef740 1 --2- 172.21.15.31:0/2094231851 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559dd8387a60 0x559dd8359870 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.562+0000 7f04d4fef740 1 -- 172.21.15.31:0/2094231851 >> 172.21.15.31:0/2094231851 conn(0x559dd835f060 msgr2=0x559dd835e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:35.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.562+0000 7f04d4fef740 1 -- 172.21.15.31:0/2094231851 shutdown_connections 2024-04-15T00:21:35.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.562+0000 7f04d4fef740 1 -- 172.21.15.31:0/2094231851 wait complete. 2024-04-15T00:21:35.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.562+0000 7f04d4fef740 1 -- start start 2024-04-15T00:21:35.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.562+0000 7f04d4fef740 1 Processor -- start 2024-04-15T00:21:35.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.563+0000 7f04d4fef740 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559dd8387a60 0x559dd840c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:35.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.563+0000 7f04d4fef740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559dd838b880 0x559dd8402a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:35.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.563+0000 7f04d4fef740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559dd838eac0 0x559dd8402f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:35.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.563+0000 7f04d4fef740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559dd83863c0 con 0x559dd838eac0 2024-04-15T00:21:35.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.563+0000 7f04d4fef740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559dd8380a40 con 0x559dd838b880 2024-04-15T00:21:35.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.563+0000 7f04d4fef740 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x559dd826c9a0 con 0x559dd8387a60 2024-04-15T00:21:35.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.563+0000 7f04d4fef740 10 client.0 _ll_register_callbacks cb 0x7f04c4007720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-15T00:21:35.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.563+0000 7f04cbfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559dd838eac0 0x559dd8402f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:35.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.563+0000 7f04cbfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559dd838eac0 0x559dd8402f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35864/0 (socket says 172.21.15.31:35864) 2024-04-15T00:21:35.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.563+0000 7f04cbfff640 1 -- 172.21.15.31:0/1654315100 learned_addr learned my addr 172.21.15.31:0/1654315100 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:35.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.563+0000 7f04cb7fe640 1 --2- 172.21.15.31:0/1654315100 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559dd8387a60 0x559dd840c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:35.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.563+0000 7f04caffd640 1 --2- 172.21.15.31:0/1654315100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559dd838b880 0x559dd8402a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:35.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.563+0000 7f04cbfff640 1 -- 172.21.15.31:0/1654315100 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559dd8387a60 msgr2=0x559dd840c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:35.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.563+0000 7f04cbfff640 1 --2- 172.21.15.31:0/1654315100 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559dd8387a60 0x559dd840c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.563+0000 7f04cbfff640 1 -- 172.21.15.31:0/1654315100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559dd838b880 msgr2=0x559dd8402a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:35.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.563+0000 7f04cbfff640 1 --2- 172.21.15.31:0/1654315100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559dd838b880 0x559dd8402a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.563+0000 7f04cbfff640 1 -- 172.21.15.31:0/1654315100 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559dd840cac0 con 0x559dd838eac0 2024-04-15T00:21:35.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.563+0000 7f04cbfff640 1 --2- 172.21.15.31:0/1654315100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559dd838eac0 0x559dd8402f40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x559dd8381cf0 tx=0x7f04c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ac1443a81d0eed server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:35.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.563+0000 7f04aa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-04-15T00:21:35.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.564+0000 7f04aa7fc640 1 -- 172.21.15.31:0/1654315100 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c4003ba0 con 0x559dd838eac0 2024-04-15T00:21:35.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.564+0000 7f04aa7fc640 1 -- 172.21.15.31:0/1654315100 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f04c4003d40 con 0x559dd838eac0 2024-04-15T00:21:35.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.564+0000 7f04d4fef740 1 -- 172.21.15.31:0/1654315100 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04bc037040 con 0x559dd838eac0 2024-04-15T00:21:35.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.564+0000 7f04aa7fc640 1 -- 172.21.15.31:0/1654315100 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f04c4038050 con 0x559dd838eac0 2024-04-15T00:21:35.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.564+0000 7f04d4fef740 10 client.4839 fetch_fsmap learned FSMap version 8 2024-04-15T00:21:35.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.564+0000 7f04d4fef740 1 -- 172.21.15.31:0/1654315100 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x559dd8356150 con 0x559dd838eac0 2024-04-15T00:21:35.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.564+0000 7f04aa7fc640 1 -- 172.21.15.31:0/1654315100 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04bc037040 con 0x559dd838eac0 2024-04-15T00:21:35.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.564+0000 7f04aa7fc640 1 -- 172.21.15.31:0/1654315100 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 8) ==== 2292+0+0 (secure 0 0 0) 0x7f04c403b020 con 0x559dd838eac0 2024-04-15T00:21:35.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.564+0000 7f04d4fef740 10 client.4839 fetch_fsmap finished waiting for FSMap version 8 2024-04-15T00:21:35.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.564+0000 7f04d4fef740 10 client.4839 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-15T00:21:35.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.564+0000 7f04d4fef740 20 client.4839 populate_metadata read hostname 'smithi031' 2024-04-15T00:21:35.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.564+0000 7f04d4fef740 1 --2- 172.21.15.31:0/1654315100 >> [v2:172.21.15.31:6834/93464605,v1:172.21.15.31:6835/93464605] conn(0x559dd835a040 0x559dd835a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:35.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.564+0000 7f04d4fef740 4 client.4839 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-15T00:21:35.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.564+0000 7f04d4fef740 1 -- 172.21.15.31:0/1654315100 --> [v2:172.21.15.31:6834/93464605,v1:172.21.15.31:6835/93464605] -- command(tid 0: {"prefix": "status"}) -- 0x559dd82cb810 con 0x559dd835a040 2024-04-15T00:21:35.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.564+0000 7f04cb7fe640 1 --2- 172.21.15.31:0/1654315100 >> [v2:172.21.15.31:6834/93464605,v1:172.21.15.31:6835/93464605] conn(0x559dd835a040 0x559dd835a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:35.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.564+0000 7f04cb7fe640 1 --2- 172.21.15.31:0/1654315100 >> [v2:172.21.15.31:6834/93464605,v1:172.21.15.31:6835/93464605] conn(0x559dd835a040 0x559dd835a420 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e95c42afaaced6bc server_cookie=78e1ebee8d0e99d in_seq=0 out_seq=0 2024-04-15T00:21:35.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.564+0000 7f04aa7fc640 10 client.4839 ms_handle_connect on v2:172.21.15.31:6834/93464605 2024-04-15T00:21:35.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.565+0000 7f04aa7fc640 1 -- 172.21.15.31:0/1654315100 <== mds.0 v2:172.21.15.31:6834/93464605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x559dd82cb810 con 0x559dd835a040 2024-04-15T00:21:35.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.565+0000 7f04aa7fc640 10 client.4839 handle_command_reply: tid=0 2024-04-15T00:21:35.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.565+0000 7f04d4fef740 1 client.4839 shutdown 2024-04-15T00:21:35.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.565+0000 7f04d4fef740 1 -- 172.21.15.31:0/1654315100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559dd838eac0 msgr2=0x559dd8402f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:35.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.565+0000 7f04d4fef740 1 --2- 172.21.15.31:0/1654315100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559dd838eac0 0x559dd8402f40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x559dd8381cf0 tx=0x7f04c4004a40 comp rx=0 tx=0).stop 2024-04-15T00:21:35.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.565+0000 7f04d4fef740 1 -- 172.21.15.31:0/1654315100 shutdown_connections 2024-04-15T00:21:35.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.565+0000 7f04d4fef740 1 --2- 172.21.15.31:0/1654315100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559dd838eac0 0x559dd8402f40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.565+0000 7f04d4fef740 1 --2- 172.21.15.31:0/1654315100 >> [v2:172.21.15.31:6834/93464605,v1:172.21.15.31:6835/93464605] conn(0x559dd835a040 0x559dd835a420 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.565+0000 7f04d4fef740 1 --2- 172.21.15.31:0/1654315100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559dd838b880 0x559dd8402a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.565+0000 7f04d4fef740 1 --2- 172.21.15.31:0/1654315100 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x559dd8387a60 0x559dd840c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.565+0000 7f04aa7fc640 0 client.4839 ms_handle_reset on v2:172.21.15.31:6834/93464605 2024-04-15T00:21:35.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.565+0000 7f04d4fef740 1 -- 172.21.15.31:0/1654315100 >> 172.21.15.31:0/1654315100 conn(0x559dd835f060 msgr2=0x559dd835f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:35.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.565+0000 7f04d4fef740 1 -- 172.21.15.31:0/1654315100 shutdown_connections 2024-04-15T00:21:35.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.565+0000 7f04d4fef740 1 -- 172.21.15.31:0/1654315100 wait complete. 2024-04-15T00:21:35.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.565+0000 7f04d4fef740 20 client.4839 trim_cache size 0 max 16384 2024-04-15T00:21:35.580 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-15T00:21:35.580 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "b57c03ab-2810-4ea5-b233-6164468328c0", 2024-04-15T00:21:35.580 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-04-15T00:21:35.580 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 4272, 2024-04-15T00:21:35.580 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-04-15T00:21:35.580 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-04-15T00:21:35.580 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-04-15T00:21:35.580 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 26.991124481, 2024-04-15T00:21:35.580 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 8, 2024-04-15T00:21:35.580 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 25, 2024-04-15T00:21:35.580 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 25, 2024-04-15T00:21:35.580 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 33.628256338 2024-04-15T00:21:35.581 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-15T00:21:35.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.565+0000 7f04d211e640 1 -- 172.21.15.31:0/69052429 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f04b806b990 msgr2=0x7f04b806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:35.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.565+0000 7f04d211e640 1 --2- 172.21.15.31:0/69052429 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f04b806b990 0x7f04b806de50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f04cc146ae0 tx=0x7f04c0009040 comp rx=0 tx=0).stop 2024-04-15T00:21:35.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.565+0000 7f04d211e640 1 -- 172.21.15.31:0/69052429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04cc0b80d0 msgr2=0x7f04cc0b2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:35.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.565+0000 7f04d211e640 1 --2- 172.21.15.31:0/69052429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04cc0b80d0 0x7f04cc0b2e70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f04bc02b8a0 tx=0x7f04bc0046c0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.565+0000 7f04d211e640 1 -- 172.21.15.31:0/69052429 shutdown_connections 2024-04-15T00:21:35.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.565+0000 7f04d211e640 1 --2- 172.21.15.31:0/69052429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04cc14b4c0 0x7f04cc147620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.565+0000 7f04d211e640 1 --2- 172.21.15.31:0/69052429 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f04b806b990 0x7f04b806de50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.565+0000 7f04d211e640 1 --2- 172.21.15.31:0/69052429 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04cc0b8be0 0x7f04cc1470e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.565+0000 7f04d211e640 1 --2- 172.21.15.31:0/69052429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04cc0b80d0 0x7f04cc0b2e70 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.565+0000 7f04d211e640 1 -- 172.21.15.31:0/69052429 >> 172.21.15.31:0/69052429 conn(0x7f04cc0bd020 msgr2=0x7f04cc09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:35.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.566+0000 7f04d211e640 1 -- 172.21.15.31:0/69052429 shutdown_connections 2024-04-15T00:21:35.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.566+0000 7f04d211e640 1 -- 172.21.15.31:0/69052429 wait complete. 2024-04-15T00:21:35.585 INFO:teuthology.run_tasks:Running task sequential... 2024-04-15T00:21:35.595 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-15T00:21:35.595 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-15T00:21:35.596 INFO:teuthology.task.print:Enabling mgr modules 2024-04-15T00:21:35.596 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-15T00:21:35.613 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-15T00:21:35.613 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-15T00:21:35.613 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-15T00:21:35.613 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-15T00:21:35.613 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-15T00:21:35.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:21:35.613 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-04-15T00:21:35.628 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-15T00:21:35.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:21:35.629 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-15T00:21:35.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:21:35.696 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link delete ceph-brx 2024-04-15T00:21:35.788 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-15T00:21:35.788 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-15T00:21:35.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.883+0000 7f77c129d640 1 Processor -- start 2024-04-15T00:21:35.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.883+0000 7f77c129d640 1 -- start start 2024-04-15T00:21:35.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.884+0000 7f77c129d640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f77bc074680 0x7f77bc13f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:35.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.884+0000 7f77c129d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77bc074a60 con 0x7f77bc1488c0 2024-04-15T00:21:35.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.884+0000 7f77c129d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77bc149440 con 0x7f77bc0b49a0 2024-04-15T00:21:35.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.884+0000 7f77c129d640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f77bc06fe10 con 0x7f77bc074680 2024-04-15T00:21:35.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.884+0000 7f77ba7fc640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f77bc1488c0 0x7f77bc0b4290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55506/0 (socket says 172.21.15.31:55506) 2024-04-15T00:21:35.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.884+0000 7f77ba7fc640 1 -- 172.21.15.31:0/3671776246 learned_addr learned my addr 172.21.15.31:0/3671776246 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:21:35.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.884+0000 7f77baffd640 1 --2- 172.21.15.31:0/3671776246 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f77bc074680 0x7f77bc13f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:35.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.884+0000 7f77b9ffb640 1 -- 172.21.15.31:0/3671776246 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3401874860 0 0) 0x7f77bc074a60 con 0x7f77bc1488c0 2024-04-15T00:21:35.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.884+0000 7f77b9ffb640 1 -- 172.21.15.31:0/3671776246 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77a8003520 con 0x7f77bc1488c0 2024-04-15T00:21:35.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.885+0000 7f77b9ffb640 1 -- 172.21.15.31:0/3671776246 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1256158578 0 0) 0x7f77a8003520 con 0x7f77bc1488c0 2024-04-15T00:21:35.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.885+0000 7f77b9ffb640 1 -- 172.21.15.31:0/3671776246 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f77bc074680 msgr2=0x7f77bc13f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:35.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.885+0000 7f77b9ffb640 1 --2- 172.21.15.31:0/3671776246 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f77bc074680 0x7f77bc13f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.885+0000 7f77b9ffb640 1 -- 172.21.15.31:0/3671776246 >> v1:172.21.15.50:6789/0 conn(0x7f77bc0b49a0 legacy=0x7f77bc14fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:35.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.885+0000 7f77b9ffb640 1 -- 172.21.15.31:0/3671776246 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77bc149720 con 0x7f77bc1488c0 2024-04-15T00:21:35.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.885+0000 7f77b9ffb640 1 -- 172.21.15.31:0/3671776246 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 697057150 0 0) 0x7f77a4001670 con 0x7f77bc1488c0 2024-04-15T00:21:35.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.885+0000 7f77b9ffb640 1 -- 172.21.15.31:0/3671776246 >> v1:172.21.15.31:6789/0 conn(0x7f77bc1488c0 legacy=0x7f77bc0b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:35.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.885+0000 7f77b9ffb640 1 --2- 172.21.15.31:0/3671776246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77a80039e0 0x7f77a8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:35.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.885+0000 7f77b9ffb640 1 --2- 172.21.15.31:0/3671776246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77a8004390 0x7f77a8004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:35.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.885+0000 7f77b9ffb640 1 --2- 172.21.15.31:0/3671776246 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f77bc074680 0x7f77a8005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:35.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.885+0000 7f77b9ffb640 1 -- 172.21.15.31:0/3671776246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f77a800ba70 con 0x7f77a80039e0 2024-04-15T00:21:35.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.885+0000 7f77b9ffb640 1 -- 172.21.15.31:0/3671776246 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f77a800bbf0 con 0x7f77a8004390 2024-04-15T00:21:35.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.885+0000 7f77b9ffb640 1 -- 172.21.15.31:0/3671776246 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f77a800bdf0 con 0x7f77bc074680 2024-04-15T00:21:35.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.885+0000 7f77baffd640 1 --2- 172.21.15.31:0/3671776246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77a80039e0 0x7f77a8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:35.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.885+0000 7f77ba7fc640 1 --2- 172.21.15.31:0/3671776246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77a8004390 0x7f77a8004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:35.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.885+0000 7f77bb7fe640 1 --2- 172.21.15.31:0/3671776246 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f77bc074680 0x7f77a8005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:35.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.885+0000 7f77baffd640 1 -- 172.21.15.31:0/3671776246 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f77bc074680 msgr2=0x7f77a8005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:35.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.885+0000 7f77baffd640 1 --2- 172.21.15.31:0/3671776246 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f77bc074680 0x7f77a8005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.885+0000 7f77baffd640 1 -- 172.21.15.31:0/3671776246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77a8004390 msgr2=0x7f77a8004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:21:35.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.885+0000 7f77baffd640 1 --2- 172.21.15.31:0/3671776246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77a8004390 0x7f77a8004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.885+0000 7f77baffd640 1 -- 172.21.15.31:0/3671776246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a8003520 con 0x7f77a80039e0 2024-04-15T00:21:35.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.886+0000 7f77baffd640 1 --2- 172.21.15.31:0/3671776246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77a80039e0 0x7f77a8003dc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f77b4009ac0 tx=0x7f77a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23bcefec836407d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:35.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.886+0000 7f77b9ffb640 1 -- 172.21.15.31:0/3671776246 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b4039070 con 0x7f77a80039e0 2024-04-15T00:21:35.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.886+0000 7f77b9ffb640 1 -- 172.21.15.31:0/3671776246 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77b402c6b0 con 0x7f77a80039e0 2024-04-15T00:21:35.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.886+0000 7f77b9ffb640 1 -- 172.21.15.31:0/3671776246 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b4009690 con 0x7f77a80039e0 2024-04-15T00:21:35.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.887+0000 7f77c129d640 1 -- 172.21.15.31:0/3671776246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77a80039e0 msgr2=0x7f77a8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:35.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.887+0000 7f77c129d640 1 --2- 172.21.15.31:0/3671776246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77a80039e0 0x7f77a8003dc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f77b4009ac0 tx=0x7f77a8005830 comp rx=0 tx=0).stop 2024-04-15T00:21:35.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.887+0000 7f77bb7fe640 1 -- 172.21.15.31:0/3671776246 reap_dead start 2024-04-15T00:21:35.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.887+0000 7f77c129d640 1 -- 172.21.15.31:0/3671776246 shutdown_connections 2024-04-15T00:21:35.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.887+0000 7f77c129d640 1 -- 172.21.15.31:0/3671776246 >> 172.21.15.31:0/3671776246 conn(0x7f77bc0b92d0 msgr2=0x7f77bc0b96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:35.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.887+0000 7f77c129d640 1 -- 172.21.15.31:0/3671776246 shutdown_connections 2024-04-15T00:21:35.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.887+0000 7f77c129d640 1 -- 172.21.15.31:0/3671776246 wait complete. 2024-04-15T00:21:35.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.888+0000 7f77c129d640 1 Processor -- start 2024-04-15T00:21:35.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.888+0000 7f77c129d640 1 -- start start 2024-04-15T00:21:35.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.888+0000 7f77c129d640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f77a80039e0 0x7f77bc1ce810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:35.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.888+0000 7f77c129d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77bc1d0220 0x7f77bc145860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:35.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.888+0000 7f77c129d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77bc143fa0 0x7f77bc144430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:35.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.888+0000 7f77c129d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f77bc148ea0 con 0x7f77bc143fa0 2024-04-15T00:21:35.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.888+0000 7f77c129d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f77bc148d20 con 0x7f77bc1d0220 2024-04-15T00:21:35.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.888+0000 7f77c129d640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f77bc149020 con 0x7f77a80039e0 2024-04-15T00:21:35.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.889+0000 7f77bb7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77bc143fa0 0x7f77bc144430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:35.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.889+0000 7f77bb7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77bc143fa0 0x7f77bc144430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35876/0 (socket says 172.21.15.31:35876) 2024-04-15T00:21:35.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.889+0000 7f77bb7fe640 1 -- 172.21.15.31:0/113429554 learned_addr learned my addr 172.21.15.31:0/113429554 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:21:35.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.889+0000 7f77baffd640 1 --2- 172.21.15.31:0/113429554 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f77a80039e0 0x7f77bc1ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:35.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.889+0000 7f77ba7fc640 1 --2- 172.21.15.31:0/113429554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77bc1d0220 0x7f77bc145860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:35.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.889+0000 7f77bb7fe640 1 -- 172.21.15.31:0/113429554 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f77a80039e0 msgr2=0x7f77bc1ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:35.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.889+0000 7f77bb7fe640 1 --2- 172.21.15.31:0/113429554 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f77a80039e0 0x7f77bc1ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.889+0000 7f77bb7fe640 1 -- 172.21.15.31:0/113429554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77bc1d0220 msgr2=0x7f77bc145860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:35.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.889+0000 7f77bb7fe640 1 --2- 172.21.15.31:0/113429554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77bc1d0220 0x7f77bc145860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:35.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.889+0000 7f77bb7fe640 1 -- 172.21.15.31:0/113429554 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77bc144970 con 0x7f77bc143fa0 2024-04-15T00:21:35.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.889+0000 7f77bb7fe640 1 --2- 172.21.15.31:0/113429554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77bc143fa0 0x7f77bc144430 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f77bc0b71a0 tx=0x7f77ac00ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:35.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.889+0000 7f77b37fe640 1 -- 172.21.15.31:0/113429554 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ac019070 con 0x7f77bc143fa0 2024-04-15T00:21:35.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.889+0000 7f77b37fe640 1 -- 172.21.15.31:0/113429554 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77ac006d60 con 0x7f77bc143fa0 2024-04-15T00:21:35.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.889+0000 7f77c129d640 1 -- 172.21.15.31:0/113429554 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77bc1dac00 con 0x7f77bc143fa0 2024-04-15T00:21:35.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.889+0000 7f77b37fe640 1 -- 172.21.15.31:0/113429554 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ac003bb0 con 0x7f77bc143fa0 2024-04-15T00:21:35.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.889+0000 7f77c129d640 1 -- 172.21.15.31:0/113429554 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77bc1daec0 con 0x7f77bc143fa0 2024-04-15T00:21:35.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.890+0000 7f77c129d640 1 -- 172.21.15.31:0/113429554 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77bc0b9e60 con 0x7f77bc143fa0 2024-04-15T00:21:35.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.891+0000 7f77b37fe640 1 -- 172.21.15.31:0/113429554 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f77ac01c070 con 0x7f77bc143fa0 2024-04-15T00:21:35.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.891+0000 7f77b37fe640 1 --2- 172.21.15.31:0/113429554 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f779c06b9c0 0x7f779c06de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:21:35.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.891+0000 7f77b37fe640 1 -- 172.21.15.31:0/113429554 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f77ac089f80 con 0x7f77bc143fa0 2024-04-15T00:21:35.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.891+0000 7f77baffd640 1 --2- 172.21.15.31:0/113429554 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f779c06b9c0 0x7f779c06de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:21:35.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.892+0000 7f77baffd640 1 --2- 172.21.15.31:0/113429554 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f779c06b9c0 0x7f779c06de80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f77b4036000 tx=0x7f77b4030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:21:35.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:35.895+0000 7f77b37fe640 1 -- 172.21.15.31:0/113429554 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f77bc144970 con 0x7f77bc143fa0 2024-04-15T00:21:36.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:36.118+0000 7f77c129d640 1 -- 172.21.15.31:0/113429554 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f77bc06de00 con 0x7f77bc143fa0 2024-04-15T00:21:36.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:36.118+0000 7f77b37fe640 1 -- 172.21.15.31:0/113429554 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f77ac058290 con 0x7f77bc143fa0 2024-04-15T00:21:36.125 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-15T00:21:36.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:36.120+0000 7f77c129d640 1 -- 172.21.15.31:0/113429554 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f779c06b9c0 msgr2=0x7f779c06de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:36.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:36.120+0000 7f77c129d640 1 --2- 172.21.15.31:0/113429554 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f779c06b9c0 0x7f779c06de80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f77b4036000 tx=0x7f77b4030000 comp rx=0 tx=0).stop 2024-04-15T00:21:36.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:36.120+0000 7f77c129d640 1 -- 172.21.15.31:0/113429554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77bc143fa0 msgr2=0x7f77bc144430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:21:36.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:36.120+0000 7f77c129d640 1 --2- 172.21.15.31:0/113429554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77bc143fa0 0x7f77bc144430 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f77bc0b71a0 tx=0x7f77ac00ff70 comp rx=0 tx=0).stop 2024-04-15T00:21:36.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:36.120+0000 7f77c129d640 1 -- 172.21.15.31:0/113429554 shutdown_connections 2024-04-15T00:21:36.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:36.120+0000 7f77c129d640 1 --2- 172.21.15.31:0/113429554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77bc143fa0 0x7f77bc144430 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:36.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:36.120+0000 7f77c129d640 1 --2- 172.21.15.31:0/113429554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77bc1d0220 0x7f77bc145860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:36.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:36.120+0000 7f77c129d640 1 --2- 172.21.15.31:0/113429554 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f779c06b9c0 0x7f779c06de80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:36.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:36.120+0000 7f77c129d640 1 --2- 172.21.15.31:0/113429554 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f77a80039e0 0x7f77bc1ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:21:36.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:36.120+0000 7f77c129d640 1 -- 172.21.15.31:0/113429554 >> 172.21.15.31:0/113429554 conn(0x7f77bc0b92d0 msgr2=0x7f77bc09ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:21:36.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:36.120+0000 7f77c129d640 1 -- 172.21.15.31:0/113429554 shutdown_connections 2024-04-15T00:21:36.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:36.120+0000 7f77c129d640 1 -- 172.21.15.31:0/113429554 wait complete. 2024-04-15T00:21:36.138 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-15T00:21:36.138 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-15T00:21:36.138 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2024-04-15T00:21:36.138 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-15T00:21:36.138 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-15T00:21:36.138 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-15T00:21:36.138 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-15T00:21:36.138 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-15T00:21:36.138 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-15T00:21:36.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:21:36.139 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2024-04-15T00:21:36.153 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-15T00:21:36.153 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-15T00:21:36.153 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-04-15T00:21:36.153 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-04-15T00:21:36.153 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-04-15T00:21:36.154 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-04-15T00:21:36.154 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-15T00:21:36.154 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2024-04-15T00:21:36.154 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2024-04-15T00:21:36.154 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-15T00:21:36.154 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2024-04-15T00:21:36.154 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2024-04-15T00:21:36.154 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-15T00:21:36.154 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2024-04-15T00:21:36.154 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2024-04-15T00:21:36.154 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-15T00:21:36.154 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42649sec preferred_lft 42649sec 2024-04-15T00:21:36.154 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link noprefixroute 2024-04-15T00:21:36.155 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-04-15T00:21:36.155 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-15T00:21:36.155 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2024-04-15T00:21:36.155 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2024-04-15T00:21:36.155 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-15T00:21:36.155 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T00:21:36.155 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-04-15T00:21:36.155 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link add name ceph-brx type bridge 2024-04-15T00:21:36.155 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip addr flush dev ceph-brx 2024-04-15T00:21:36.155 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set ceph-brx up 2024-04-15T00:21:36.155 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-15T00:21:36.156 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-04-15T00:21:36.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T00:21:36.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T00:21:36.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:21:36.301 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-15T00:21:36.326 INFO:teuthology.orchestra.run.smithi031.stdout:1 2024-04-15T00:21:36.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:21:36.327 DEBUG:teuthology.orchestra.run.smithi031:> route 2024-04-15T00:21:36.382 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2024-04-15T00:21:36.382 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-15T00:21:36.383 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-15T00:21:36.383 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-15T00:21:36.383 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-15T00:21:36.383 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T00:21:36.383 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-04-15T00:21:36.383 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-15T00:21:36.383 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-15T00:21:36.383 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-15T00:21:36.383 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-04-15T00:21:36.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T00:21:36.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T00:21:36.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:21:36.519 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-04-15T00:21:36.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:21:36.535 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list-id 2024-04-15T00:21:36.589 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T00:21:36.589 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-04-15T00:21:36.589 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T00:21:36.589 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-15T00:21:36.589 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-04-15T00:21:36.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T00:21:36.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T00:21:36.712 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-15T00:21:36.712 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T00:21:36.712 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-04-15T00:21:36.712 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-15T00:21:36.712 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-15T00:21:36.712 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-15T00:21:36.712 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-15T00:21:36.712 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-15T00:21:36.712 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-04-15T00:21:36.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T00:21:36.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T00:21:36.835 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T00:21:36.835 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-04-15T00:21:36.835 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2024-04-15T00:21:36.836 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set dev brx.0 master ceph-brx 2024-04-15T00:21:36.836 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-04-15T00:21:36.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T00:21:36.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T00:21:36.916 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-15T00:21:36.916 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T00:21:36.916 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-15T00:21:36.931 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-15T00:21:36.931 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T00:21:36.931 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-15T00:21:36.984 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2024-04-15T00:21:37.051 DEBUG:teuthology.orchestra.run.smithi031:> cat /proc/self/mounts | awk '{print $2}' 2024-04-15T00:21:37.106 INFO:teuthology.orchestra.run.smithi031.stdout:/proc 2024-04-15T00:21:37.106 INFO:teuthology.orchestra.run.smithi031.stdout:/sys 2024-04-15T00:21:37.106 INFO:teuthology.orchestra.run.smithi031.stdout:/dev 2024-04-15T00:21:37.106 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/security 2024-04-15T00:21:37.107 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/shm 2024-04-15T00:21:37.107 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/pts 2024-04-15T00:21:37.107 INFO:teuthology.orchestra.run.smithi031.stdout:/run 2024-04-15T00:21:37.107 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/cgroup 2024-04-15T00:21:37.107 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/pstore 2024-04-15T00:21:37.107 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/bpf 2024-04-15T00:21:37.107 INFO:teuthology.orchestra.run.smithi031.stdout:/ 2024-04-15T00:21:37.107 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/selinux 2024-04-15T00:21:37.107 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T00:21:37.107 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/hugepages 2024-04-15T00:21:37.107 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/mqueue 2024-04-15T00:21:37.107 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/debug 2024-04-15T00:21:37.107 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/tracing 2024-04-15T00:21:37.107 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/fuse/connections 2024-04-15T00:21:37.107 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/config 2024-04-15T00:21:37.107 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-sysctl.service 2024-04-15T00:21:37.108 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-15T00:21:37.108 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-15T00:21:37.108 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/nfs/rpc_pipefs 2024-04-15T00:21:37.108 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/1000 2024-04-15T00:21:37.108 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph 2024-04-15T00:21:37.108 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-0 2024-04-15T00:21:37.108 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-1 2024-04-15T00:21:37.108 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-2 2024-04-15T00:21:37.109 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-3 2024-04-15T00:21:37.109 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns 2024-04-15T00:21:37.109 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T00:21:37.109 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T00:21:37.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:21:37.109 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2024-04-15T00:21:37.160 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-15T00:21:37.161 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-15T00:21:37.203 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2024-04-15T00:21:37.229 DEBUG:teuthology.orchestra.run.smithi031:> cat /proc/self/mounts | awk '{print $2}' 2024-04-15T00:21:37.285 INFO:teuthology.orchestra.run.smithi031.stdout:/proc 2024-04-15T00:21:37.285 INFO:teuthology.orchestra.run.smithi031.stdout:/sys 2024-04-15T00:21:37.285 INFO:teuthology.orchestra.run.smithi031.stdout:/dev 2024-04-15T00:21:37.285 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/security 2024-04-15T00:21:37.285 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/shm 2024-04-15T00:21:37.285 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/pts 2024-04-15T00:21:37.285 INFO:teuthology.orchestra.run.smithi031.stdout:/run 2024-04-15T00:21:37.286 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/cgroup 2024-04-15T00:21:37.286 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/pstore 2024-04-15T00:21:37.286 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/bpf 2024-04-15T00:21:37.286 INFO:teuthology.orchestra.run.smithi031.stdout:/ 2024-04-15T00:21:37.286 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/selinux 2024-04-15T00:21:37.286 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T00:21:37.286 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/hugepages 2024-04-15T00:21:37.286 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/mqueue 2024-04-15T00:21:37.286 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/debug 2024-04-15T00:21:37.286 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/tracing 2024-04-15T00:21:37.286 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/fuse/connections 2024-04-15T00:21:37.286 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/config 2024-04-15T00:21:37.286 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-sysctl.service 2024-04-15T00:21:37.286 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-15T00:21:37.287 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-15T00:21:37.287 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/nfs/rpc_pipefs 2024-04-15T00:21:37.287 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/1000 2024-04-15T00:21:37.287 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph 2024-04-15T00:21:37.287 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-0 2024-04-15T00:21:37.287 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-1 2024-04-15T00:21:37.287 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-2 2024-04-15T00:21:37.287 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-3 2024-04-15T00:21:37.287 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns 2024-04-15T00:21:37.287 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T00:21:37.287 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T00:21:37.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:21:37.288 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2024-04-15T00:21:37.289 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi031.stderr:2024-04-15T00:21:37.281+0000 7f15c5e3e480 -1 init, newargv = 0x555bfc10b230 newargc=15 2024-04-15T00:21:37.289 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi031.stderr:ceph-fuse[48007]: starting ceph client 2024-04-15T00:21:37.293 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi031.stderr:ceph-fuse[48007]: starting fuse 2024-04-15T00:21:37.303 INFO:teuthology.orchestra.run.smithi031.stdout:42 2024-04-15T00:21:37.303 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-04-15T00:21:37.303 DEBUG:teuthology.orchestra.run.smithi031:> sudo stdin-killer -- python3 -c ' 2024-04-15T00:21:37.304 DEBUG:teuthology.orchestra.run.smithi031:> import glob 2024-04-15T00:21:37.304 DEBUG:teuthology.orchestra.run.smithi031:> import re 2024-04-15T00:21:37.304 DEBUG:teuthology.orchestra.run.smithi031:> import os 2024-04-15T00:21:37.304 DEBUG:teuthology.orchestra.run.smithi031:> import subprocess 2024-04-15T00:21:37.304 DEBUG:teuthology.orchestra.run.smithi031:> 2024-04-15T00:21:37.304 DEBUG:teuthology.orchestra.run.smithi031:> def _find_admin_socket(client_name): 2024-04-15T00:21:37.304 DEBUG:teuthology.orchestra.run.smithi031:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-15T00:21:37.304 DEBUG:teuthology.orchestra.run.smithi031:> files = glob.glob(asok_path) 2024-04-15T00:21:37.304 DEBUG:teuthology.orchestra.run.smithi031:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-15T00:21:37.304 DEBUG:teuthology.orchestra.run.smithi031:> 2024-04-15T00:21:37.304 DEBUG:teuthology.orchestra.run.smithi031:> # Given a non-glob path, it better be there 2024-04-15T00:21:37.304 DEBUG:teuthology.orchestra.run.smithi031:> if "*" not in asok_path: 2024-04-15T00:21:37.304 DEBUG:teuthology.orchestra.run.smithi031:> assert(len(files) == 1) 2024-04-15T00:21:37.304 DEBUG:teuthology.orchestra.run.smithi031:> return files[0] 2024-04-15T00:21:37.304 DEBUG:teuthology.orchestra.run.smithi031:> 2024-04-15T00:21:37.304 DEBUG:teuthology.orchestra.run.smithi031:> for f in files: 2024-04-15T00:21:37.305 DEBUG:teuthology.orchestra.run.smithi031:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-15T00:21:37.305 DEBUG:teuthology.orchestra.run.smithi031:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-15T00:21:37.305 DEBUG:teuthology.orchestra.run.smithi031:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-15T00:21:37.305 DEBUG:teuthology.orchestra.run.smithi031:> contents = proc_f.read() 2024-04-15T00:21:37.305 DEBUG:teuthology.orchestra.run.smithi031:> if mountpoint in contents: 2024-04-15T00:21:37.305 DEBUG:teuthology.orchestra.run.smithi031:> return f 2024-04-15T00:21:37.305 DEBUG:teuthology.orchestra.run.smithi031:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-15T00:21:37.305 DEBUG:teuthology.orchestra.run.smithi031:> 2024-04-15T00:21:37.305 DEBUG:teuthology.orchestra.run.smithi031:> print(_find_admin_socket("client.0")) 2024-04-15T00:21:37.305 DEBUG:teuthology.orchestra.run.smithi031:> ' 2024-04-15T00:21:37.423 INFO:teuthology.orchestra.run.smithi031.stdout:/var/run/ceph/ceph-client.0.48007.asok 2024-04-15T00:21:37.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:21:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T00:21:37.434 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48007.asok 2024-04-15T00:21:37.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:21:37.434 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.48007.asok status 2024-04-15T00:21:37.571 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-15T00:21:37.571 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": { 2024-04-15T00:21:37.571 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_sha1": "a9a752df26c63acad72e1b3569fd79a515ca0765", 2024-04-15T00:21:37.571 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_version": "ceph version 19.0.0-2114-ga9a752df (a9a752df26c63acad72e1b3569fd79a515ca0765) squid (dev)", 2024-04-15T00:21:37.571 INFO:teuthology.orchestra.run.smithi031.stdout: "entity_id": "0", 2024-04-15T00:21:37.571 INFO:teuthology.orchestra.run.smithi031.stdout: "hostname": "smithi031", 2024-04-15T00:21:37.572 INFO:teuthology.orchestra.run.smithi031.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-15T00:21:37.572 INFO:teuthology.orchestra.run.smithi031.stdout: "pid": "48007", 2024-04-15T00:21:37.572 INFO:teuthology.orchestra.run.smithi031.stdout: "root": "/" 2024-04-15T00:21:37.572 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:21:37.572 INFO:teuthology.orchestra.run.smithi031.stdout: "dentry_count": 0, 2024-04-15T00:21:37.572 INFO:teuthology.orchestra.run.smithi031.stdout: "dentry_pinned_count": 0, 2024-04-15T00:21:37.572 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 4854, 2024-04-15T00:21:37.572 INFO:teuthology.orchestra.run.smithi031.stdout: "inst": { 2024-04-15T00:21:37.572 INFO:teuthology.orchestra.run.smithi031.stdout: "name": { 2024-04-15T00:21:37.572 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "client", 2024-04-15T00:21:37.572 INFO:teuthology.orchestra.run.smithi031.stdout: "num": 4854 2024-04-15T00:21:37.572 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:21:37.572 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": { 2024-04-15T00:21:37.572 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-04-15T00:21:37.572 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "192.168.0.1:0", 2024-04-15T00:21:37.573 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 3301174359 2024-04-15T00:21:37.573 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:21:37.573 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:21:37.573 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": { 2024-04-15T00:21:37.573 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-04-15T00:21:37.573 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "192.168.0.1:0", 2024-04-15T00:21:37.573 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 3301174359 2024-04-15T00:21:37.573 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:21:37.573 INFO:teuthology.orchestra.run.smithi031.stdout: "inst_str": "client.4854 192.168.0.1:0/3301174359", 2024-04-15T00:21:37.573 INFO:teuthology.orchestra.run.smithi031.stdout: "addr_str": "192.168.0.1:0/3301174359", 2024-04-15T00:21:37.573 INFO:teuthology.orchestra.run.smithi031.stdout: "inode_count": 1, 2024-04-15T00:21:37.573 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_epoch": 8, 2024-04-15T00:21:37.573 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_epoch": 25, 2024-04-15T00:21:37.573 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_epoch_barrier": 0, 2024-04-15T00:21:37.573 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklisted": false, 2024-04-15T00:21:37.573 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs" 2024-04-15T00:21:37.574 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-15T00:21:37.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:21:37.579 DEBUG:teuthology.orchestra.run.smithi031:> stat --file-system '--printf=%T 2024-04-15T00:21:37.579 DEBUG:teuthology.orchestra.run.smithi031:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-15T00:21:37.594 INFO:teuthology.orchestra.run.smithi031.stdout:fuseblk 2024-04-15T00:21:37.594 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-15T00:21:37.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:21:37.594 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-15T00:21:37.660 INFO:teuthology.run_tasks:Running task check-counter... 2024-04-15T00:21:37.698 INFO:teuthology.run_tasks:Running task workunit... 2024-04-15T00:21:37.710 INFO:tasks.workunit:Pulling workunits from ref a9a752df26c63acad72e1b3569fd79a515ca0765 2024-04-15T00:21:37.711 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-15T00:21:37.711 INFO:tasks.workunit:timeout=3h 2024-04-15T00:21:37.711 INFO:tasks.workunit:cleanup=True 2024-04-15T00:21:37.711 DEBUG:teuthology.orchestra.run.smithi031:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-15T00:21:37.726 INFO:teuthology.orchestra.run.smithi031.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-15T00:21:37.726 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-15T00:21:37.726 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 2ah/42d Inode: 1 Links: 2 2024-04-15T00:21:37.726 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T00:21:37.726 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-15T00:21:37.726 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-15T00:21:37.726 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-04-15 00:21:08.575894549 +0000 2024-04-15T00:21:37.726 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-04-15 00:21:17.847886424 +0000 2024-04-15T00:21:37.726 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2024-04-15T00:21:37.727 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-15T00:21:37.727 DEBUG:teuthology.orchestra.run.smithi031:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-15T00:21:37.797 DEBUG:teuthology.orchestra.run.smithi031:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout a9a752df26c63acad72e1b3569fd79a515ca0765 2024-04-15T00:21:37.852 INFO:tasks.workunit.client.0.smithi031.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-15T00:21:40.698 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:21:40.701 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:22:10.764 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:22:10.770 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:22:40.827 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:22:40.830 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:22:45.319 INFO:tasks.workunit.client.0.smithi031.stderr:Updating files: 99% (12356/12473) Updating files: 100% (12473/12473) Updating files: 100% (12473/12473), done. 2024-04-15T00:22:45.773 INFO:tasks.workunit.client.0.smithi031.stderr:Note: switching to 'a9a752df26c63acad72e1b3569fd79a515ca0765'. 2024-04-15T00:22:45.773 INFO:tasks.workunit.client.0.smithi031.stderr: 2024-04-15T00:22:45.773 INFO:tasks.workunit.client.0.smithi031.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-15T00:22:45.773 INFO:tasks.workunit.client.0.smithi031.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-15T00:22:45.774 INFO:tasks.workunit.client.0.smithi031.stderr:state without impacting any branches by switching back to a branch. 2024-04-15T00:22:45.774 INFO:tasks.workunit.client.0.smithi031.stderr: 2024-04-15T00:22:45.774 INFO:tasks.workunit.client.0.smithi031.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-15T00:22:45.774 INFO:tasks.workunit.client.0.smithi031.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-15T00:22:45.774 INFO:tasks.workunit.client.0.smithi031.stderr: 2024-04-15T00:22:45.774 INFO:tasks.workunit.client.0.smithi031.stderr: git switch -c 2024-04-15T00:22:45.774 INFO:tasks.workunit.client.0.smithi031.stderr: 2024-04-15T00:22:45.774 INFO:tasks.workunit.client.0.smithi031.stderr:Or undo this operation with: 2024-04-15T00:22:45.774 INFO:tasks.workunit.client.0.smithi031.stderr: 2024-04-15T00:22:45.774 INFO:tasks.workunit.client.0.smithi031.stderr: git switch - 2024-04-15T00:22:45.774 INFO:tasks.workunit.client.0.smithi031.stderr: 2024-04-15T00:22:45.774 INFO:tasks.workunit.client.0.smithi031.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-15T00:22:45.774 INFO:tasks.workunit.client.0.smithi031.stderr: 2024-04-15T00:22:45.774 INFO:tasks.workunit.client.0.smithi031.stderr:HEAD is now at a9a752df26c Merge pull request #56871 from zdover23/wip-doc-2024-04-14-backport-56870-to-squid 2024-04-15T00:22:45.777 DEBUG:teuthology.orchestra.run.smithi031:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-15T00:22:45.799 INFO:tasks.workunit.client.0.smithi031.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-15T00:22:45.841 INFO:tasks.workunit.client.0.smithi031.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-15T00:22:45.841 INFO:tasks.workunit.client.0.smithi031.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-15T00:22:46.457 INFO:tasks.workunit.client.0.smithi031.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-15T00:22:46.528 INFO:tasks.workunit.client.0.smithi031.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-15T00:22:46.567 INFO:tasks.workunit.client.0.smithi031.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-15T00:22:46.568 INFO:tasks.workunit.client.0.smithi031.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-15T00:22:46.569 INFO:tasks.workunit.client.0.smithi031.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-15T00:22:46.607 INFO:tasks.workunit.client.0.smithi031.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-15T00:22:46.610 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-15T00:22:46.610 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-15T00:22:46.666 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2024-04-15T00:22:46.667 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-04-15T00:22:46.667 DEBUG:teuthology.orchestra.run.smithi031:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a9a752df26c63acad72e1b3569fd79a515ca0765 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-04-15T00:22:46.730 INFO:tasks.workunit.client.0.smithi031.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-04-15T00:22:46.731 INFO:tasks.workunit.client.0.smithi031.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/suites 2024-04-15T00:22:46.731 INFO:tasks.workunit.client.0.smithi031.stderr:+ trap -- retry EXIT 2024-04-15T00:22:46.731 INFO:tasks.workunit.client.0.smithi031.stderr:+ rm -rf ffsb 2024-04-15T00:22:46.732 INFO:tasks.workunit.client.0.smithi031.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2024-04-15T00:22:46.736 INFO:tasks.workunit.client.0.smithi031.stderr:Cloning into 'ffsb'... 2024-04-15T00:22:48.580 INFO:tasks.workunit.client.0.smithi031.stderr:+ trap - EXIT 2024-04-15T00:22:48.580 INFO:tasks.workunit.client.0.smithi031.stderr:+ cd ffsb 2024-04-15T00:22:48.581 INFO:tasks.workunit.client.0.smithi031.stderr:+ ./configure 2024-04-15T00:22:48.716 INFO:tasks.workunit.client.0.smithi031.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-04-15T00:22:49.727 INFO:tasks.workunit.client.0.smithi031.stdout:checking whether build environment is sane... yes 2024-04-15T00:22:49.746 INFO:tasks.workunit.client.0.smithi031.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-04-15T00:22:49.747 INFO:tasks.workunit.client.0.smithi031.stdout:checking for gawk... gawk 2024-04-15T00:22:49.774 INFO:tasks.workunit.client.0.smithi031.stdout:checking whether make sets $(MAKE)... yes 2024-04-15T00:22:49.821 INFO:tasks.workunit.client.0.smithi031.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-04-15T00:22:49.822 INFO:tasks.workunit.client.0.smithi031.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-04-15T00:22:49.842 INFO:tasks.workunit.client.0.smithi031.stdout:checking for style of include used by make... GNU 2024-04-15T00:22:49.847 INFO:tasks.workunit.client.0.smithi031.stdout:checking for gcc... gcc 2024-04-15T00:22:49.938 INFO:tasks.workunit.client.0.smithi031.stdout:checking for C compiler default output file name... a.out 2024-04-15T00:22:49.941 INFO:tasks.workunit.client.0.smithi031.stdout:checking whether the C compiler works... yes 2024-04-15T00:22:49.945 INFO:tasks.workunit.client.0.smithi031.stdout:checking whether we are cross compiling... no 2024-04-15T00:22:50.004 INFO:tasks.workunit.client.0.smithi031.stdout:checking for suffix of executables... 2024-04-15T00:22:50.050 INFO:tasks.workunit.client.0.smithi031.stdout:checking for suffix of object files... o 2024-04-15T00:22:50.093 INFO:tasks.workunit.client.0.smithi031.stdout:checking whether we are using the GNU C compiler... yes 2024-04-15T00:22:50.134 INFO:tasks.workunit.client.0.smithi031.stdout:checking whether gcc accepts -g... yes 2024-04-15T00:22:50.226 INFO:tasks.workunit.client.0.smithi031.stdout:checking for gcc option to accept ISO C89... none needed 2024-04-15T00:22:50.392 INFO:tasks.workunit.client.0.smithi031.stdout:checking dependency style of gcc... gcc3 2024-04-15T00:22:50.461 INFO:tasks.workunit.client.0.smithi031.stdout:checking how to run the C preprocessor... gcc -E 2024-04-15T00:22:50.517 INFO:tasks.workunit.client.0.smithi031.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-04-15T00:22:50.518 INFO:tasks.workunit.client.0.smithi031.stdout:checking for egrep... /usr/bin/grep -E 2024-04-15T00:22:50.532 INFO:tasks.workunit.client.0.smithi031.stdout:checking for AIX... no 2024-04-15T00:22:50.553 INFO:tasks.workunit.client.0.smithi031.stdout:checking for gcc... (cached) gcc 2024-04-15T00:22:50.567 INFO:tasks.workunit.client.0.smithi031.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-04-15T00:22:50.568 INFO:tasks.workunit.client.0.smithi031.stdout:checking whether gcc accepts -g... (cached) yes 2024-04-15T00:22:50.569 INFO:tasks.workunit.client.0.smithi031.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-04-15T00:22:50.569 INFO:tasks.workunit.client.0.smithi031.stdout:checking dependency style of gcc... (cached) gcc3 2024-04-15T00:22:50.671 INFO:tasks.workunit.client.0.smithi031.stdout:checking for main in -lm... yes 2024-04-15T00:22:50.748 INFO:tasks.workunit.client.0.smithi031.stdout:checking for main in -lpthread... yes 2024-04-15T00:22:51.081 INFO:tasks.workunit.client.0.smithi031.stdout:checking for ANSI C header files... yes 2024-04-15T00:22:51.188 INFO:tasks.workunit.client.0.smithi031.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-04-15T00:22:51.251 INFO:tasks.workunit.client.0.smithi031.stdout:checking for sys/types.h... yes 2024-04-15T00:22:51.318 INFO:tasks.workunit.client.0.smithi031.stdout:checking for sys/stat.h... yes 2024-04-15T00:22:51.387 INFO:tasks.workunit.client.0.smithi031.stdout:checking for stdlib.h... yes 2024-04-15T00:22:51.456 INFO:tasks.workunit.client.0.smithi031.stdout:checking for string.h... yes 2024-04-15T00:22:51.528 INFO:tasks.workunit.client.0.smithi031.stdout:checking for memory.h... yes 2024-04-15T00:22:51.596 INFO:tasks.workunit.client.0.smithi031.stdout:checking for strings.h... yes 2024-04-15T00:22:51.667 INFO:tasks.workunit.client.0.smithi031.stdout:checking for inttypes.h... yes 2024-04-15T00:22:51.734 INFO:tasks.workunit.client.0.smithi031.stdout:checking for stdint.h... yes 2024-04-15T00:22:51.804 INFO:tasks.workunit.client.0.smithi031.stdout:checking for unistd.h... yes 2024-04-15T00:22:51.895 INFO:tasks.workunit.client.0.smithi031.stdout:checking pthread.h usability... yes 2024-04-15T00:22:51.926 INFO:tasks.workunit.client.0.smithi031.stdout:checking pthread.h presence... yes 2024-04-15T00:22:51.927 INFO:tasks.workunit.client.0.smithi031.stdout:checking for pthread.h... yes 2024-04-15T00:22:52.004 INFO:tasks.workunit.client.0.smithi031.stdout:checking fcntl.h usability... yes 2024-04-15T00:22:52.030 INFO:tasks.workunit.client.0.smithi031.stdout:checking fcntl.h presence... yes 2024-04-15T00:22:52.030 INFO:tasks.workunit.client.0.smithi031.stdout:checking for fcntl.h... yes 2024-04-15T00:22:52.103 INFO:tasks.workunit.client.0.smithi031.stdout:checking limits.h usability... yes 2024-04-15T00:22:52.129 INFO:tasks.workunit.client.0.smithi031.stdout:checking limits.h presence... yes 2024-04-15T00:22:52.130 INFO:tasks.workunit.client.0.smithi031.stdout:checking for limits.h... yes 2024-04-15T00:22:52.150 INFO:tasks.workunit.client.0.smithi031.stdout:checking for stdint.h... (cached) yes 2024-04-15T00:22:52.220 INFO:tasks.workunit.client.0.smithi031.stdout:checking sys/time.h usability... yes 2024-04-15T00:22:52.246 INFO:tasks.workunit.client.0.smithi031.stdout:checking sys/time.h presence... yes 2024-04-15T00:22:52.247 INFO:tasks.workunit.client.0.smithi031.stdout:checking for sys/time.h... yes 2024-04-15T00:22:52.267 INFO:tasks.workunit.client.0.smithi031.stdout:checking for unistd.h... (cached) yes 2024-04-15T00:22:52.335 INFO:tasks.workunit.client.0.smithi031.stdout:checking sys/vfs.h usability... yes 2024-04-15T00:22:52.361 INFO:tasks.workunit.client.0.smithi031.stdout:checking sys/vfs.h presence... yes 2024-04-15T00:22:52.362 INFO:tasks.workunit.client.0.smithi031.stdout:checking for sys/vfs.h... yes 2024-04-15T00:22:52.432 INFO:tasks.workunit.client.0.smithi031.stdout:checking sys/limits.h usability... no 2024-04-15T00:22:52.464 INFO:tasks.workunit.client.0.smithi031.stdout:checking sys/limits.h presence... no 2024-04-15T00:22:52.465 INFO:tasks.workunit.client.0.smithi031.stdout:checking for sys/limits.h... no 2024-04-15T00:22:52.513 INFO:tasks.workunit.client.0.smithi031.stdout:checking for an ANSI C-conforming const... yes 2024-04-15T00:22:52.560 INFO:tasks.workunit.client.0.smithi031.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-04-15T00:22:52.562 INFO:tasks.workunit.client.0.smithi031.stdout:checking for function prototypes... yes 2024-04-15T00:22:52.626 INFO:tasks.workunit.client.0.smithi031.stdout:checking whether setvbuf arguments are reversed... no 2024-04-15T00:22:52.737 INFO:tasks.workunit.client.0.smithi031.stdout:checking for system... yes 2024-04-15T00:22:52.835 INFO:tasks.workunit.client.0.smithi031.stdout:checking for gettimeofday... yes 2024-04-15T00:22:52.924 INFO:tasks.workunit.client.0.smithi031.stdout:checking for mkdir... yes 2024-04-15T00:22:53.017 INFO:tasks.workunit.client.0.smithi031.stdout:checking for strerror... yes 2024-04-15T00:22:53.110 INFO:tasks.workunit.client.0.smithi031.stdout:checking for open64... yes 2024-04-15T00:22:53.204 INFO:tasks.workunit.client.0.smithi031.stdout:checking for stat64... yes 2024-04-15T00:22:53.294 INFO:tasks.workunit.client.0.smithi031.stdout:checking for fseeko64... yes 2024-04-15T00:22:53.392 INFO:tasks.workunit.client.0.smithi031.stdout:checking for lrand48_r... yes 2024-04-15T00:22:53.485 INFO:tasks.workunit.client.0.smithi031.stdout:checking for srand48_r... yes 2024-04-15T00:22:53.517 INFO:tasks.workunit.client.0.smithi031.stdout:configure: creating ./config.status 2024-04-15T00:22:53.680 INFO:tasks.workunit.client.0.smithi031.stdout:config.status: creating Makefile 2024-04-15T00:22:53.712 INFO:tasks.workunit.client.0.smithi031.stdout:config.status: creating config.h 2024-04-15T00:22:53.746 INFO:tasks.workunit.client.0.smithi031.stdout:config.status: executing depfiles commands 2024-04-15T00:22:53.838 INFO:tasks.workunit.client.0.smithi031.stdout:config.status: executing default commands 2024-04-15T00:22:53.897 INFO:tasks.workunit.client.0.smithi031.stderr:+ make 2024-04-15T00:22:53.928 INFO:tasks.workunit.client.0.smithi031.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2024-04-15T00:22:53.934 INFO:tasks.workunit.client.0.smithi031.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-04-15T00:22:53.935 INFO:tasks.workunit.client.0.smithi031.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-04-15T00:22:53.935 INFO:tasks.workunit.client.0.smithi031.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-04-15T00:22:53.935 INFO:tasks.workunit.client.0.smithi031.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-04-15T00:22:53.935 INFO:tasks.workunit.client.0.smithi031.stderr: any GNU archive site. 2024-04-15T00:22:53.940 INFO:tasks.workunit.client.0.smithi031.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2024-04-15T00:22:53.946 INFO:tasks.workunit.client.0.smithi031.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-04-15T00:22:53.947 INFO:tasks.workunit.client.0.smithi031.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-04-15T00:22:53.947 INFO:tasks.workunit.client.0.smithi031.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-04-15T00:22:53.947 INFO:tasks.workunit.client.0.smithi031.stderr: You might want to install the `Automake' and `Perl' packages. 2024-04-15T00:22:53.947 INFO:tasks.workunit.client.0.smithi031.stderr: Grab them from any GNU archive site. 2024-04-15T00:22:54.103 INFO:tasks.workunit.client.0.smithi031.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2024-04-15T00:22:54.417 INFO:tasks.workunit.client.0.smithi031.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-04-15T00:22:54.417 INFO:tasks.workunit.client.0.smithi031.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-04-15T00:22:54.417 INFO:tasks.workunit.client.0.smithi031.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-04-15T00:22:54.417 INFO:tasks.workunit.client.0.smithi031.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-04-15T00:22:54.557 INFO:tasks.workunit.client.0.smithi031.stdout:/bin/sh ./config.status --recheck 2024-04-15T00:22:54.624 INFO:tasks.workunit.client.0.smithi031.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2024-04-15T00:22:54.804 INFO:tasks.workunit.client.0.smithi031.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-04-15T00:22:55.815 INFO:tasks.workunit.client.0.smithi031.stdout:checking whether build environment is sane... yes 2024-04-15T00:22:55.826 INFO:tasks.workunit.client.0.smithi031.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-04-15T00:22:55.827 INFO:tasks.workunit.client.0.smithi031.stdout:checking for gawk... gawk 2024-04-15T00:22:55.852 INFO:tasks.workunit.client.0.smithi031.stdout:checking whether make sets $(MAKE)... yes 2024-04-15T00:22:55.898 INFO:tasks.workunit.client.0.smithi031.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-04-15T00:22:55.899 INFO:tasks.workunit.client.0.smithi031.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-04-15T00:22:55.920 INFO:tasks.workunit.client.0.smithi031.stdout:checking for style of include used by make... GNU 2024-04-15T00:22:55.925 INFO:tasks.workunit.client.0.smithi031.stdout:checking for gcc... gcc 2024-04-15T00:22:56.051 INFO:tasks.workunit.client.0.smithi031.stdout:checking whether the C compiler works... yes 2024-04-15T00:22:56.051 INFO:tasks.workunit.client.0.smithi031.stdout:checking for C compiler default output file name... a.out 2024-04-15T00:22:56.107 INFO:tasks.workunit.client.0.smithi031.stdout:checking for suffix of executables... 2024-04-15T00:22:56.162 INFO:tasks.workunit.client.0.smithi031.stdout:checking whether we are cross compiling... no 2024-04-15T00:22:56.209 INFO:tasks.workunit.client.0.smithi031.stdout:checking for suffix of object files... o 2024-04-15T00:22:56.246 INFO:tasks.workunit.client.0.smithi031.stdout:checking whether we are using the GNU C compiler... yes 2024-04-15T00:22:56.279 INFO:tasks.workunit.client.0.smithi031.stdout:checking whether gcc accepts -g... yes 2024-04-15T00:22:56.323 INFO:tasks.workunit.client.0.smithi031.stdout:checking for gcc option to accept ISO C89... none needed 2024-04-15T00:22:56.479 INFO:tasks.workunit.client.0.smithi031.stdout:checking dependency style of gcc... gcc3 2024-04-15T00:22:56.541 INFO:tasks.workunit.client.0.smithi031.stdout:checking how to run the C preprocessor... gcc -E 2024-04-15T00:22:56.607 INFO:tasks.workunit.client.0.smithi031.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-04-15T00:22:56.608 INFO:tasks.workunit.client.0.smithi031.stdout:checking for egrep... /usr/bin/grep -E 2024-04-15T00:22:57.026 INFO:tasks.workunit.client.0.smithi031.stdout:checking for ANSI C header files... yes 2024-04-15T00:22:57.089 INFO:tasks.workunit.client.0.smithi031.stdout:checking for sys/types.h... yes 2024-04-15T00:22:57.162 INFO:tasks.workunit.client.0.smithi031.stdout:checking for sys/stat.h... yes 2024-04-15T00:22:57.228 INFO:tasks.workunit.client.0.smithi031.stdout:checking for stdlib.h... yes 2024-04-15T00:22:57.301 INFO:tasks.workunit.client.0.smithi031.stdout:checking for string.h... yes 2024-04-15T00:22:57.435 INFO:tasks.workunit.client.0.smithi031.stdout:checking for memory.h... yes 2024-04-15T00:22:57.557 INFO:tasks.workunit.client.0.smithi031.stdout:checking for strings.h... yes 2024-04-15T00:22:57.717 INFO:tasks.workunit.client.0.smithi031.stdout:checking for inttypes.h... yes 2024-04-15T00:22:57.810 INFO:tasks.workunit.client.0.smithi031.stdout:checking for stdint.h... yes 2024-04-15T00:22:57.955 INFO:tasks.workunit.client.0.smithi031.stdout:checking for unistd.h... yes 2024-04-15T00:22:58.110 INFO:tasks.workunit.client.0.smithi031.stdout:checking minix/config.h usability... no 2024-04-15T00:22:58.150 INFO:tasks.workunit.client.0.smithi031.stdout:checking minix/config.h presence... no 2024-04-15T00:22:58.151 INFO:tasks.workunit.client.0.smithi031.stdout:checking for minix/config.h... no 2024-04-15T00:22:58.282 INFO:tasks.workunit.client.0.smithi031.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-04-15T00:22:58.293 INFO:tasks.workunit.client.0.smithi031.stdout:checking for gcc... (cached) gcc 2024-04-15T00:22:58.346 INFO:tasks.workunit.client.0.smithi031.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-04-15T00:22:58.346 INFO:tasks.workunit.client.0.smithi031.stdout:checking whether gcc accepts -g... (cached) yes 2024-04-15T00:22:58.346 INFO:tasks.workunit.client.0.smithi031.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-04-15T00:22:58.347 INFO:tasks.workunit.client.0.smithi031.stdout:checking dependency style of gcc... (cached) gcc3 2024-04-15T00:22:58.409 INFO:tasks.workunit.client.0.smithi031.stdout:checking for main in -lm... yes 2024-04-15T00:22:58.475 INFO:tasks.workunit.client.0.smithi031.stdout:checking for main in -lpthread... yes 2024-04-15T00:22:58.479 INFO:tasks.workunit.client.0.smithi031.stdout:checking for ANSI C header files... (cached) yes 2024-04-15T00:22:58.526 INFO:tasks.workunit.client.0.smithi031.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-04-15T00:22:58.586 INFO:tasks.workunit.client.0.smithi031.stdout:checking pthread.h usability... yes 2024-04-15T00:22:58.613 INFO:tasks.workunit.client.0.smithi031.stdout:checking pthread.h presence... yes 2024-04-15T00:22:58.613 INFO:tasks.workunit.client.0.smithi031.stdout:checking for pthread.h... yes 2024-04-15T00:22:58.695 INFO:tasks.workunit.client.0.smithi031.stdout:checking fcntl.h usability... yes 2024-04-15T00:22:58.717 INFO:tasks.workunit.client.0.smithi031.stdout:checking fcntl.h presence... yes 2024-04-15T00:22:58.717 INFO:tasks.workunit.client.0.smithi031.stdout:checking for fcntl.h... yes 2024-04-15T00:22:58.787 INFO:tasks.workunit.client.0.smithi031.stdout:checking limits.h usability... yes 2024-04-15T00:22:58.810 INFO:tasks.workunit.client.0.smithi031.stdout:checking limits.h presence... yes 2024-04-15T00:22:58.810 INFO:tasks.workunit.client.0.smithi031.stdout:checking for limits.h... yes 2024-04-15T00:22:58.830 INFO:tasks.workunit.client.0.smithi031.stdout:checking for stdint.h... (cached) yes 2024-04-15T00:22:58.884 INFO:tasks.workunit.client.0.smithi031.stdout:checking sys/time.h usability... yes 2024-04-15T00:22:58.907 INFO:tasks.workunit.client.0.smithi031.stdout:checking sys/time.h presence... yes 2024-04-15T00:22:58.908 INFO:tasks.workunit.client.0.smithi031.stdout:checking for sys/time.h... yes 2024-04-15T00:22:58.927 INFO:tasks.workunit.client.0.smithi031.stdout:checking for unistd.h... (cached) yes 2024-04-15T00:22:58.980 INFO:tasks.workunit.client.0.smithi031.stdout:checking sys/vfs.h usability... yes 2024-04-15T00:22:59.002 INFO:tasks.workunit.client.0.smithi031.stdout:checking sys/vfs.h presence... yes 2024-04-15T00:22:59.002 INFO:tasks.workunit.client.0.smithi031.stdout:checking for sys/vfs.h... yes 2024-04-15T00:22:59.073 INFO:tasks.workunit.client.0.smithi031.stdout:checking sys/limits.h usability... no 2024-04-15T00:22:59.111 INFO:tasks.workunit.client.0.smithi031.stdout:checking sys/limits.h presence... no 2024-04-15T00:22:59.111 INFO:tasks.workunit.client.0.smithi031.stdout:checking for sys/limits.h... no 2024-04-15T00:22:59.148 INFO:tasks.workunit.client.0.smithi031.stdout:checking for an ANSI C-conforming const... yes 2024-04-15T00:22:59.185 INFO:tasks.workunit.client.0.smithi031.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-04-15T00:22:59.272 INFO:tasks.workunit.client.0.smithi031.stdout:checking for system... yes 2024-04-15T00:22:59.352 INFO:tasks.workunit.client.0.smithi031.stdout:checking for gettimeofday... yes 2024-04-15T00:22:59.435 INFO:tasks.workunit.client.0.smithi031.stdout:checking for mkdir... yes 2024-04-15T00:22:59.516 INFO:tasks.workunit.client.0.smithi031.stdout:checking for strerror... yes 2024-04-15T00:22:59.599 INFO:tasks.workunit.client.0.smithi031.stdout:checking for open64... yes 2024-04-15T00:22:59.693 INFO:tasks.workunit.client.0.smithi031.stdout:checking for stat64... yes 2024-04-15T00:22:59.777 INFO:tasks.workunit.client.0.smithi031.stdout:checking for fseeko64... yes 2024-04-15T00:22:59.857 INFO:tasks.workunit.client.0.smithi031.stdout:checking for lrand48_r... yes 2024-04-15T00:22:59.942 INFO:tasks.workunit.client.0.smithi031.stdout:checking for srand48_r... yes 2024-04-15T00:22:59.970 INFO:tasks.workunit.client.0.smithi031.stdout:configure: creating ./config.status 2024-04-15T00:23:00.071 INFO:tasks.workunit.client.0.smithi031.stdout: /bin/sh ./config.status 2024-04-15T00:23:00.139 INFO:tasks.workunit.client.0.smithi031.stdout:config.status: creating Makefile 2024-04-15T00:23:00.166 INFO:tasks.workunit.client.0.smithi031.stdout:config.status: creating config.h 2024-04-15T00:23:00.191 INFO:tasks.workunit.client.0.smithi031.stdout:config.status: executing depfiles commands 2024-04-15T00:23:00.211 INFO:tasks.workunit.client.0.smithi031.stdout:config.status: executing default commands 2024-04-15T00:23:00.264 INFO:tasks.workunit.client.0.smithi031.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2024-04-15T00:23:00.443 INFO:tasks.workunit.client.0.smithi031.stdout:rm -f stamp-h1 2024-04-15T00:23:00.446 INFO:tasks.workunit.client.0.smithi031.stdout:touch config.h.in 2024-04-15T00:23:00.449 INFO:tasks.workunit.client.0.smithi031.stdout:cd . && /bin/sh ./config.status config.h 2024-04-15T00:23:00.507 INFO:tasks.workunit.client.0.smithi031.stdout:config.status: creating config.h 2024-04-15T00:23:00.545 INFO:tasks.workunit.client.0.smithi031.stdout:make all-am 2024-04-15T00:23:00.570 INFO:tasks.workunit.client.0.smithi031.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-04-15T00:23:00.570 INFO:tasks.workunit.client.0.smithi031.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-04-15T00:23:00.776 INFO:tasks.workunit.client.0.smithi031.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-04-15T00:23:00.783 INFO:tasks.workunit.client.0.smithi031.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-04-15T00:23:00.931 INFO:tasks.workunit.client.0.smithi031.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-04-15T00:23:00.945 INFO:tasks.workunit.client.0.smithi031.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-04-15T00:23:01.085 INFO:tasks.workunit.client.0.smithi031.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-04-15T00:23:01.095 INFO:tasks.workunit.client.0.smithi031.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-04-15T00:23:01.238 INFO:tasks.workunit.client.0.smithi031.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-04-15T00:23:01.244 INFO:tasks.workunit.client.0.smithi031.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-04-15T00:23:01.428 INFO:tasks.workunit.client.0.smithi031.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-04-15T00:23:01.434 INFO:tasks.workunit.client.0.smithi031.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-04-15T00:23:01.537 INFO:tasks.workunit.client.0.smithi031.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-04-15T00:23:01.543 INFO:tasks.workunit.client.0.smithi031.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-04-15T00:23:01.616 INFO:tasks.workunit.client.0.smithi031.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-04-15T00:23:01.622 INFO:tasks.workunit.client.0.smithi031.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-04-15T00:23:01.727 INFO:tasks.workunit.client.0.smithi031.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-04-15T00:23:01.750 INFO:tasks.workunit.client.0.smithi031.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-04-15T00:23:01.995 INFO:tasks.workunit.client.0.smithi031.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-04-15T00:23:02.001 INFO:tasks.workunit.client.0.smithi031.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-04-15T00:23:02.184 INFO:tasks.workunit.client.0.smithi031.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-04-15T00:23:02.191 INFO:tasks.workunit.client.0.smithi031.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-04-15T00:23:02.404 INFO:tasks.workunit.client.0.smithi031.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-04-15T00:23:02.416 INFO:tasks.workunit.client.0.smithi031.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-04-15T00:23:02.530 INFO:tasks.workunit.client.0.smithi031.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-04-15T00:23:02.540 INFO:tasks.workunit.client.0.smithi031.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-04-15T00:23:02.658 INFO:tasks.workunit.client.0.smithi031.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-04-15T00:23:02.668 INFO:tasks.workunit.client.0.smithi031.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-04-15T00:23:02.841 INFO:tasks.workunit.client.0.smithi031.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-04-15T00:23:02.854 INFO:tasks.workunit.client.0.smithi031.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-04-15T00:23:02.921 INFO:tasks.workunit.client.0.smithi031.stderr:In file included from parser.h:22, 2024-04-15T00:23:02.921 INFO:tasks.workunit.client.0.smithi031.stderr: from parser.c:25: 2024-04-15T00:23:02.921 INFO:tasks.workunit.client.0.smithi031.stderr:parser.c: In function ‘init_filesys’: 2024-04-15T00:23:02.923 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-15T00:23:02.923 INFO:tasks.workunit.client.0.smithi031.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-15T00:23:02.923 INFO:tasks.workunit.client.0.smithi031.stderr: | ^ 2024-04-15T00:23:02.923 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-15T00:23:02.923 INFO:tasks.workunit.client.0.smithi031.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-15T00:23:02.923 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~ 2024-04-15T00:23:02.923 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-15T00:23:02.923 INFO:tasks.workunit.client.0.smithi031.stderr: 36 | container_of(ptr, type, member) 2024-04-15T00:23:02.923 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~~~~~ 2024-04-15T00:23:02.923 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-04-15T00:23:02.923 INFO:tasks.workunit.client.0.smithi031.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-04-15T00:23:02.923 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~~~ 2024-04-15T00:23:02.924 INFO:tasks.workunit.client.0.smithi031.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-04-15T00:23:02.924 INFO:tasks.workunit.client.0.smithi031.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-04-15T00:23:02.924 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-15T00:23:02.924 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-15T00:23:02.924 INFO:tasks.workunit.client.0.smithi031.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-15T00:23:02.924 INFO:tasks.workunit.client.0.smithi031.stderr: | ^ 2024-04-15T00:23:02.924 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-15T00:23:02.924 INFO:tasks.workunit.client.0.smithi031.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-15T00:23:02.924 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~ 2024-04-15T00:23:02.924 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-15T00:23:02.924 INFO:tasks.workunit.client.0.smithi031.stderr: 36 | container_of(ptr, type, member) 2024-04-15T00:23:02.924 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~~~~~ 2024-04-15T00:23:02.924 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-04-15T00:23:02.924 INFO:tasks.workunit.client.0.smithi031.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-04-15T00:23:02.924 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~~~ 2024-04-15T00:23:02.925 INFO:tasks.workunit.client.0.smithi031.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-04-15T00:23:02.925 INFO:tasks.workunit.client.0.smithi031.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-04-15T00:23:02.925 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-15T00:23:02.925 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-15T00:23:02.925 INFO:tasks.workunit.client.0.smithi031.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-15T00:23:02.925 INFO:tasks.workunit.client.0.smithi031.stderr: | ^ 2024-04-15T00:23:02.925 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-15T00:23:02.925 INFO:tasks.workunit.client.0.smithi031.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-15T00:23:02.925 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~ 2024-04-15T00:23:02.925 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-15T00:23:02.925 INFO:tasks.workunit.client.0.smithi031.stderr: 36 | container_of(ptr, type, member) 2024-04-15T00:23:02.925 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~~~~~ 2024-04-15T00:23:02.925 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-04-15T00:23:02.925 INFO:tasks.workunit.client.0.smithi031.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-04-15T00:23:02.925 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~~~ 2024-04-15T00:23:02.926 INFO:tasks.workunit.client.0.smithi031.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-04-15T00:23:02.926 INFO:tasks.workunit.client.0.smithi031.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-04-15T00:23:02.926 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-15T00:23:02.926 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-15T00:23:02.926 INFO:tasks.workunit.client.0.smithi031.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-15T00:23:02.926 INFO:tasks.workunit.client.0.smithi031.stderr: | ^ 2024-04-15T00:23:02.926 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-15T00:23:02.926 INFO:tasks.workunit.client.0.smithi031.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-15T00:23:02.926 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~ 2024-04-15T00:23:02.926 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-15T00:23:02.926 INFO:tasks.workunit.client.0.smithi031.stderr: 36 | container_of(ptr, type, member) 2024-04-15T00:23:02.926 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~~~~~ 2024-04-15T00:23:02.926 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-04-15T00:23:02.926 INFO:tasks.workunit.client.0.smithi031.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-04-15T00:23:02.927 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~~~ 2024-04-15T00:23:02.927 INFO:tasks.workunit.client.0.smithi031.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-04-15T00:23:02.927 INFO:tasks.workunit.client.0.smithi031.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-04-15T00:23:02.927 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-15T00:23:02.927 INFO:tasks.workunit.client.0.smithi031.stderr:parser.c: In function ‘init_tg_stats’: 2024-04-15T00:23:02.927 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-15T00:23:02.927 INFO:tasks.workunit.client.0.smithi031.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-15T00:23:02.927 INFO:tasks.workunit.client.0.smithi031.stderr: | ^ 2024-04-15T00:23:02.927 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-15T00:23:02.927 INFO:tasks.workunit.client.0.smithi031.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-15T00:23:02.927 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~ 2024-04-15T00:23:02.927 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-15T00:23:02.927 INFO:tasks.workunit.client.0.smithi031.stderr: 36 | container_of(ptr, type, member) 2024-04-15T00:23:02.928 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~~~~~ 2024-04-15T00:23:02.928 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-04-15T00:23:02.928 INFO:tasks.workunit.client.0.smithi031.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-04-15T00:23:02.928 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~~~ 2024-04-15T00:23:02.928 INFO:tasks.workunit.client.0.smithi031.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-04-15T00:23:02.928 INFO:tasks.workunit.client.0.smithi031.stderr: 971 | list_for_each_entry(tmp_list, 2024-04-15T00:23:02.928 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-15T00:23:02.928 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-15T00:23:02.928 INFO:tasks.workunit.client.0.smithi031.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-15T00:23:02.928 INFO:tasks.workunit.client.0.smithi031.stderr: | ^ 2024-04-15T00:23:02.928 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-15T00:23:02.928 INFO:tasks.workunit.client.0.smithi031.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-15T00:23:02.928 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~ 2024-04-15T00:23:02.928 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-15T00:23:02.928 INFO:tasks.workunit.client.0.smithi031.stderr: 36 | container_of(ptr, type, member) 2024-04-15T00:23:02.929 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~~~~~ 2024-04-15T00:23:02.929 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-04-15T00:23:02.929 INFO:tasks.workunit.client.0.smithi031.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-04-15T00:23:02.929 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~~~ 2024-04-15T00:23:02.929 INFO:tasks.workunit.client.0.smithi031.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-04-15T00:23:02.929 INFO:tasks.workunit.client.0.smithi031.stderr: 971 | list_for_each_entry(tmp_list, 2024-04-15T00:23:02.929 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-15T00:23:02.929 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-15T00:23:02.929 INFO:tasks.workunit.client.0.smithi031.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-15T00:23:02.929 INFO:tasks.workunit.client.0.smithi031.stderr: | ^ 2024-04-15T00:23:02.929 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-15T00:23:02.929 INFO:tasks.workunit.client.0.smithi031.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-15T00:23:02.929 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~ 2024-04-15T00:23:02.929 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-15T00:23:02.929 INFO:tasks.workunit.client.0.smithi031.stderr: 36 | container_of(ptr, type, member) 2024-04-15T00:23:02.930 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~~~~~ 2024-04-15T00:23:02.930 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-04-15T00:23:02.930 INFO:tasks.workunit.client.0.smithi031.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-04-15T00:23:02.930 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~~~ 2024-04-15T00:23:02.930 INFO:tasks.workunit.client.0.smithi031.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-04-15T00:23:02.930 INFO:tasks.workunit.client.0.smithi031.stderr: 980 | list_for_each_entry(tmp_list, 2024-04-15T00:23:02.930 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-15T00:23:02.930 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-15T00:23:02.930 INFO:tasks.workunit.client.0.smithi031.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-15T00:23:02.930 INFO:tasks.workunit.client.0.smithi031.stderr: | ^ 2024-04-15T00:23:02.930 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-15T00:23:02.930 INFO:tasks.workunit.client.0.smithi031.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-15T00:23:02.930 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~ 2024-04-15T00:23:02.930 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-15T00:23:02.931 INFO:tasks.workunit.client.0.smithi031.stderr: 36 | container_of(ptr, type, member) 2024-04-15T00:23:02.931 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~~~~~ 2024-04-15T00:23:02.931 INFO:tasks.workunit.client.0.smithi031.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-04-15T00:23:02.931 INFO:tasks.workunit.client.0.smithi031.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-04-15T00:23:02.931 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~~~ 2024-04-15T00:23:02.931 INFO:tasks.workunit.client.0.smithi031.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-04-15T00:23:02.931 INFO:tasks.workunit.client.0.smithi031.stderr: 980 | list_for_each_entry(tmp_list, 2024-04-15T00:23:02.931 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-15T00:23:02.975 INFO:tasks.workunit.client.0.smithi031.stderr:parser.c: In function ‘get_optstr’: 2024-04-15T00:23:02.975 INFO:tasks.workunit.client.0.smithi031.stderr:parser.c:206:23: warning: ‘strnlen’ specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-04-15T00:23:02.975 INFO:tasks.workunit.client.0.smithi031.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-04-15T00:23:02.975 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-15T00:23:02.975 INFO:tasks.workunit.client.0.smithi031.stderr:parser.c:200:14: note: source object declared here 2024-04-15T00:23:02.976 INFO:tasks.workunit.client.0.smithi031.stderr: 200 | char temp[BUFSIZE]; 2024-04-15T00:23:02.976 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~ 2024-04-15T00:23:02.982 INFO:tasks.workunit.client.0.smithi031.stderr:parser.c: In function ‘size64_convert’: 2024-04-15T00:23:02.982 INFO:tasks.workunit.client.0.smithi031.stderr:parser.c:119:9: warning: ‘memcpy’ reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-04-15T00:23:02.982 INFO:tasks.workunit.client.0.smithi031.stderr: 119 | memcpy(unit, "\0", 3); 2024-04-15T00:23:02.982 INFO:tasks.workunit.client.0.smithi031.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-15T00:23:03.281 INFO:tasks.workunit.client.0.smithi031.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-04-15T00:23:03.287 INFO:tasks.workunit.client.0.smithi031.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-04-15T00:23:03.391 INFO:tasks.workunit.client.0.smithi031.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-04-15T00:23:03.402 INFO:tasks.workunit.client.0.smithi031.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-04-15T00:23:03.536 INFO:tasks.workunit.client.0.smithi031.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-04-15T00:23:03.546 INFO:tasks.workunit.client.0.smithi031.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-04-15T00:23:03.599 INFO:tasks.workunit.client.0.smithi031.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-04-15T00:23:03.606 INFO:tasks.workunit.client.0.smithi031.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-04-15T00:23:03.716 INFO:tasks.workunit.client.0.smithi031.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-04-15T00:23:03.717 INFO:tasks.workunit.client.0.smithi031.stderr:+ cd .. 2024-04-15T00:23:03.718 INFO:tasks.workunit.client.0.smithi031.stderr:+ mkdir tmp 2024-04-15T00:23:03.721 INFO:tasks.workunit.client.0.smithi031.stderr:+ cd tmp 2024-04-15T00:23:03.722 INFO:tasks.workunit.client.0.smithi031.stderr:+ for f in $mydir/*.ffsb 2024-04-15T00:23:03.722 INFO:tasks.workunit.client.0.smithi031.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/random_write.32.ffsb 2024-04-15T00:23:03.723 INFO:tasks.workunit.client.0.smithi031.stdout:FFSB version 6.0-RC2 started 2024-04-15T00:23:03.723 INFO:tasks.workunit.client.0.smithi031.stdout: 2024-04-15T00:23:03.726 INFO:tasks.workunit.client.0.smithi031.stdout:benchmark time = 300 2024-04-15T00:23:03.726 INFO:tasks.workunit.client.0.smithi031.stdout:ThreadGroup 0 2024-04-15T00:23:03.726 INFO:tasks.workunit.client.0.smithi031.stdout:================ 2024-04-15T00:23:03.726 INFO:tasks.workunit.client.0.smithi031.stdout: num_threads = 32 2024-04-15T00:23:03.726 INFO:tasks.workunit.client.0.smithi031.stdout: 2024-04-15T00:23:03.726 INFO:tasks.workunit.client.0.smithi031.stdout: read_random = off 2024-04-15T00:23:03.726 INFO:tasks.workunit.client.0.smithi031.stdout: read_size = 0 (0B) 2024-04-15T00:23:03.726 INFO:tasks.workunit.client.0.smithi031.stdout: read_blocksize = 0 (0B) 2024-04-15T00:23:03.726 INFO:tasks.workunit.client.0.smithi031.stdout: read_skip = off 2024-04-15T00:23:03.726 INFO:tasks.workunit.client.0.smithi031.stdout: read_skipsize = 0 (0B) 2024-04-15T00:23:03.726 INFO:tasks.workunit.client.0.smithi031.stdout: 2024-04-15T00:23:03.727 INFO:tasks.workunit.client.0.smithi031.stdout: write_random = on 2024-04-15T00:23:03.727 INFO:tasks.workunit.client.0.smithi031.stdout: write_size = 5242880 (5MB) 2024-04-15T00:23:03.727 INFO:tasks.workunit.client.0.smithi031.stdout: fsync_file = 0 2024-04-15T00:23:03.727 INFO:tasks.workunit.client.0.smithi031.stdout: write_blocksize = 4096 (4KB) 2024-04-15T00:23:03.727 INFO:tasks.workunit.client.0.smithi031.stdout: wait time = 0 2024-04-15T00:23:03.727 INFO:tasks.workunit.client.0.smithi031.stdout: 2024-04-15T00:23:03.727 INFO:tasks.workunit.client.0.smithi031.stdout: op weights 2024-04-15T00:23:03.727 INFO:tasks.workunit.client.0.smithi031.stdout: read = 0 (0.00%) 2024-04-15T00:23:03.727 INFO:tasks.workunit.client.0.smithi031.stdout: readall = 0 (0.00%) 2024-04-15T00:23:03.727 INFO:tasks.workunit.client.0.smithi031.stdout: write = 1 (100.00%) 2024-04-15T00:23:03.727 INFO:tasks.workunit.client.0.smithi031.stdout: create = 0 (0.00%) 2024-04-15T00:23:03.727 INFO:tasks.workunit.client.0.smithi031.stdout: append = 0 (0.00%) 2024-04-15T00:23:03.727 INFO:tasks.workunit.client.0.smithi031.stdout: delete = 0 (0.00%) 2024-04-15T00:23:03.727 INFO:tasks.workunit.client.0.smithi031.stdout: metaop = 0 (0.00%) 2024-04-15T00:23:03.727 INFO:tasks.workunit.client.0.smithi031.stdout: createdir = 0 (0.00%) 2024-04-15T00:23:03.728 INFO:tasks.workunit.client.0.smithi031.stdout: stat = 0 (0.00%) 2024-04-15T00:23:03.728 INFO:tasks.workunit.client.0.smithi031.stdout: writeall = 0 (0.00%) 2024-04-15T00:23:03.728 INFO:tasks.workunit.client.0.smithi031.stdout: writeall_fsync = 0 (0.00%) 2024-04-15T00:23:03.728 INFO:tasks.workunit.client.0.smithi031.stdout: open_close = 0 (0.00%) 2024-04-15T00:23:03.728 INFO:tasks.workunit.client.0.smithi031.stdout: write_fsync = 0 (0.00%) 2024-04-15T00:23:03.728 INFO:tasks.workunit.client.0.smithi031.stdout: create_fsync = 0 (0.00%) 2024-04-15T00:23:03.728 INFO:tasks.workunit.client.0.smithi031.stdout: append_fsync = 0 (0.00%) 2024-04-15T00:23:03.728 INFO:tasks.workunit.client.0.smithi031.stdout: 2024-04-15T00:23:03.728 INFO:tasks.workunit.client.0.smithi031.stdout:FileSystem . 2024-04-15T00:23:03.728 INFO:tasks.workunit.client.0.smithi031.stdout:========== 2024-04-15T00:23:03.728 INFO:tasks.workunit.client.0.smithi031.stdout: num_dirs = 0 2024-04-15T00:23:03.728 INFO:tasks.workunit.client.0.smithi031.stdout: starting files = 128 2024-04-15T00:23:03.728 INFO:tasks.workunit.client.0.smithi031.stdout: 2024-04-15T00:23:03.728 INFO:tasks.workunit.client.0.smithi031.stdout: min file size = 104857600 (100MB) 2024-04-15T00:23:03.728 INFO:tasks.workunit.client.0.smithi031.stdout: max file size = 104857600 (100MB) 2024-04-15T00:23:03.728 INFO:tasks.workunit.client.0.smithi031.stdout: directio = off 2024-04-15T00:23:03.729 INFO:tasks.workunit.client.0.smithi031.stdout: alignedio = on 2024-04-15T00:23:03.729 INFO:tasks.workunit.client.0.smithi031.stdout: bufferedio = off 2024-04-15T00:23:03.729 INFO:tasks.workunit.client.0.smithi031.stdout: 2024-04-15T00:23:03.729 INFO:tasks.workunit.client.0.smithi031.stdout: aging is off 2024-04-15T00:23:03.729 INFO:tasks.workunit.client.0.smithi031.stdout: current utilization = 0.04% 2024-04-15T00:23:03.729 INFO:tasks.workunit.client.0.smithi031.stdout: 2024-04-15T00:23:03.729 INFO:tasks.workunit.client.0.smithi031.stdout:checking existing fs: . 2024-04-15T00:23:03.729 INFO:tasks.workunit.client.0.smithi031.stdout:recreating new fileset 2024-04-15T00:23:03.729 INFO:tasks.workunit.client.0.smithi031.stderr:opendir: No such file or directory 2024-04-15T00:23:10.900 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:23:10.903 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:23:40.978 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:23:40.981 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:24:11.028 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:24:11.031 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:24:41.102 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:24:41.105 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:25:11.157 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:25:11.160 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:25:41.222 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:25:41.225 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:26:11.286 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:26:11.290 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:26:41.586 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:26:41.588 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:27:11.639 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:27:11.643 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:27:41.704 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:27:41.708 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:28:11.848 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:28:11.888 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:28:41.941 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:28:41.944 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:29:12.312 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:29:12.315 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:29:42.371 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:29:42.375 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:30:12.461 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:30:12.465 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:30:42.708 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:30:42.712 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:30:51.196 INFO:tasks.workunit.client.0.smithi031.stdout:fs setup took 467 secs 2024-04-15T00:30:53.023 INFO:tasks.workunit.client.0.smithi031.stdout:Syncing()...1 sec 2024-04-15T00:30:53.023 INFO:tasks.workunit.client.0.smithi031.stdout:Starting Actual Benchmark At: Mon Apr 15 00:30:53 2024 2024-04-15T00:30:53.023 INFO:tasks.workunit.client.0.smithi031.stdout: 2024-04-15T00:31:13.032 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:31:13.038 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:31:29.866 INFO:tasks.workunit.client.0.smithi031.stdout:Wrote -1 instead of 4096 bytes. 2024-04-15T00:31:29.867 INFO:tasks.workunit.client.0.smithi031.stdout:Probably out of disk space 2024-04-15T00:31:29.867 INFO:tasks.workunit.client.0.smithi031.stderr:write: Bad file descriptor 2024-04-15T00:31:29.882 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T00:31:29.882 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2024-04-15T00:31:29.883 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-15T00:31:30.387 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/ffsb.sh) on smithi031 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a9a752df26c63acad72e1b3569fd79a515ca0765 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh' 2024-04-15T00:31:30.719 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=c428e2498c374387935e4fd65dae4d97 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/ffsb.sh) on smithi031 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a9a752df26c63acad72e1b3569fd79a515ca0765 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh' 2024-04-15T00:31:30.722 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-04-15T00:31:30.772 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:31:32.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.614+0000 7fc6afb64640 1 Processor -- start 2024-04-15T00:31:32.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.614+0000 7fc6afb64640 1 -- start start 2024-04-15T00:31:32.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.615+0000 7fc6afb64640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc6a8141ab0 0x7fc6a80b7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:32.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.615+0000 7fc6afb64640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6a80b0bc0 con 0x7fc6a8147f50 2024-04-15T00:31:32.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.615+0000 7fc6afb64640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6a80b0e60 con 0x7fc6a80b1a90 2024-04-15T00:31:32.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.615+0000 7fc6afb64640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fc6a8141e90 con 0x7fc6a8141ab0 2024-04-15T00:31:32.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.617+0000 7fc6ad900640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc6a8141ab0 0x7fc6a80b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:32.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.617+0000 7fc6ad900640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc6a8141ab0 0x7fc6a80b7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58906/0 (socket says 172.21.15.31:58906) 2024-04-15T00:31:32.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.617+0000 7fc6ad900640 1 -- 172.21.15.31:0/2148727862 learned_addr learned my addr 172.21.15.31:0/2148727862 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:32.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.617+0000 7fc6ac8fe640 1 -- 172.21.15.31:0/2148727862 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3685654492 0 0) 0x7fc6a80b0e60 con 0x7fc6a80b1a90 2024-04-15T00:31:32.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.617+0000 7fc6ad900640 1 -- 172.21.15.31:0/2148727862 >> v1:172.21.15.50:6789/0 conn(0x7fc6a80b1a90 legacy=0x7fc6a8147840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:32.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.617+0000 7fc6ad900640 1 -- 172.21.15.31:0/2148727862 >> v1:172.21.15.31:6789/0 conn(0x7fc6a8147f50 legacy=0x7fc6a8151ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:32.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.617+0000 7fc6ad900640 1 -- 172.21.15.31:0/2148727862 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6a80b1140 con 0x7fc6a8141ab0 2024-04-15T00:31:32.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.621+0000 7fc6ad900640 1 --2- 172.21.15.31:0/2148727862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6a8141ab0 0x7fc6a80b7610 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc6a80724d0 tx=0x7fc6a402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8ac9e74f75339 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:32.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.622+0000 7fc6ac8fe640 1 -- 172.21.15.31:0/2148727862 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a40317c0 con 0x7fc6a8141ab0 2024-04-15T00:31:32.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.622+0000 7fc6ac8fe640 1 -- 172.21.15.31:0/2148727862 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6a4037070 con 0x7fc6a8141ab0 2024-04-15T00:31:32.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.623+0000 7fc6afb64640 1 -- 172.21.15.31:0/2148727862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6a8141ab0 msgr2=0x7fc6a80b7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:32.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.623+0000 7fc6ac8fe640 1 -- 172.21.15.31:0/2148727862 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a40317c0 con 0x7fc6a8141ab0 2024-04-15T00:31:32.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.623+0000 7fc6afb64640 1 --2- 172.21.15.31:0/2148727862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6a8141ab0 0x7fc6a80b7610 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc6a80724d0 tx=0x7fc6a402b860 comp rx=0 tx=0).stop 2024-04-15T00:31:32.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.623+0000 7fc6afb64640 1 -- 172.21.15.31:0/2148727862 shutdown_connections 2024-04-15T00:31:32.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.623+0000 7fc6afb64640 1 --2- 172.21.15.31:0/2148727862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6a8141ab0 0x7fc6a80b7610 secure :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc6a80724d0 tx=0x7fc6a402b860 comp rx=0 tx=0).stop 2024-04-15T00:31:32.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.623+0000 7fc6afb64640 1 -- 172.21.15.31:0/2148727862 >> 172.21.15.31:0/2148727862 conn(0x7fc6a80bae10 msgr2=0x7fc6a80bb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:32.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.624+0000 7fc6afb64640 1 -- 172.21.15.31:0/2148727862 shutdown_connections 2024-04-15T00:31:32.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.625+0000 7fc6afb64640 1 -- 172.21.15.31:0/2148727862 wait complete. 2024-04-15T00:31:32.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.626+0000 7fc6afb64640 1 Processor -- start 2024-04-15T00:31:32.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.626+0000 7fc6afb64640 1 -- start start 2024-04-15T00:31:32.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.627+0000 7fc6afb64640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc6a80b1a90 0x7fc6a806b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:32.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.628+0000 7fc6afb64640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a8147f50 0x7fc6a8149e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:32.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.628+0000 7fc6afb64640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6a813d990 0x7fc6a81e5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:32.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.628+0000 7fc6afb64640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a80b0450 con 0x7fc6a813d990 2024-04-15T00:31:32.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.628+0000 7fc6afb64640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a80b14b0 con 0x7fc6a8147f50 2024-04-15T00:31:32.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.628+0000 7fc6afb64640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fc6a80b55b0 con 0x7fc6a80b1a90 2024-04-15T00:31:32.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.628+0000 7fc6ad0ff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a8147f50 0x7fc6a8149e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:32.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.628+0000 7fc6ae101640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6a813d990 0x7fc6a81e5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:32.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.628+0000 7fc6ad900640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc6a80b1a90 0x7fc6a806b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:32.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.629+0000 7fc6ad900640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc6a80b1a90 0x7fc6a806b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.31:59388/0 (socket says 172.21.15.31:59388) 2024-04-15T00:31:32.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.629+0000 7fc6ad900640 1 -- 172.21.15.31:0/400973079 learned_addr learned my addr 172.21.15.31:0/400973079 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:32.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.629+0000 7fc6ae101640 1 -- 172.21.15.31:0/400973079 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc6a80b1a90 msgr2=0x7fc6a806b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:32.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.629+0000 7fc6ae101640 1 --2- 172.21.15.31:0/400973079 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc6a80b1a90 0x7fc6a806b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:32.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.629+0000 7fc6ae101640 1 -- 172.21.15.31:0/400973079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a8147f50 msgr2=0x7fc6a8149e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:32.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.629+0000 7fc6ae101640 1 --2- 172.21.15.31:0/400973079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a8147f50 0x7fc6a8149e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:32.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.629+0000 7fc6ae101640 1 -- 172.21.15.31:0/400973079 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6a8149140 con 0x7fc6a813d990 2024-04-15T00:31:32.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.630+0000 7fc6ae101640 1 --2- 172.21.15.31:0/400973079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6a813d990 0x7fc6a81e5150 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc6a000c8e0 tx=0x7fc6a000cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:32.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.630+0000 7fc69e7fc640 1 -- 172.21.15.31:0/400973079 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0016020 con 0x7fc6a813d990 2024-04-15T00:31:32.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.631+0000 7fc6afb64640 1 -- 172.21.15.31:0/400973079 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6a8149690 con 0x7fc6a813d990 2024-04-15T00:31:32.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.631+0000 7fc6afb64640 1 -- 172.21.15.31:0/400973079 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6a81493b0 con 0x7fc6a813d990 2024-04-15T00:31:32.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.632+0000 7fc69e7fc640 1 -- 172.21.15.31:0/400973079 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6a000a860 con 0x7fc6a813d990 2024-04-15T00:31:32.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.632+0000 7fc6afb64640 1 -- 172.21.15.31:0/400973079 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6a80725a0 con 0x7fc6a813d990 2024-04-15T00:31:32.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.634+0000 7fc69e7fc640 1 -- 172.21.15.31:0/400973079 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a000ac50 con 0x7fc6a813d990 2024-04-15T00:31:32.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.636+0000 7fc69e7fc640 1 -- 172.21.15.31:0/400973079 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc6a0019020 con 0x7fc6a813d990 2024-04-15T00:31:32.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.636+0000 7fc69e7fc640 1 --2- 172.21.15.31:0/400973079 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc68c06ba10 0x7fc68c06ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:32.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.637+0000 7fc69e7fc640 1 -- 172.21.15.31:0/400973079 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fc6a008ac30 con 0x7fc6a813d990 2024-04-15T00:31:32.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.637+0000 7fc6ad900640 1 --2- 172.21.15.31:0/400973079 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc68c06ba10 0x7fc68c06ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:32.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.638+0000 7fc6ad900640 1 --2- 172.21.15.31:0/400973079 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc68c06ba10 0x7fc68c06ded0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4000c00 tx=0x7fc6a4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:32.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.645+0000 7fc69e7fc640 1 -- 172.21.15.31:0/400973079 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc6a0020020 con 0x7fc6a813d990 2024-04-15T00:31:32.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.987+0000 7fc6afb64640 1 -- 172.21.15.31:0/400973079 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc6a804f620 con 0x7fc6a813d990 2024-04-15T00:31:32.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.989+0000 7fc69e7fc640 1 -- 172.21.15.31:0/400973079 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18841 (secure 0 0 0) 0x7fc6a0058f60 con 0x7fc6a813d990 2024-04-15T00:31:32.997 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:31:32.998 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":27,"fsid":"b57c03ab-2810-4ea5-b233-6164468328c0","created":"2024-04-15T00:20:44.073217+0000","modified":"2024-04-15T00:21:49.696289+0000","last_up_change":"2024-04-15T00:20:55.515596+0000","last_in_change":"2024-04-15T00:20:46.364541+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:20:56.423161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:21:06.436169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:21:06.888505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:21:10.610300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b085a2f4-5565-4ccc-a98e-e56180791550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6817","nonce":2355720818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6819","nonce":2355720818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6823","nonce":2355720818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6821","nonce":2355720818}]},"public_addr":"172.21.15.31:6817/2355720818","cluster_addr":"172.21.15.31:6819/2355720818","heartbeat_back_addr":"172.21.15.31:6823/2355720818","heartbeat_front_addr":"172.21.15.31:6821/2355720818","state":["exists","up"]},{"osd":1,"uuid":"0f751557-3f18-464f-8b78-614d19549f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6809","nonce":2705297130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6811","nonce":2705297130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6815","nonce":2705297130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6813","nonce":2705297130}]},"public_addr":"172.21.15.31:6809/2705297130","cluster_addr":"172.21.15.31:6811/2705297130","heartbeat_back_addr":"172.21.15.31:6815/2705297130","heartbeat_front_addr":"172.21.15.31:6813/2705297130","state":["exists","up"]},{"osd":2,"uuid":"17371b09-2bd7-4ef7-926f-e7706319f064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6801","nonce":225061474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6803","nonce":225061474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6807","nonce":225061474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6805","nonce":225061474}]},"public_addr":"172.21.15.31:6801/225061474","cluster_addr":"172.21.15.31:6803/225061474","heartbeat_back_addr":"172.21.15.31:6807/225061474","heartbeat_front_addr":"172.21.15.31:6805/225061474","state":["exists","up"]},{"osd":3,"uuid":"315b6949-f009-4291-9581-aa4912642dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6825","nonce":3722449780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6827","nonce":3722449780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6831","nonce":3722449780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6829","nonce":3722449780}]},"public_addr":"172.21.15.31:6825/3722449780","cluster_addr":"172.21.15.31:6827/3722449780","heartbeat_back_addr":"172.21.15.31:6831/3722449780","heartbeat_front_addr":"172.21.15.31:6829/3722449780","state":["exists","up"]},{"osd":4,"uuid":"e3659369-cc78-4aa8-bd10-a199d4a1569d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6801","nonce":1279970071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6803","nonce":1279970071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6807","nonce":1279970071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6805","nonce":1279970071}]},"public_addr":"172.21.15.50:6801/1279970071","cluster_addr":"172.21.15.50:6803/1279970071","heartbeat_back_addr":"172.21.15.50:6807/1279970071","heartbeat_front_addr":"172.21.15.50:6805/1279970071","state":["exists","up"]},{"osd":5,"uuid":"35c3a4c0-0b45-45d2-85b9-301c347602f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6809","nonce":1589417182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6811","nonce":1589417182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6815","nonce":1589417182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6813","nonce":1589417182}]},"public_addr":"172.21.15.50:6809/1589417182","cluster_addr":"172.21.15.50:6811/1589417182","heartbeat_back_addr":"172.21.15.50:6815/1589417182","heartbeat_front_addr":"172.21.15.50:6813/1589417182","state":["exists","up"]},{"osd":6,"uuid":"20df7a76-245f-4946-9624-6ca9e949227b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6817","nonce":682288274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6819","nonce":682288274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6823","nonce":682288274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6821","nonce":682288274}]},"public_addr":"172.21.15.50:6817/682288274","cluster_addr":"172.21.15.50:6819/682288274","heartbeat_back_addr":"172.21.15.50:6823/682288274","heartbeat_front_addr":"172.21.15.50:6821/682288274","state":["exists","up"]},{"osd":7,"uuid":"95a504b7-e13a-49e6-8484-9dff4d5fc048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6825","nonce":4129060906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6827","nonce":4129060906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6831","nonce":4129060906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6829","nonce":4129060906}]},"public_addr":"172.21.15.50:6825/4129060906","cluster_addr":"172.21.15.50:6827/4129060906","heartbeat_back_addr":"172.21.15.50:6831/4129060906","heartbeat_front_addr":"172.21.15.50:6829/4129060906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.501980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.529961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.540913+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.521396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.448364+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.514136+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.527229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.508950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:31:32.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.991+0000 7fc6afb64640 1 -- 172.21.15.31:0/400973079 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc68c06ba10 msgr2=0x7fc68c06ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:32.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.991+0000 7fc6afb64640 1 --2- 172.21.15.31:0/400973079 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc68c06ba10 0x7fc68c06ded0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4000c00 tx=0x7fc6a4008030 comp rx=0 tx=0).stop 2024-04-15T00:31:33.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.991+0000 7fc6afb64640 1 -- 172.21.15.31:0/400973079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6a813d990 msgr2=0x7fc6a81e5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:33.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.991+0000 7fc6afb64640 1 --2- 172.21.15.31:0/400973079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6a813d990 0x7fc6a81e5150 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc6a000c8e0 tx=0x7fc6a000cda0 comp rx=0 tx=0).stop 2024-04-15T00:31:33.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.991+0000 7fc6afb64640 1 -- 172.21.15.31:0/400973079 shutdown_connections 2024-04-15T00:31:33.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.991+0000 7fc6afb64640 1 --2- 172.21.15.31:0/400973079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6a813d990 0x7fc6a81e5150 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:33.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.991+0000 7fc6afb64640 1 --2- 172.21.15.31:0/400973079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a8147f50 0x7fc6a8149e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:33.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.991+0000 7fc6afb64640 1 --2- 172.21.15.31:0/400973079 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc68c06ba10 0x7fc68c06ded0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:33.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.991+0000 7fc6afb64640 1 --2- 172.21.15.31:0/400973079 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc6a80b1a90 0x7fc6a806b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:33.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.991+0000 7fc6afb64640 1 -- 172.21.15.31:0/400973079 >> 172.21.15.31:0/400973079 conn(0x7fc6a80bae10 msgr2=0x7fc6a80b5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:33.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.991+0000 7fc6afb64640 1 -- 172.21.15.31:0/400973079 shutdown_connections 2024-04-15T00:31:33.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:32.992+0000 7fc6afb64640 1 -- 172.21.15.31:0/400973079 wait complete. 2024-04-15T00:31:33.016 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T00:20:56.423161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T00:21:06.436169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T00:21:06.888505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-15T00:21:10.610300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-15T00:31:33.017 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T00:31:33.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.169+0000 7f4889095640 1 Processor -- start 2024-04-15T00:31:33.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.169+0000 7f4889095640 1 -- start start 2024-04-15T00:31:33.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.170+0000 7f4889095640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f48840b5c50 0x7f48840b1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:33.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.170+0000 7f4889095640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4884072a00 0x7f48840b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:33.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.170+0000 7f4889095640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48840b6030 con 0x7f4884072580 2024-04-15T00:31:33.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.170+0000 7f4889095640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f48840b0d00 con 0x7f4884072a00 2024-04-15T00:31:33.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.170+0000 7f4889095640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f48840af970 con 0x7f48840b5c50 2024-04-15T00:31:33.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.170+0000 7f4882d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f48840b5c50 0x7f48840b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:33.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.170+0000 7f488359e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4884072a00 0x7f48840b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:33.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.170+0000 7f4882d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f48840b5c50 0x7f48840b1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.31:42134/0 (socket says 172.21.15.31:42134) 2024-04-15T00:31:33.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.170+0000 7f4882d9d640 1 -- 172.21.15.31:0/3631070675 learned_addr learned my addr 172.21.15.31:0/3631070675 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:33.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.171+0000 7f4882d9d640 1 -- 172.21.15.31:0/3631070675 >> v2:172.21.15.31:3300/0 conn(0x7f4884072a00 msgr2=0x7f48840b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:33.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.171+0000 7f4882d9d640 1 --2- 172.21.15.31:0/3631070675 >> v2:172.21.15.31:3300/0 conn(0x7f4884072a00 0x7f48840b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:33.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.171+0000 7f4882d9d640 1 -- 172.21.15.31:0/3631070675 >> v1:172.21.15.31:6789/0 conn(0x7f4884072580 legacy=0x7f48840b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:33.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.171+0000 7f4882d9d640 1 -- 172.21.15.31:0/3631070675 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48840af690 con 0x7f48840b5c50 2024-04-15T00:31:33.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.172+0000 7f488359e640 1 --2- 172.21.15.31:0/3631070675 >> v2:172.21.15.31:3300/0 conn(0x7f4884072a00 0x7f48840b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:31:33.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.173+0000 7f4882d9d640 1 --2- 172.21.15.31:0/3631070675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48840b5c50 0x7f48840b1210 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f488406da80 tx=0x7f487402bf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0f01362bf54aa6d server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:33.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.173+0000 7f488259c640 1 -- 172.21.15.31:0/3631070675 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487402cb10 con 0x7f48840b5c50 2024-04-15T00:31:33.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.173+0000 7f488259c640 1 -- 172.21.15.31:0/3631070675 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f487402ccb0 con 0x7f48840b5c50 2024-04-15T00:31:33.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.173+0000 7f488259c640 1 -- 172.21.15.31:0/3631070675 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487402ce60 con 0x7f48840b5c50 2024-04-15T00:31:33.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.174+0000 7f4889095640 1 -- 172.21.15.31:0/3631070675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48840b5c50 msgr2=0x7f48840b1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:33.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.174+0000 7f4889095640 1 --2- 172.21.15.31:0/3631070675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48840b5c50 0x7f48840b1210 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f488406da80 tx=0x7f487402bf70 comp rx=0 tx=0).stop 2024-04-15T00:31:33.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.174+0000 7f4889095640 1 -- 172.21.15.31:0/3631070675 shutdown_connections 2024-04-15T00:31:33.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.174+0000 7f4889095640 1 --2- 172.21.15.31:0/3631070675 >> v2:172.21.15.31:3300/0 conn(0x7f4884072a00 0x7f48840b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:33.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.174+0000 7f4889095640 1 --2- 172.21.15.31:0/3631070675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48840b5c50 0x7f48840b1210 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:33.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.174+0000 7f4889095640 1 -- 172.21.15.31:0/3631070675 >> 172.21.15.31:0/3631070675 conn(0x7f4884067330 msgr2=0x7f4884067740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:33.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.174+0000 7f4889095640 1 -- 172.21.15.31:0/3631070675 shutdown_connections 2024-04-15T00:31:33.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.174+0000 7f4889095640 1 -- 172.21.15.31:0/3631070675 wait complete. 2024-04-15T00:31:33.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.175+0000 7f4889095640 1 Processor -- start 2024-04-15T00:31:33.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.175+0000 7f4889095640 1 -- start start 2024-04-15T00:31:33.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.176+0000 7f4889095640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4884072580 0x7f48840b8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:33.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.176+0000 7f4889095640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4884072a00 0x7f4884070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:33.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.176+0000 7f4889095640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48840b5c50 0x7f4884071220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:33.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.176+0000 7f4882d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4884072580 0x7f48840b8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:33.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.176+0000 7f487a59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4884072a00 0x7f4884070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:33.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.176+0000 7f4882d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4884072580 0x7f48840b8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.31:42144/0 (socket says 172.21.15.31:42144) 2024-04-15T00:31:33.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.176+0000 7f487a59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4884072a00 0x7f4884070ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58930/0 (socket says 172.21.15.31:58930) 2024-04-15T00:31:33.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.176+0000 7f4882d9d640 1 -- 172.21.15.31:0/2114526729 learned_addr learned my addr 172.21.15.31:0/2114526729 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:33.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.176+0000 7f4889095640 1 -- 172.21.15.31:0/2114526729 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f48840afbb0 con 0x7f4884072a00 2024-04-15T00:31:33.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.176+0000 7f4889095640 1 -- 172.21.15.31:0/2114526729 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4884072e70 con 0x7f4884072580 2024-04-15T00:31:33.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.176+0000 7f4889095640 1 -- 172.21.15.31:0/2114526729 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f48840b1750 con 0x7f48840b5c50 2024-04-15T00:31:33.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.176+0000 7f488359e640 1 --2- 172.21.15.31:0/2114526729 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48840b5c50 0x7f4884071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:33.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.177+0000 7f4882d9d640 1 -- 172.21.15.31:0/2114526729 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48840b5c50 msgr2=0x7f4884071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:33.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.177+0000 7f4882d9d640 1 --2- 172.21.15.31:0/2114526729 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48840b5c50 0x7f4884071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:33.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.177+0000 7f4882d9d640 1 -- 172.21.15.31:0/2114526729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4884072a00 msgr2=0x7f4884070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:33.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.177+0000 7f4882d9d640 1 --2- 172.21.15.31:0/2114526729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4884072a00 0x7f4884070ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:33.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.177+0000 7f4882d9d640 1 -- 172.21.15.31:0/2114526729 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f488414de60 con 0x7f4884072580 2024-04-15T00:31:33.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.177+0000 7f488359e640 1 --2- 172.21.15.31:0/2114526729 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48840b5c50 0x7f4884071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:31:33.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.177+0000 7f4882d9d640 1 --2- 172.21.15.31:0/2114526729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4884072580 0x7f48840b8a80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4874000f80 tx=0x7f4874004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:33.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.177+0000 7f487bfff640 1 -- 172.21.15.31:0/2114526729 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4874043020 con 0x7f4884072580 2024-04-15T00:31:33.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.177+0000 7f487bfff640 1 -- 172.21.15.31:0/2114526729 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f487403e450 con 0x7f4884072580 2024-04-15T00:31:33.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.177+0000 7f487bfff640 1 -- 172.21.15.31:0/2114526729 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487402ce60 con 0x7f4884072580 2024-04-15T00:31:33.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.177+0000 7f4889095640 1 -- 172.21.15.31:0/2114526729 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4884071ed0 con 0x7f4884072580 2024-04-15T00:31:33.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.177+0000 7f4889095640 1 -- 172.21.15.31:0/2114526729 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48840b95c0 con 0x7f4884072580 2024-04-15T00:31:33.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.179+0000 7f4889095640 1 -- 172.21.15.31:0/2114526729 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48840b1ae0 con 0x7f4884072580 2024-04-15T00:31:33.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.179+0000 7f487bfff640 1 -- 172.21.15.31:0/2114526729 <== mon.1 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f4874046020 con 0x7f4884072580 2024-04-15T00:31:33.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.179+0000 7f487bfff640 1 --2- 172.21.15.31:0/2114526729 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f486406b990 0x7f486406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:33.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.180+0000 7f487bfff640 1 -- 172.21.15.31:0/2114526729 <== mon.1 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f48740ad130 con 0x7f4884072580 2024-04-15T00:31:33.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.180+0000 7f487a59c640 1 --2- 172.21.15.31:0/2114526729 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f486406b990 0x7f486406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:33.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.180+0000 7f487a59c640 1 --2- 172.21.15.31:0/2114526729 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f486406b990 0x7f486406de50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f48841d8f60 tx=0x7f486c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:33.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.185+0000 7f487bfff640 1 -- 172.21.15.31:0/2114526729 <== mon.1 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f48840b1ae0 con 0x7f4884072580 2024-04-15T00:31:33.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.408+0000 7f4889095640 1 -- 172.21.15.31:0/2114526729 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4884073600 con 0x7f4884072580 2024-04-15T00:31:33.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.409+0000 7f487bfff640 1 -- 172.21.15.31:0/2114526729 <== mon.1 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f4884073600 con 0x7f4884072580 2024-04-15T00:31:33.419 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-15T00:31:33.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.411+0000 7f4889095640 1 -- 172.21.15.31:0/2114526729 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f486406b990 msgr2=0x7f486406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:33.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.411+0000 7f4889095640 1 --2- 172.21.15.31:0/2114526729 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f486406b990 0x7f486406de50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f48841d8f60 tx=0x7f486c009040 comp rx=0 tx=0).stop 2024-04-15T00:31:33.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.411+0000 7f4889095640 1 -- 172.21.15.31:0/2114526729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4884072580 msgr2=0x7f48840b8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:33.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.411+0000 7f4889095640 1 --2- 172.21.15.31:0/2114526729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4884072580 0x7f48840b8a80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4874000f80 tx=0x7f4874004a40 comp rx=0 tx=0).stop 2024-04-15T00:31:33.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.411+0000 7f4889095640 1 -- 172.21.15.31:0/2114526729 shutdown_connections 2024-04-15T00:31:33.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.411+0000 7f4889095640 1 --2- 172.21.15.31:0/2114526729 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f486406b990 0x7f486406de50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:33.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.411+0000 7f4889095640 1 --2- 172.21.15.31:0/2114526729 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f48840b5c50 0x7f4884071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:33.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.411+0000 7f4889095640 1 --2- 172.21.15.31:0/2114526729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4884072a00 0x7f4884070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:33.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.411+0000 7f4889095640 1 --2- 172.21.15.31:0/2114526729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4884072580 0x7f48840b8a80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:33.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.411+0000 7f4889095640 1 -- 172.21.15.31:0/2114526729 >> 172.21.15.31:0/2114526729 conn(0x7f4884067330 msgr2=0x7f48840b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:33.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.411+0000 7f4889095640 1 -- 172.21.15.31:0/2114526729 shutdown_connections 2024-04-15T00:31:33.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.411+0000 7f4889095640 1 -- 172.21.15.31:0/2114526729 wait complete. 2024-04-15T00:31:33.430 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T00:31:33.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.527+0000 7f43a0269640 1 Processor -- start 2024-04-15T00:31:33.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.527+0000 7f43a0269640 1 -- start start 2024-04-15T00:31:33.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.528+0000 7f43a0269640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4398151190 0x7f4398153580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:33.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.528+0000 7f43a0269640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4398072b30 con 0x7f43980b8ab0 2024-04-15T00:31:33.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.528+0000 7f43a0269640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43980bad90 con 0x7f4398072750 2024-04-15T00:31:33.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.528+0000 7f43a0269640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f43980b0580 con 0x7f4398151190 2024-04-15T00:31:33.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.528+0000 7f439d804640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f43980b8ab0 0x7f43980b8f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50156/0 (socket says 172.21.15.31:50156) 2024-04-15T00:31:33.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.528+0000 7f439d804640 1 -- 172.21.15.31:0/3320441927 learned_addr learned my addr 172.21.15.31:0/3320441927 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:31:33.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.528+0000 7f439e806640 1 --2- 172.21.15.31:0/3320441927 >> v2:172.21.15.50:3300/0 conn(0x7f4398151190 0x7f4398153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:33.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.528+0000 7f439d003640 1 -- 172.21.15.31:0/3320441927 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 438696938 0 0) 0x7f4398072b30 con 0x7f43980b8ab0 2024-04-15T00:31:33.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.529+0000 7f439d003640 1 -- 172.21.15.31:0/3320441927 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4380003520 con 0x7f43980b8ab0 2024-04-15T00:31:33.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.529+0000 7f439d003640 1 -- 172.21.15.31:0/3320441927 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2049459868 0 0) 0x7f4380003520 con 0x7f43980b8ab0 2024-04-15T00:31:33.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.529+0000 7f439d003640 1 -- 172.21.15.31:0/3320441927 >> v2:172.21.15.50:3300/0 conn(0x7f4398151190 msgr2=0x7f4398153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:33.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.529+0000 7f439d003640 1 --2- 172.21.15.31:0/3320441927 >> v2:172.21.15.50:3300/0 conn(0x7f4398151190 0x7f4398153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:33.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.529+0000 7f439d003640 1 -- 172.21.15.31:0/3320441927 >> v1:172.21.15.50:6789/0 conn(0x7f4398072750 legacy=0x7f439809bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:33.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.529+0000 7f439d003640 1 -- 172.21.15.31:0/3320441927 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43980bb070 con 0x7f43980b8ab0 2024-04-15T00:31:33.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.529+0000 7f439d003640 1 -- 172.21.15.31:0/3320441927 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 697057150 0 0) 0x7f438c001670 con 0x7f43980b8ab0 2024-04-15T00:31:33.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.529+0000 7f439d003640 1 -- 172.21.15.31:0/3320441927 >> v1:172.21.15.31:6789/0 conn(0x7f43980b8ab0 legacy=0x7f43980b8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:33.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.529+0000 7f439d003640 1 --2- 172.21.15.31:0/3320441927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43800039b0 0x7f4380003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:33.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.529+0000 7f439d003640 1 --2- 172.21.15.31:0/3320441927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4380004800 0x7f4380004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:33.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.529+0000 7f439d003640 1 --2- 172.21.15.31:0/3320441927 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43800051c0 0x7f438000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:33.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.529+0000 7f439d003640 1 -- 172.21.15.31:0/3320441927 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f43980b0580 con 0x7f4380004800 2024-04-15T00:31:33.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.529+0000 7f439d003640 1 -- 172.21.15.31:0/3320441927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f438000c160 con 0x7f43800039b0 2024-04-15T00:31:33.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.529+0000 7f439d003640 1 -- 172.21.15.31:0/3320441927 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f438000c360 con 0x7f43800051c0 2024-04-15T00:31:33.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.529+0000 7f439e806640 1 --2- 172.21.15.31:0/3320441927 >> v2:172.21.15.50:3300/0 conn(0x7f4398151190 0x7f4398153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:31:33.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.529+0000 7f439d804640 1 --2- 172.21.15.31:0/3320441927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4380004800 0x7f4380004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:33.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.529+0000 7f439e005640 1 --2- 172.21.15.31:0/3320441927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43800039b0 0x7f4380003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:33.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.529+0000 7f439e806640 1 --2- 172.21.15.31:0/3320441927 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43800051c0 0x7f438000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:33.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.529+0000 7f439d804640 1 -- 172.21.15.31:0/3320441927 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43800051c0 msgr2=0x7f438000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:33.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.529+0000 7f439d804640 1 --2- 172.21.15.31:0/3320441927 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f43800051c0 0x7f438000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:33.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.529+0000 7f439d804640 1 -- 172.21.15.31:0/3320441927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43800039b0 msgr2=0x7f4380003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:33.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.529+0000 7f439d804640 1 --2- 172.21.15.31:0/3320441927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43800039b0 0x7f4380003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:33.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.529+0000 7f439e806640 1 -- 172.21.15.31:0/3320441927 reap_dead start 2024-04-15T00:31:33.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.529+0000 7f439d804640 1 -- 172.21.15.31:0/3320441927 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4380003520 con 0x7f4380004800 2024-04-15T00:31:33.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.530+0000 7f439d804640 1 --2- 172.21.15.31:0/3320441927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4380004800 0x7f4380004c80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f438c00c240 tx=0x7f4380005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15291a3b264e1d69 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:33.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.530+0000 7f439d003640 1 -- 172.21.15.31:0/3320441927 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438c007d10 con 0x7f4380004800 2024-04-15T00:31:33.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.530+0000 7f439d003640 1 -- 172.21.15.31:0/3320441927 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f438c030070 con 0x7f4380004800 2024-04-15T00:31:33.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.530+0000 7f439d003640 1 -- 172.21.15.31:0/3320441927 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438c005d70 con 0x7f4380004800 2024-04-15T00:31:33.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.531+0000 7f43a0269640 1 -- 172.21.15.31:0/3320441927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4380004800 msgr2=0x7f4380004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:33.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.531+0000 7f43a0269640 1 --2- 172.21.15.31:0/3320441927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4380004800 0x7f4380004c80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f438c00c240 tx=0x7f4380005830 comp rx=0 tx=0).stop 2024-04-15T00:31:33.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.531+0000 7f43a0269640 1 -- 172.21.15.31:0/3320441927 shutdown_connections 2024-04-15T00:31:33.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.531+0000 7f43a0269640 1 --2- 172.21.15.31:0/3320441927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4380004800 0x7f4380004c80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:33.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.531+0000 7f43a0269640 1 -- 172.21.15.31:0/3320441927 >> 172.21.15.31:0/3320441927 conn(0x7f43980bcef0 msgr2=0x7f43980bd300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:33.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.531+0000 7f43a0269640 1 -- 172.21.15.31:0/3320441927 shutdown_connections 2024-04-15T00:31:33.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.531+0000 7f43a0269640 1 -- 172.21.15.31:0/3320441927 wait complete. 2024-04-15T00:31:33.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.532+0000 7f43a0269640 1 Processor -- start 2024-04-15T00:31:33.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.532+0000 7f43a0269640 1 -- start start 2024-04-15T00:31:33.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.533+0000 7f43a0269640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4380004800 0x7f43981462e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:33.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.533+0000 7f43a0269640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4398148f30 0x7f43980b6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:33.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.533+0000 7f43a0269640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43980b6580 0x7f43981e05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:33.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.533+0000 7f43a0269640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4398074530 con 0x7f43980b6580 2024-04-15T00:31:33.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.533+0000 7f43a0269640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f43981478f0 con 0x7f4380004800 2024-04-15T00:31:33.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.533+0000 7f43a0269640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f43980b3c80 con 0x7f4398148f30 2024-04-15T00:31:33.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.533+0000 7f439e806640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43980b6580 0x7f43981e05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:33.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.533+0000 7f439e806640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43980b6580 0x7f43981e05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58960/0 (socket says 172.21.15.31:58960) 2024-04-15T00:31:33.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.533+0000 7f439e806640 1 -- 172.21.15.31:0/1747871371 learned_addr learned my addr 172.21.15.31:0/1747871371 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:33.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.533+0000 7f439e005640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4380004800 0x7f43981462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:33.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.533+0000 7f439d804640 1 --2- 172.21.15.31:0/1747871371 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4398148f30 0x7f43980b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:33.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.533+0000 7f439e806640 1 -- 172.21.15.31:0/1747871371 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4398148f30 msgr2=0x7f43980b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:33.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.533+0000 7f439e806640 1 --2- 172.21.15.31:0/1747871371 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4398148f30 0x7f43980b6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:33.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.533+0000 7f439e806640 1 -- 172.21.15.31:0/1747871371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4380004800 msgr2=0x7f43981462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:33.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.533+0000 7f439e806640 1 --2- 172.21.15.31:0/1747871371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4380004800 0x7f43981462e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:33.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.533+0000 7f439e806640 1 -- 172.21.15.31:0/1747871371 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43980b6ec0 con 0x7f43980b6580 2024-04-15T00:31:33.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.533+0000 7f439e005640 1 --2- 172.21.15.31:0/1747871371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4380004800 0x7f43981462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:31:33.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.533+0000 7f439e806640 1 --2- 172.21.15.31:0/1747871371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43980b6580 0x7f43981e05a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f43980734d0 tx=0x7f4388009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:33.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.534+0000 7f4396ffd640 1 -- 172.21.15.31:0/1747871371 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388011e60 con 0x7f43980b6580 2024-04-15T00:31:33.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.534+0000 7f4396ffd640 1 -- 172.21.15.31:0/1747871371 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f438801b070 con 0x7f43980b6580 2024-04-15T00:31:33.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.534+0000 7f43a0269640 1 -- 172.21.15.31:0/1747871371 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f439814a2c0 con 0x7f43980b6580 2024-04-15T00:31:33.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.534+0000 7f4396ffd640 1 -- 172.21.15.31:0/1747871371 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388003990 con 0x7f43980b6580 2024-04-15T00:31:33.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.534+0000 7f43a0269640 1 -- 172.21.15.31:0/1747871371 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4398146b70 con 0x7f43980b6580 2024-04-15T00:31:33.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.535+0000 7f43a0269640 1 -- 172.21.15.31:0/1747871371 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f439809ddf0 con 0x7f43980b6580 2024-04-15T00:31:33.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.535+0000 7f4396ffd640 1 -- 172.21.15.31:0/1747871371 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f4388003b30 con 0x7f43980b6580 2024-04-15T00:31:33.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.535+0000 7f4396ffd640 1 --2- 172.21.15.31:0/1747871371 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f438406b990 0x7f438406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:33.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.536+0000 7f4396ffd640 1 -- 172.21.15.31:0/1747871371 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f438808b5e0 con 0x7f43980b6580 2024-04-15T00:31:33.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.536+0000 7f439e005640 1 --2- 172.21.15.31:0/1747871371 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f438406b990 0x7f438406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:33.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.536+0000 7f439e005640 1 --2- 172.21.15.31:0/1747871371 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f438406b990 0x7f438406de50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4390000c00 tx=0x7f4390009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:33.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.540+0000 7f4396ffd640 1 -- 172.21.15.31:0/1747871371 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f439809ddf0 con 0x7f43980b6580 2024-04-15T00:31:33.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.723+0000 7f43a0269640 1 -- 172.21.15.31:0/1747871371 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f439804f540 con 0x7f43980b6580 2024-04-15T00:31:33.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.724+0000 7f4396ffd640 1 -- 172.21.15.31:0/1747871371 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f4388003e20 con 0x7f43980b6580 2024-04-15T00:31:33.732 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-15T00:31:33.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.726+0000 7f43a0269640 1 -- 172.21.15.31:0/1747871371 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f438406b990 msgr2=0x7f438406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:33.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.726+0000 7f43a0269640 1 --2- 172.21.15.31:0/1747871371 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f438406b990 0x7f438406de50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4390000c00 tx=0x7f4390009040 comp rx=0 tx=0).stop 2024-04-15T00:31:33.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.726+0000 7f43a0269640 1 -- 172.21.15.31:0/1747871371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43980b6580 msgr2=0x7f43981e05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:33.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.726+0000 7f43a0269640 1 --2- 172.21.15.31:0/1747871371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43980b6580 0x7f43981e05a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f43980734d0 tx=0x7f4388009f90 comp rx=0 tx=0).stop 2024-04-15T00:31:33.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.726+0000 7f43a0269640 1 -- 172.21.15.31:0/1747871371 shutdown_connections 2024-04-15T00:31:33.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.726+0000 7f43a0269640 1 --2- 172.21.15.31:0/1747871371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43980b6580 0x7f43981e05a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:33.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.726+0000 7f43a0269640 1 --2- 172.21.15.31:0/1747871371 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f438406b990 0x7f438406de50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:33.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.726+0000 7f43a0269640 1 --2- 172.21.15.31:0/1747871371 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4398148f30 0x7f43980b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:33.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.726+0000 7f43a0269640 1 --2- 172.21.15.31:0/1747871371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4380004800 0x7f43981462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:33.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.726+0000 7f43a0269640 1 -- 172.21.15.31:0/1747871371 >> 172.21.15.31:0/1747871371 conn(0x7f43980bcef0 msgr2=0x7f439809c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:33.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.726+0000 7f43a0269640 1 -- 172.21.15.31:0/1747871371 shutdown_connections 2024-04-15T00:31:33.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.726+0000 7f43a0269640 1 -- 172.21.15.31:0/1747871371 wait complete. 2024-04-15T00:31:33.745 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T00:31:33.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.841+0000 7f6c88315640 1 Processor -- start 2024-04-15T00:31:33.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.841+0000 7f6c88315640 1 -- start start 2024-04-15T00:31:33.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.841+0000 7f6c88315640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6c800b1840 0x7f6c80147b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:33.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.841+0000 7f6c88315640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c80072e90 con 0x7f6c80148090 2024-04-15T00:31:33.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.841+0000 7f6c88315640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c800b6030 con 0x7f6c800b5c50 2024-04-15T00:31:33.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.841+0000 7f6c88315640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f6c800afcb0 con 0x7f6c800b1840 2024-04-15T00:31:33.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.842+0000 7f6c858b0640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6c800b1840 0x7f6c80147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:33.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.842+0000 7f6c868b2640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6c80148090 0x7f6c8014ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50168/0 (socket says 172.21.15.31:50168) 2024-04-15T00:31:33.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.842+0000 7f6c868b2640 1 -- 172.21.15.31:0/1372623900 learned_addr learned my addr 172.21.15.31:0/1372623900 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:31:33.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.842+0000 7f6c858b0640 1 -- 172.21.15.31:0/1372623900 >> v1:172.21.15.50:6789/0 conn(0x7f6c800b5c50 legacy=0x7f6c80072780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:33.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.842+0000 7f6c858b0640 1 -- 172.21.15.31:0/1372623900 >> v1:172.21.15.31:6789/0 conn(0x7f6c80148090 legacy=0x7f6c8014ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:33.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.842+0000 7f6c858b0640 1 -- 172.21.15.31:0/1372623900 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c800b2290 con 0x7f6c800b1840 2024-04-15T00:31:33.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.843+0000 7f6c858b0640 1 --2- 172.21.15.31:0/1372623900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c800b1840 0x7f6c80147b50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6c740097a0 tx=0x7f6c7402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2204407c023abe09 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:33.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.843+0000 7f6c850af640 1 -- 172.21.15.31:0/1372623900 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c740315a0 con 0x7f6c800b1840 2024-04-15T00:31:33.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.843+0000 7f6c850af640 1 -- 172.21.15.31:0/1372623900 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c74037070 con 0x7f6c800b1840 2024-04-15T00:31:33.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.843+0000 7f6c850af640 1 -- 172.21.15.31:0/1372623900 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c74031960 con 0x7f6c800b1840 2024-04-15T00:31:33.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.843+0000 7f6c88315640 1 -- 172.21.15.31:0/1372623900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c800b1840 msgr2=0x7f6c80147b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:33.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.843+0000 7f6c88315640 1 --2- 172.21.15.31:0/1372623900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c800b1840 0x7f6c80147b50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6c740097a0 tx=0x7f6c7402b840 comp rx=0 tx=0).stop 2024-04-15T00:31:33.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.843+0000 7f6c88315640 1 -- 172.21.15.31:0/1372623900 shutdown_connections 2024-04-15T00:31:33.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.843+0000 7f6c88315640 1 --2- 172.21.15.31:0/1372623900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c800b1840 0x7f6c80147b50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:33.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.843+0000 7f6c88315640 1 -- 172.21.15.31:0/1372623900 >> 172.21.15.31:0/1372623900 conn(0x7f6c80067330 msgr2=0x7f6c80067740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:33.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.843+0000 7f6c88315640 1 -- 172.21.15.31:0/1372623900 shutdown_connections 2024-04-15T00:31:33.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.843+0000 7f6c88315640 1 -- 172.21.15.31:0/1372623900 wait complete. 2024-04-15T00:31:33.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.844+0000 7f6c88315640 1 Processor -- start 2024-04-15T00:31:33.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.844+0000 7f6c88315640 1 -- start start 2024-04-15T00:31:33.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.845+0000 7f6c88315640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c800b1840 0x7f6c801447d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:33.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.845+0000 7f6c88315640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c800b5c50 0x7f6c801de5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:33.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.845+0000 7f6c88315640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6c80148090 0x7f6c801deb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:33.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.845+0000 7f6c88315640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6c801484b0 con 0x7f6c800b1840 2024-04-15T00:31:33.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.845+0000 7f6c88315640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6c800b2850 con 0x7f6c800b5c50 2024-04-15T00:31:33.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.845+0000 7f6c88315640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f6c800b1f20 con 0x7f6c80148090 2024-04-15T00:31:33.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.845+0000 7f6c860b1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c800b1840 0x7f6c801447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:33.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.845+0000 7f6c860b1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c800b1840 0x7f6c801447d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58974/0 (socket says 172.21.15.31:58974) 2024-04-15T00:31:33.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.845+0000 7f6c860b1640 1 -- 172.21.15.31:0/1408856333 learned_addr learned my addr 172.21.15.31:0/1408856333 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:33.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.845+0000 7f6c858b0640 1 --2- 172.21.15.31:0/1408856333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c800b5c50 0x7f6c801de5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:33.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.845+0000 7f6c868b2640 1 --2- 172.21.15.31:0/1408856333 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6c80148090 0x7f6c801deb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:33.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.845+0000 7f6c860b1640 1 -- 172.21.15.31:0/1408856333 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6c80148090 msgr2=0x7f6c801deb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:33.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.845+0000 7f6c860b1640 1 --2- 172.21.15.31:0/1408856333 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6c80148090 0x7f6c801deb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:33.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.845+0000 7f6c860b1640 1 -- 172.21.15.31:0/1408856333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c800b5c50 msgr2=0x7f6c801de5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:33.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.845+0000 7f6c860b1640 1 --2- 172.21.15.31:0/1408856333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c800b5c50 0x7f6c801de5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:33.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.845+0000 7f6c860b1640 1 -- 172.21.15.31:0/1408856333 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c800b8aa0 con 0x7f6c800b1840 2024-04-15T00:31:33.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.845+0000 7f6c858b0640 1 --2- 172.21.15.31:0/1408856333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c800b5c50 0x7f6c801de5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:31:33.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.845+0000 7f6c868b2640 1 --2- 172.21.15.31:0/1408856333 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6c80148090 0x7f6c801deb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:31:33.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.846+0000 7f6c860b1640 1 --2- 172.21.15.31:0/1408856333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c800b1840 0x7f6c801447d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6c7800c450 tx=0x7f6c7800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:33.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.846+0000 7f6c7effd640 1 -- 172.21.15.31:0/1408856333 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c780052d0 con 0x7f6c800b1840 2024-04-15T00:31:33.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.846+0000 7f6c7effd640 1 -- 172.21.15.31:0/1408856333 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c78005470 con 0x7f6c800b1840 2024-04-15T00:31:33.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.846+0000 7f6c88315640 1 -- 172.21.15.31:0/1408856333 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c800b3d60 con 0x7f6c800b1840 2024-04-15T00:31:33.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.846+0000 7f6c7effd640 1 -- 172.21.15.31:0/1408856333 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c78012870 con 0x7f6c800b1840 2024-04-15T00:31:33.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.846+0000 7f6c88315640 1 -- 172.21.15.31:0/1408856333 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c800b8d80 con 0x7f6c800b1840 2024-04-15T00:31:33.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.847+0000 7f6c88315640 1 -- 172.21.15.31:0/1408856333 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c8004f620 con 0x7f6c800b1840 2024-04-15T00:31:33.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.847+0000 7f6c7effd640 1 -- 172.21.15.31:0/1408856333 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f6c78012a10 con 0x7f6c800b1840 2024-04-15T00:31:33.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.848+0000 7f6c7effd640 1 --2- 172.21.15.31:0/1408856333 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f6c6c06b990 0x7f6c6c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:33.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.848+0000 7f6c7effd640 1 -- 172.21.15.31:0/1408856333 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f6c7808a800 con 0x7f6c800b1840 2024-04-15T00:31:33.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.848+0000 7f6c858b0640 1 --2- 172.21.15.31:0/1408856333 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f6c6c06b990 0x7f6c6c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:33.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.848+0000 7f6c858b0640 1 --2- 172.21.15.31:0/1408856333 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f6c6c06b990 0x7f6c6c06de50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6c74036000 tx=0x7f6c74008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:33.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:33.852+0000 7f6c7effd640 1 -- 172.21.15.31:0/1408856333 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6c780590a0 con 0x7f6c800b1840 2024-04-15T00:31:34.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.032+0000 7f6c88315640 1 -- 172.21.15.31:0/1408856333 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6c80146190 con 0x7f6c800b1840 2024-04-15T00:31:34.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.032+0000 7f6c7effd640 1 -- 172.21.15.31:0/1408856333 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f6c780589a0 con 0x7f6c800b1840 2024-04-15T00:31:34.040 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-04-15T00:31:34.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.034+0000 7f6c88315640 1 -- 172.21.15.31:0/1408856333 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f6c6c06b990 msgr2=0x7f6c6c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:34.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.034+0000 7f6c88315640 1 --2- 172.21.15.31:0/1408856333 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f6c6c06b990 0x7f6c6c06de50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6c74036000 tx=0x7f6c74008030 comp rx=0 tx=0).stop 2024-04-15T00:31:34.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.034+0000 7f6c88315640 1 -- 172.21.15.31:0/1408856333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c800b1840 msgr2=0x7f6c801447d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:34.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.034+0000 7f6c88315640 1 --2- 172.21.15.31:0/1408856333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c800b1840 0x7f6c801447d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6c7800c450 tx=0x7f6c7800c910 comp rx=0 tx=0).stop 2024-04-15T00:31:34.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.034+0000 7f6c88315640 1 -- 172.21.15.31:0/1408856333 shutdown_connections 2024-04-15T00:31:34.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.034+0000 7f6c88315640 1 --2- 172.21.15.31:0/1408856333 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f6c6c06b990 0x7f6c6c06de50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:34.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.034+0000 7f6c88315640 1 --2- 172.21.15.31:0/1408856333 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6c80148090 0x7f6c801deb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:34.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.034+0000 7f6c88315640 1 --2- 172.21.15.31:0/1408856333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c800b5c50 0x7f6c801de5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:34.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.034+0000 7f6c88315640 1 --2- 172.21.15.31:0/1408856333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c800b1840 0x7f6c801447d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:34.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.034+0000 7f6c88315640 1 -- 172.21.15.31:0/1408856333 >> 172.21.15.31:0/1408856333 conn(0x7f6c80067330 msgr2=0x7f6c800b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:34.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.034+0000 7f6c88315640 1 -- 172.21.15.31:0/1408856333 shutdown_connections 2024-04-15T00:31:34.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.034+0000 7f6c88315640 1 -- 172.21.15.31:0/1408856333 wait complete. 2024-04-15T00:31:34.053 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-15T00:31:34.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.150+0000 7f66b42de640 1 Processor -- start 2024-04-15T00:31:34.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.150+0000 7f66b42de640 1 -- start start 2024-04-15T00:31:34.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.150+0000 7f66b42de640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f66ac072750 0x7f66ac09bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:34.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.150+0000 7f66b42de640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66ac072b30 con 0x7f66ac0b91c0 2024-04-15T00:31:34.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.150+0000 7f66b42de640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66ac0bad90 con 0x7f66ac09c4d0 2024-04-15T00:31:34.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.150+0000 7f66b42de640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f66ac0b0580 con 0x7f66ac072750 2024-04-15T00:31:34.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.151+0000 7f66b207a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f66ac072750 0x7f66ac09bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:34.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.151+0000 7f66b287b640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f66ac0b91c0 0x7f66ac152190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50172/0 (socket says 172.21.15.31:50172) 2024-04-15T00:31:34.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.151+0000 7f66b287b640 1 -- 172.21.15.31:0/2195092341 learned_addr learned my addr 172.21.15.31:0/2195092341 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:31:34.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.151+0000 7f66b207a640 1 --2- 172.21.15.31:0/2195092341 >> v2:172.21.15.31:3300/0 conn(0x7f66ac072750 0x7f66ac09bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58982/0 (socket says 172.21.15.31:58982) 2024-04-15T00:31:34.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.151+0000 7f66b207a640 1 -- 172.21.15.31:0/2195092341 >> v1:172.21.15.50:6789/0 conn(0x7f66ac09c4d0 legacy=0x7f66ac0b8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:34.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.151+0000 7f66b207a640 1 -- 172.21.15.31:0/2195092341 >> v1:172.21.15.31:6789/0 conn(0x7f66ac0b91c0 legacy=0x7f66ac152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:34.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.151+0000 7f66b207a640 1 -- 172.21.15.31:0/2195092341 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ac0bb070 con 0x7f66ac072750 2024-04-15T00:31:34.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.151+0000 7f66b1078640 1 -- 172.21.15.31:0/2195092341 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 725037167 0 0) 0x7f66ac072b30 con 0x7f66ac0b91c0 2024-04-15T00:31:34.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.152+0000 7f66b207a640 1 --2- 172.21.15.31:0/2195092341 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66ac072750 0x7f66ac09bf90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f66a80097a0 tx=0x7f66a802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=293c97456cecf830 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:34.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.152+0000 7f66b1078640 1 -- 172.21.15.31:0/2195092341 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a8035020 con 0x7f66ac072750 2024-04-15T00:31:34.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.152+0000 7f66b1078640 1 -- 172.21.15.31:0/2195092341 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66a8031830 con 0x7f66ac072750 2024-04-15T00:31:34.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.152+0000 7f66b1078640 1 -- 172.21.15.31:0/2195092341 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a8031c00 con 0x7f66ac072750 2024-04-15T00:31:34.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.152+0000 7f66b42de640 1 -- 172.21.15.31:0/2195092341 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66ac072750 msgr2=0x7f66ac09bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:34.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.152+0000 7f66b42de640 1 --2- 172.21.15.31:0/2195092341 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66ac072750 0x7f66ac09bf90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f66a80097a0 tx=0x7f66a802b8d0 comp rx=0 tx=0).stop 2024-04-15T00:31:34.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.152+0000 7f66b42de640 1 -- 172.21.15.31:0/2195092341 shutdown_connections 2024-04-15T00:31:34.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.152+0000 7f66b42de640 1 --2- 172.21.15.31:0/2195092341 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66ac072750 0x7f66ac09bf90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:34.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.152+0000 7f66b42de640 1 -- 172.21.15.31:0/2195092341 >> 172.21.15.31:0/2195092341 conn(0x7f66ac0bcef0 msgr2=0x7f66ac0bd300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:34.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.152+0000 7f66b42de640 1 -- 172.21.15.31:0/2195092341 shutdown_connections 2024-04-15T00:31:34.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.152+0000 7f66b42de640 1 -- 172.21.15.31:0/2195092341 wait complete. 2024-04-15T00:31:34.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.153+0000 7f66b42de640 1 Processor -- start 2024-04-15T00:31:34.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.153+0000 7f66b42de640 1 -- start start 2024-04-15T00:31:34.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.154+0000 7f66b42de640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f66ac072750 0x7f66ac0b3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:34.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.154+0000 7f66b42de640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66ac09c4d0 0x7f66ac142b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:34.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.154+0000 7f66b42de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66ac0b91c0 0x7f66ac143090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:34.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.154+0000 7f66b42de640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f66ac074530 con 0x7f66ac09c4d0 2024-04-15T00:31:34.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.154+0000 7f66b42de640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f66ac1478f0 con 0x7f66ac0b91c0 2024-04-15T00:31:34.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.154+0000 7f66b42de640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f66ac0b3c80 con 0x7f66ac072750 2024-04-15T00:31:34.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.154+0000 7f66b1879640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66ac09c4d0 0x7f66ac142b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:34.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.154+0000 7f66b1879640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66ac09c4d0 0x7f66ac142b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58992/0 (socket says 172.21.15.31:58992) 2024-04-15T00:31:34.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.154+0000 7f66b1879640 1 -- 172.21.15.31:0/124434022 learned_addr learned my addr 172.21.15.31:0/124434022 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:34.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.154+0000 7f66b287b640 1 --2- 172.21.15.31:0/124434022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66ac0b91c0 0x7f66ac143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:34.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.154+0000 7f66b207a640 1 --2- 172.21.15.31:0/124434022 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f66ac072750 0x7f66ac0b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:34.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.154+0000 7f66b1879640 1 -- 172.21.15.31:0/124434022 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f66ac072750 msgr2=0x7f66ac0b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:34.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.154+0000 7f66b1879640 1 --2- 172.21.15.31:0/124434022 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f66ac072750 0x7f66ac0b3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:34.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.154+0000 7f66b1879640 1 -- 172.21.15.31:0/124434022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66ac0b91c0 msgr2=0x7f66ac143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:34.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.154+0000 7f66b1879640 1 --2- 172.21.15.31:0/124434022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66ac0b91c0 0x7f66ac143090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:34.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.154+0000 7f66b1879640 1 -- 172.21.15.31:0/124434022 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ac14b440 con 0x7f66ac09c4d0 2024-04-15T00:31:34.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.155+0000 7f66b1879640 1 --2- 172.21.15.31:0/124434022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66ac09c4d0 0x7f66ac142b50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f669c00c480 tx=0x7f669c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:34.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.155+0000 7f66a2ffd640 1 -- 172.21.15.31:0/124434022 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c0052d0 con 0x7f66ac09c4d0 2024-04-15T00:31:34.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.155+0000 7f66a2ffd640 1 -- 172.21.15.31:0/124434022 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f669c005470 con 0x7f66ac09c4d0 2024-04-15T00:31:34.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.155+0000 7f66b42de640 1 -- 172.21.15.31:0/124434022 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66ac0b2ea0 con 0x7f66ac09c4d0 2024-04-15T00:31:34.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.155+0000 7f66a2ffd640 1 -- 172.21.15.31:0/124434022 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c012870 con 0x7f66ac09c4d0 2024-04-15T00:31:34.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.155+0000 7f66b42de640 1 -- 172.21.15.31:0/124434022 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66ac14b9e0 con 0x7f66ac09c4d0 2024-04-15T00:31:34.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.156+0000 7f66b42de640 1 -- 172.21.15.31:0/124434022 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66ac04f540 con 0x7f66ac09c4d0 2024-04-15T00:31:34.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.156+0000 7f66a2ffd640 1 -- 172.21.15.31:0/124434022 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f669c012a10 con 0x7f66ac09c4d0 2024-04-15T00:31:34.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.156+0000 7f66a2ffd640 1 --2- 172.21.15.31:0/124434022 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f669006b9c0 0x7f669006de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:34.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.157+0000 7f66a2ffd640 1 -- 172.21.15.31:0/124434022 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f669c08a8a0 con 0x7f66ac09c4d0 2024-04-15T00:31:34.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.157+0000 7f66b207a640 1 --2- 172.21.15.31:0/124434022 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f669006b9c0 0x7f669006de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:34.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.157+0000 7f66b207a640 1 --2- 172.21.15.31:0/124434022 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f669006b9c0 0x7f669006de80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f66a8036000 tx=0x7f66a8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:34.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.161+0000 7f66a2ffd640 1 -- 172.21.15.31:0/124434022 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f669c059140 con 0x7f66ac09c4d0 2024-04-15T00:31:34.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.344+0000 7f66b42de640 1 -- 172.21.15.31:0/124434022 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f66ac0b2bc0 con 0x7f66ac09c4d0 2024-04-15T00:31:34.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.344+0000 7f66a2ffd640 1 -- 172.21.15.31:0/124434022 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f669c058a40 con 0x7f66ac09c4d0 2024-04-15T00:31:34.353 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-15T00:31:34.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.346+0000 7f66b42de640 1 -- 172.21.15.31:0/124434022 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f669006b9c0 msgr2=0x7f669006de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:34.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.346+0000 7f66b42de640 1 --2- 172.21.15.31:0/124434022 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f669006b9c0 0x7f669006de80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f66a8036000 tx=0x7f66a8008030 comp rx=0 tx=0).stop 2024-04-15T00:31:34.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.346+0000 7f66b42de640 1 -- 172.21.15.31:0/124434022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66ac09c4d0 msgr2=0x7f66ac142b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:34.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.346+0000 7f66b42de640 1 --2- 172.21.15.31:0/124434022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66ac09c4d0 0x7f66ac142b50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f669c00c480 tx=0x7f669c00c940 comp rx=0 tx=0).stop 2024-04-15T00:31:34.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.346+0000 7f66b42de640 1 -- 172.21.15.31:0/124434022 shutdown_connections 2024-04-15T00:31:34.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.346+0000 7f66b42de640 1 --2- 172.21.15.31:0/124434022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66ac0b91c0 0x7f66ac143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:34.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.346+0000 7f66b42de640 1 --2- 172.21.15.31:0/124434022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66ac09c4d0 0x7f66ac142b50 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:34.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.346+0000 7f66b42de640 1 --2- 172.21.15.31:0/124434022 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f669006b9c0 0x7f669006de80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:34.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.346+0000 7f66b42de640 1 --2- 172.21.15.31:0/124434022 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f66ac072750 0x7f66ac0b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:34.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.346+0000 7f66b42de640 1 -- 172.21.15.31:0/124434022 >> 172.21.15.31:0/124434022 conn(0x7f66ac0bcef0 msgr2=0x7f66ac09d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:34.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.346+0000 7f66b42de640 1 -- 172.21.15.31:0/124434022 shutdown_connections 2024-04-15T00:31:34.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.346+0000 7f66b42de640 1 -- 172.21.15.31:0/124434022 wait complete. 2024-04-15T00:31:34.365 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-04-15T00:31:34.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.460+0000 7f600fb64640 1 Processor -- start 2024-04-15T00:31:34.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.460+0000 7f600fb64640 1 -- start start 2024-04-15T00:31:34.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.461+0000 7f600fb64640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f60080727b0 0x7f60080b0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:34.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.461+0000 7f600fb64640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f60080b52a0 0x7f60080aed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:34.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.461+0000 7f600fb64640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f600806bbc0 con 0x7f600813f300 2024-04-15T00:31:34.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.461+0000 7f600fb64640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f60080b5700 con 0x7f60080727b0 2024-04-15T00:31:34.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.461+0000 7f600fb64640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f60080af290 con 0x7f60080b52a0 2024-04-15T00:31:34.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.461+0000 7f600d900640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f60080727b0 0x7f60080b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:34.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.461+0000 7f600e101640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f600813f300 0x7f6008066f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50178/0 (socket says 172.21.15.31:50178) 2024-04-15T00:31:34.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.461+0000 7f600e101640 1 -- 172.21.15.31:0/3141593285 learned_addr learned my addr 172.21.15.31:0/3141593285 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:31:34.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.461+0000 7f600d0ff640 1 --2- 172.21.15.31:0/3141593285 >> v2:172.21.15.50:3300/0 conn(0x7f60080b52a0 0x7f60080aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:34.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.461+0000 7f600d900640 1 -- 172.21.15.31:0/3141593285 >> v2:172.21.15.50:3300/0 conn(0x7f60080b52a0 msgr2=0x7f60080aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:34.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.461+0000 7f600d900640 1 --2- 172.21.15.31:0/3141593285 >> v2:172.21.15.50:3300/0 conn(0x7f60080b52a0 0x7f60080aed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:34.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.461+0000 7f600d900640 1 -- 172.21.15.31:0/3141593285 >> v1:172.21.15.31:6789/0 conn(0x7f600813f300 legacy=0x7f6008066f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:34.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.461+0000 7f600d900640 1 -- 172.21.15.31:0/3141593285 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6008072b90 con 0x7f60080727b0 2024-04-15T00:31:34.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.461+0000 7f600c8fe640 1 -- 172.21.15.31:0/3141593285 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 199704816 0 0) 0x7f600806bbc0 con 0x7f600813f300 2024-04-15T00:31:34.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.462+0000 7f600d900640 1 --2- 172.21.15.31:0/3141593285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60080727b0 0x7f60080b0060 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f600806b340 tx=0x7f600402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d27ced44c86cd9 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:34.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.462+0000 7f600c8fe640 1 -- 172.21.15.31:0/3141593285 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60040315a0 con 0x7f60080727b0 2024-04-15T00:31:34.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.462+0000 7f600c8fe640 1 -- 172.21.15.31:0/3141593285 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6004037070 con 0x7f60080727b0 2024-04-15T00:31:34.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.462+0000 7f600c8fe640 1 -- 172.21.15.31:0/3141593285 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6004031960 con 0x7f60080727b0 2024-04-15T00:31:34.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.462+0000 7f600fb64640 1 -- 172.21.15.31:0/3141593285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60080727b0 msgr2=0x7f60080b0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:34.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.462+0000 7f600fb64640 1 --2- 172.21.15.31:0/3141593285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60080727b0 0x7f60080b0060 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f600806b340 tx=0x7f600402b840 comp rx=0 tx=0).stop 2024-04-15T00:31:34.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.463+0000 7f600fb64640 1 -- 172.21.15.31:0/3141593285 shutdown_connections 2024-04-15T00:31:34.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.463+0000 7f600fb64640 1 --2- 172.21.15.31:0/3141593285 >> v2:172.21.15.50:3300/0 conn(0x7f60080b52a0 0x7f60080aed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:34.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.463+0000 7f600fb64640 1 --2- 172.21.15.31:0/3141593285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60080727b0 0x7f60080b0060 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:34.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.463+0000 7f600fb64640 1 -- 172.21.15.31:0/3141593285 >> 172.21.15.31:0/3141593285 conn(0x7f60080b6640 msgr2=0x7f60080b6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:34.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.463+0000 7f600fb64640 1 -- 172.21.15.31:0/3141593285 shutdown_connections 2024-04-15T00:31:34.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.463+0000 7f600fb64640 1 -- 172.21.15.31:0/3141593285 wait complete. 2024-04-15T00:31:34.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.464+0000 7f600fb64640 1 Processor -- start 2024-04-15T00:31:34.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.464+0000 7f600fb64640 1 -- start start 2024-04-15T00:31:34.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.464+0000 7f600fb64640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f60080727b0 0x7f600809f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:34.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.464+0000 7f600fb64640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60080b52a0 0x7f6008141260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:34.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.464+0000 7f600fb64640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f600813f300 0x7f60080707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:34.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.464+0000 7f600fb64640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f600806c110 con 0x7f600813f300 2024-04-15T00:31:34.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.464+0000 7f600fb64640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f60080afb40 con 0x7f60080b52a0 2024-04-15T00:31:34.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.464+0000 7f600fb64640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f60080b0920 con 0x7f60080727b0 2024-04-15T00:31:34.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.464+0000 7f600e101640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f600813f300 0x7f60080707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:34.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.464+0000 7f600e101640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f600813f300 0x7f60080707c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59002/0 (socket says 172.21.15.31:59002) 2024-04-15T00:31:34.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.464+0000 7f600e101640 1 -- 172.21.15.31:0/4260818054 learned_addr learned my addr 172.21.15.31:0/4260818054 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:34.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.464+0000 7f600d0ff640 1 --2- 172.21.15.31:0/4260818054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60080b52a0 0x7f6008141260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:34.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.464+0000 7f600d900640 1 --2- 172.21.15.31:0/4260818054 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f60080727b0 0x7f600809f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:34.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.465+0000 7f600e101640 1 -- 172.21.15.31:0/4260818054 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f60080727b0 msgr2=0x7f600809f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:34.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.465+0000 7f600e101640 1 --2- 172.21.15.31:0/4260818054 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f60080727b0 0x7f600809f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:34.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.465+0000 7f600e101640 1 -- 172.21.15.31:0/4260818054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60080b52a0 msgr2=0x7f6008141260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:34.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.465+0000 7f600e101640 1 --2- 172.21.15.31:0/4260818054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60080b52a0 0x7f6008141260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:34.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.465+0000 7f600e101640 1 -- 172.21.15.31:0/4260818054 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6008141980 con 0x7f600813f300 2024-04-15T00:31:34.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.465+0000 7f600e101640 1 --2- 172.21.15.31:0/4260818054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f600813f300 0x7f60080707c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f600000c700 tx=0x7f600000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:34.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.465+0000 7f5ffe7fc640 1 -- 172.21.15.31:0/4260818054 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6000018070 con 0x7f600813f300 2024-04-15T00:31:34.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.465+0000 7f5ffe7fc640 1 -- 172.21.15.31:0/4260818054 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f600000ce10 con 0x7f600813f300 2024-04-15T00:31:34.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.465+0000 7f5ffe7fc640 1 -- 172.21.15.31:0/4260818054 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600000a860 con 0x7f600813f300 2024-04-15T00:31:34.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.465+0000 7f600fb64640 1 -- 172.21.15.31:0/4260818054 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6008141c60 con 0x7f600813f300 2024-04-15T00:31:34.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.465+0000 7f600fb64640 1 -- 172.21.15.31:0/4260818054 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60080721b0 con 0x7f600813f300 2024-04-15T00:31:34.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.466+0000 7f600fb64640 1 -- 172.21.15.31:0/4260818054 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f600804f620 con 0x7f600813f300 2024-04-15T00:31:34.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.466+0000 7f5ffe7fc640 1 -- 172.21.15.31:0/4260818054 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f600001b070 con 0x7f600813f300 2024-04-15T00:31:34.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.467+0000 7f5ffe7fc640 1 --2- 172.21.15.31:0/4260818054 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f5fec06b9c0 0x7f5fec06de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:34.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.467+0000 7f5ffe7fc640 1 -- 172.21.15.31:0/4260818054 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f600008a1e0 con 0x7f600813f300 2024-04-15T00:31:34.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.467+0000 7f600d900640 1 --2- 172.21.15.31:0/4260818054 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f5fec06b9c0 0x7f5fec06de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:34.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.467+0000 7f600d900640 1 --2- 172.21.15.31:0/4260818054 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f5fec06b9c0 0x7f5fec06de80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6004036000 tx=0x7f600403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:34.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.471+0000 7f5ffe7fc640 1 -- 172.21.15.31:0/4260818054 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f60000589f0 con 0x7f600813f300 2024-04-15T00:31:34.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.701+0000 7f600fb64640 1 -- 172.21.15.31:0/4260818054 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f600806ca20 con 0x7f600813f300 2024-04-15T00:31:34.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.706+0000 7f5ffe7fc640 1 -- 172.21.15.31:0/4260818054 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v5) ==== 81+0+469179 (secure 0 0 0) 0x7f60000582f0 con 0x7f600813f300 2024-04-15T00:31:34.723 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:31:34.723 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-15T00:31:34.723 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 5, 2024-04-15T00:31:34.723 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.723 INFO:teuthology.orchestra.run.smithi031.stdout: "active_gid": 4107, 2024-04-15T00:31:34.723 INFO:teuthology.orchestra.run.smithi031.stdout: "active_name": "y", 2024-04-15T00:31:34.723 INFO:teuthology.orchestra.run.smithi031.stdout: "active_addrs": { 2024-04-15T00:31:34.724 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-04-15T00:31:34.724 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:34.724 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2024-04-15T00:31:34.724 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6832", 2024-04-15T00:31:34.724 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 915470279 2024-04-15T00:31:34.724 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.724 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:34.724 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-04-15T00:31:34.724 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6833", 2024-04-15T00:31:34.725 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 915470279 2024-04-15T00:31:34.725 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:34.725 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-15T00:31:34.725 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.725 INFO:teuthology.orchestra.run.smithi031.stdout: "active_addr": "172.21.15.31:6833/915470279", 2024-04-15T00:31:34.725 INFO:teuthology.orchestra.run.smithi031.stdout: "active_change": "2024-04-15T00:20:48.381822+0000", 2024-04-15T00:31:34.725 INFO:teuthology.orchestra.run.smithi031.stdout: "active_mgr_features": 4540701547738038271, 2024-04-15T00:31:34.725 INFO:teuthology.orchestra.run.smithi031.stdout: "available": true, 2024-04-15T00:31:34.725 INFO:teuthology.orchestra.run.smithi031.stdout: "standbys": [ 2024-04-15T00:31:34.726 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:34.726 INFO:teuthology.orchestra.run.smithi031.stdout: "gid": 4102, 2024-04-15T00:31:34.726 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "x", 2024-04-15T00:31:34.726 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr_features": 4540701547738038271, 2024-04-15T00:31:34.726 INFO:teuthology.orchestra.run.smithi031.stdout: "available_modules": [ 2024-04-15T00:31:34.726 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:34.726 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "alerts", 2024-04-15T00:31:34.726 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:34.727 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:34.727 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:34.727 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-04-15T00:31:34.727 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-04-15T00:31:34.727 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:34.727 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.727 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.727 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-04-15T00:31:34.728 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.728 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.728 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.728 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How frequently to reexamine health status", 2024-04-15T00:31:34.728 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.728 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.728 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.729 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.729 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:34.729 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:34.729 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.729 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.730 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.730 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:34.730 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.730 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.730 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:34.730 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:34.731 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:34.731 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:34.731 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:34.731 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:34.731 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:34.731 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:34.731 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.731 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.731 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.732 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.732 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.732 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:34.732 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:34.732 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.732 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.732 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.732 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:34.733 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.733 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.733 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.733 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.733 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.734 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.734 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.734 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.735 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:34.735 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:34.735 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.735 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.736 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.736 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:34.736 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.736 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.736 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:34.736 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:34.736 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:34.737 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:34.737 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:34.737 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:34.737 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:34.737 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:34.737 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.737 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.737 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.738 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.738 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.738 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:34.738 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:34.738 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.738 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.738 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.739 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:34.739 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.739 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.739 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.739 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.739 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.739 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.740 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.740 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.740 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_destination": { 2024-04-15T00:31:34.740 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_destination", 2024-04-15T00:31:34.740 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.740 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.740 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.740 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:34.740 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.741 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.741 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.741 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Email address to send alerts to", 2024-04-15T00:31:34.741 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.741 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.743 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.743 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.743 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_from_name": { 2024-04-15T00:31:34.743 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_from_name", 2024-04-15T00:31:34.743 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.743 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.744 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.744 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "Ceph", 2024-04-15T00:31:34.744 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.744 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.744 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.744 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Email From: name", 2024-04-15T00:31:34.744 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.744 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.745 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.745 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.745 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_host": { 2024-04-15T00:31:34.745 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_host", 2024-04-15T00:31:34.745 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.745 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.745 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.745 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:34.745 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.746 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.746 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.746 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "SMTP server", 2024-04-15T00:31:34.746 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.746 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.746 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.746 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.746 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_password": { 2024-04-15T00:31:34.746 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_password", 2024-04-15T00:31:34.747 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.747 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.747 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.747 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:34.747 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.747 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.747 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.747 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Password to authenticate with", 2024-04-15T00:31:34.747 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.748 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.748 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.748 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.748 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_port": { 2024-04-15T00:31:34.748 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_port", 2024-04-15T00:31:34.748 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:34.748 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.748 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.748 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "465", 2024-04-15T00:31:34.749 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.749 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.749 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.749 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "SMTP port", 2024-04-15T00:31:34.749 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.749 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.749 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.749 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.749 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_sender": { 2024-04-15T00:31:34.750 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_sender", 2024-04-15T00:31:34.750 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.750 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.750 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.750 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:34.750 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.750 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.750 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.751 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "SMTP envelope sender", 2024-04-15T00:31:34.751 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.751 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.751 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.751 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.751 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_ssl": { 2024-04-15T00:31:34.751 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_ssl", 2024-04-15T00:31:34.751 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.752 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.752 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.752 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:34.752 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.752 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.752 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.752 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-15T00:31:34.753 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.753 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.753 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.754 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.754 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_user": { 2024-04-15T00:31:34.754 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_user", 2024-04-15T00:31:34.754 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.754 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.754 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.754 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:34.754 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.755 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.755 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.755 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "User to authenticate as", 2024-04-15T00:31:34.755 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.755 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.755 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.755 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:34.755 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:34.755 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.756 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:34.756 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "balancer", 2024-04-15T00:31:34.756 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:34.756 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:34.756 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:34.756 INFO:teuthology.orchestra.run.smithi031.stdout: "active": { 2024-04-15T00:31:34.756 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "active", 2024-04-15T00:31:34.756 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.756 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.757 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.757 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:34.757 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.757 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.757 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.757 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "automatically balance PGs across cluster", 2024-04-15T00:31:34.758 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.758 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.758 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.758 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.758 INFO:teuthology.orchestra.run.smithi031.stdout: "begin_time": { 2024-04-15T00:31:34.758 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "begin_time", 2024-04-15T00:31:34.758 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.758 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.759 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.759 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0000", 2024-04-15T00:31:34.759 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.759 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.759 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.759 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "beginning time of day to automatically balance", 2024-04-15T00:31:34.759 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-15T00:31:34.759 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.760 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.760 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.760 INFO:teuthology.orchestra.run.smithi031.stdout: "begin_weekday": { 2024-04-15T00:31:34.760 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "begin_weekday", 2024-04-15T00:31:34.760 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-04-15T00:31:34.760 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.760 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.761 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-04-15T00:31:34.761 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "0", 2024-04-15T00:31:34.761 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "6", 2024-04-15T00:31:34.761 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.761 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-15T00:31:34.761 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-15T00:31:34.761 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.762 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.762 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.762 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_compat_max_iterations": { 2024-04-15T00:31:34.762 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crush_compat_max_iterations", 2024-04-15T00:31:34.763 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-04-15T00:31:34.763 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.763 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.763 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "25", 2024-04-15T00:31:34.763 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1", 2024-04-15T00:31:34.763 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "250", 2024-04-15T00:31:34.763 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.763 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-15T00:31:34.764 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.764 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.764 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.764 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.764 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_compat_metrics": { 2024-04-15T00:31:34.764 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crush_compat_metrics", 2024-04-15T00:31:34.764 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.764 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.764 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.765 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "pgs,objects,bytes", 2024-04-15T00:31:34.765 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.765 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.765 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.765 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-15T00:31:34.765 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-15T00:31:34.765 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.765 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.766 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.766 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_compat_step": { 2024-04-15T00:31:34.766 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crush_compat_step", 2024-04-15T00:31:34.766 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-04-15T00:31:34.766 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.766 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.766 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0.5", 2024-04-15T00:31:34.766 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "0.001", 2024-04-15T00:31:34.767 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "0.999", 2024-04-15T00:31:34.767 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.767 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "aggressiveness of optimization", 2024-04-15T00:31:34.767 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-15T00:31:34.767 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.767 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.767 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.767 INFO:teuthology.orchestra.run.smithi031.stdout: "end_time": { 2024-04-15T00:31:34.767 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "end_time", 2024-04-15T00:31:34.768 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.768 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.768 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.768 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "2359", 2024-04-15T00:31:34.768 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.768 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.768 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.768 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "ending time of day to automatically balance", 2024-04-15T00:31:34.769 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-15T00:31:34.769 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.769 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.769 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.769 INFO:teuthology.orchestra.run.smithi031.stdout: "end_weekday": { 2024-04-15T00:31:34.770 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "end_weekday", 2024-04-15T00:31:34.770 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-04-15T00:31:34.771 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.771 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.771 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-04-15T00:31:34.771 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "0", 2024-04-15T00:31:34.771 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "6", 2024-04-15T00:31:34.772 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.772 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-15T00:31:34.773 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-15T00:31:34.773 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.774 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.775 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.775 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:34.776 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:34.776 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.777 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.777 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.777 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:34.777 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.778 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.778 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:34.778 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:34.778 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:34.779 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:34.779 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:34.779 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:34.779 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:34.780 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:34.780 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.780 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.780 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.780 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.781 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.781 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:34.781 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:34.782 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.783 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.783 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.783 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:34.784 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.785 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.785 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.785 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.786 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.786 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.786 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.786 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.786 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:34.787 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:34.787 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.787 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.787 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.787 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:34.788 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.788 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.788 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:34.788 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:34.788 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:34.789 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:34.789 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:34.789 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:34.789 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:34.790 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:34.790 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.790 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.790 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.791 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.791 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.791 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:34.792 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:34.792 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.792 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.792 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.793 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:34.793 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.794 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.794 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.794 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.794 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.795 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.795 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.795 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.796 INFO:teuthology.orchestra.run.smithi031.stdout: "min_score": { 2024-04-15T00:31:34.796 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "min_score", 2024-04-15T00:31:34.796 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-04-15T00:31:34.796 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.797 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.797 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-04-15T00:31:34.797 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.797 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.798 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.798 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-15T00:31:34.798 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.798 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.799 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.799 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.799 INFO:teuthology.orchestra.run.smithi031.stdout: "mode": { 2024-04-15T00:31:34.799 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mode", 2024-04-15T00:31:34.800 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.800 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.800 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.800 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "upmap", 2024-04-15T00:31:34.801 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.801 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.801 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:34.801 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-compat", 2024-04-15T00:31:34.802 INFO:teuthology.orchestra.run.smithi031.stdout: "none", 2024-04-15T00:31:34.802 INFO:teuthology.orchestra.run.smithi031.stdout: "read", 2024-04-15T00:31:34.802 INFO:teuthology.orchestra.run.smithi031.stdout: "upmap", 2024-04-15T00:31:34.803 INFO:teuthology.orchestra.run.smithi031.stdout: "upmap-read" 2024-04-15T00:31:34.803 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:34.803 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Balancer mode", 2024-04-15T00:31:34.803 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.804 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.804 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.804 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.804 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_ids": { 2024-04-15T00:31:34.805 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "pool_ids", 2024-04-15T00:31:34.805 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.805 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.805 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.806 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:34.806 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.806 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.806 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.807 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-15T00:31:34.807 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.807 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.807 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.808 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.808 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-04-15T00:31:34.808 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-04-15T00:31:34.809 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:34.809 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.809 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.809 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-04-15T00:31:34.810 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.810 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.810 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.810 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-15T00:31:34.810 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.810 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.811 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.811 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.811 INFO:teuthology.orchestra.run.smithi031.stdout: "upmap_max_deviation": { 2024-04-15T00:31:34.811 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "upmap_max_deviation", 2024-04-15T00:31:34.811 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:34.813 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.816 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.816 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5", 2024-04-15T00:31:34.816 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1", 2024-04-15T00:31:34.816 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.816 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.816 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-15T00:31:34.817 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-15T00:31:34.817 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.817 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.817 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.817 INFO:teuthology.orchestra.run.smithi031.stdout: "upmap_max_optimizations": { 2024-04-15T00:31:34.817 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "upmap_max_optimizations", 2024-04-15T00:31:34.818 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-04-15T00:31:34.818 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.818 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.818 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-04-15T00:31:34.818 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.818 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.818 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.818 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-15T00:31:34.819 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.819 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.819 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.819 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:34.819 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:34.819 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.819 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:34.820 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cephadm", 2024-04-15T00:31:34.820 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:34.820 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:34.820 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:34.820 INFO:teuthology.orchestra.run.smithi031.stdout: "agent_down_multiplier": { 2024-04-15T00:31:34.820 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "agent_down_multiplier", 2024-04-15T00:31:34.820 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-04-15T00:31:34.820 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.821 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.821 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "3.0", 2024-04-15T00:31:34.821 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.821 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.821 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.821 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-15T00:31:34.821 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.821 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.822 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.822 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.822 INFO:teuthology.orchestra.run.smithi031.stdout: "agent_refresh_rate": { 2024-04-15T00:31:34.822 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "agent_refresh_rate", 2024-04-15T00:31:34.822 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:34.822 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.822 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.822 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "20", 2024-04-15T00:31:34.823 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.823 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.823 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.823 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-15T00:31:34.823 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.823 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.823 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.823 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.824 INFO:teuthology.orchestra.run.smithi031.stdout: "agent_starting_port": { 2024-04-15T00:31:34.824 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "agent_starting_port", 2024-04-15T00:31:34.824 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:34.824 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.824 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.824 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "4721", 2024-04-15T00:31:34.824 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.824 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.825 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.825 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-15T00:31:34.825 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.825 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.825 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.825 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.825 INFO:teuthology.orchestra.run.smithi031.stdout: "allow_ptrace": { 2024-04-15T00:31:34.826 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "allow_ptrace", 2024-04-15T00:31:34.826 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.826 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.826 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.826 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:34.826 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.826 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.826 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.827 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-15T00:31:34.827 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-15T00:31:34.827 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.827 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.827 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.827 INFO:teuthology.orchestra.run.smithi031.stdout: "autotune_interval": { 2024-04-15T00:31:34.827 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "autotune_interval", 2024-04-15T00:31:34.827 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:34.828 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.828 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.828 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-04-15T00:31:34.828 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.828 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.828 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.828 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-15T00:31:34.828 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.828 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.829 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.829 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.829 INFO:teuthology.orchestra.run.smithi031.stdout: "autotune_memory_target_ratio": { 2024-04-15T00:31:34.829 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "autotune_memory_target_ratio", 2024-04-15T00:31:34.829 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-04-15T00:31:34.829 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.829 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.829 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0.7", 2024-04-15T00:31:34.830 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.830 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.830 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.830 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-15T00:31:34.830 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.830 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.830 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.830 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.831 INFO:teuthology.orchestra.run.smithi031.stdout: "cephadm_log_destination": { 2024-04-15T00:31:34.831 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cephadm_log_destination", 2024-04-15T00:31:34.831 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.831 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.831 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.831 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:34.831 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.831 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.831 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:34.832 INFO:teuthology.orchestra.run.smithi031.stdout: "file", 2024-04-15T00:31:34.832 INFO:teuthology.orchestra.run.smithi031.stdout: "file,syslog", 2024-04-15T00:31:34.832 INFO:teuthology.orchestra.run.smithi031.stdout: "syslog" 2024-04-15T00:31:34.832 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:34.832 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-15T00:31:34.832 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.832 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.832 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.833 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.833 INFO:teuthology.orchestra.run.smithi031.stdout: "cgroups_split": { 2024-04-15T00:31:34.833 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cgroups_split", 2024-04-15T00:31:34.833 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.833 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.833 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.833 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:34.833 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.833 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.834 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.834 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-15T00:31:34.834 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.834 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.834 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.834 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.834 INFO:teuthology.orchestra.run.smithi031.stdout: "config_checks_enabled": { 2024-04-15T00:31:34.834 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "config_checks_enabled", 2024-04-15T00:31:34.835 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.835 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.835 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.835 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:34.835 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.835 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.835 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.835 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-15T00:31:34.836 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.836 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.836 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.836 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.837 INFO:teuthology.orchestra.run.smithi031.stdout: "config_dashboard": { 2024-04-15T00:31:34.837 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "config_dashboard", 2024-04-15T00:31:34.837 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.837 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.837 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.837 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:34.838 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.838 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.838 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.838 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-15T00:31:34.838 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.838 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.838 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.838 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.839 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_alertmanager": { 2024-04-15T00:31:34.839 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_alertmanager", 2024-04-15T00:31:34.839 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.839 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.839 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.839 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-15T00:31:34.839 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.839 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.840 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.840 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Prometheus container image", 2024-04-15T00:31:34.840 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.840 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.840 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.840 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.840 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_base": { 2024-04-15T00:31:34.840 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_base", 2024-04-15T00:31:34.841 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.841 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.841 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.841 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-15T00:31:34.841 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.841 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.841 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.841 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Container image name, without the tag", 2024-04-15T00:31:34.841 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.842 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.842 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.842 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.842 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_elasticsearch": { 2024-04-15T00:31:34.842 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_elasticsearch", 2024-04-15T00:31:34.842 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.842 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.842 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.843 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-15T00:31:34.843 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.843 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.843 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.843 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "elasticsearch container image", 2024-04-15T00:31:34.843 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.843 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.843 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.844 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.844 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_grafana": { 2024-04-15T00:31:34.844 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_grafana", 2024-04-15T00:31:34.844 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.844 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.844 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.844 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-15T00:31:34.844 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.844 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.845 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.845 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Prometheus container image", 2024-04-15T00:31:34.845 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.845 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.845 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.845 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.845 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_haproxy": { 2024-04-15T00:31:34.845 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_haproxy", 2024-04-15T00:31:34.846 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.846 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.846 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.846 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-15T00:31:34.846 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.847 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.847 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.847 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "HAproxy container image", 2024-04-15T00:31:34.847 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.847 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.847 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.847 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.847 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_jaeger_agent": { 2024-04-15T00:31:34.848 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_jaeger_agent", 2024-04-15T00:31:34.848 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.848 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.848 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.848 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-15T00:31:34.848 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.848 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.849 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.849 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Jaeger agent container image", 2024-04-15T00:31:34.849 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.849 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.849 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.849 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.849 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_jaeger_collector": { 2024-04-15T00:31:34.849 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_jaeger_collector", 2024-04-15T00:31:34.850 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.850 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.850 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.850 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-15T00:31:34.850 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.850 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.850 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.850 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Jaeger collector container image", 2024-04-15T00:31:34.851 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.851 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.851 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.851 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.851 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_jaeger_query": { 2024-04-15T00:31:34.851 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_jaeger_query", 2024-04-15T00:31:34.851 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.851 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.852 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.852 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-15T00:31:34.852 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.852 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.852 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.852 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Jaeger query container image", 2024-04-15T00:31:34.852 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.852 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.852 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.853 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.853 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_keepalived": { 2024-04-15T00:31:34.853 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_keepalived", 2024-04-15T00:31:34.853 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.853 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.853 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.853 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-15T00:31:34.854 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.854 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.854 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.854 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Keepalived container image", 2024-04-15T00:31:34.854 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.854 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.854 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.854 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.855 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_loki": { 2024-04-15T00:31:34.855 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_loki", 2024-04-15T00:31:34.855 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.855 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.855 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.855 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-15T00:31:34.855 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.855 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.855 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.856 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Loki container image", 2024-04-15T00:31:34.856 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.856 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.856 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.856 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.856 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_node_exporter": { 2024-04-15T00:31:34.856 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_node_exporter", 2024-04-15T00:31:34.856 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.857 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.857 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.857 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-15T00:31:34.857 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.857 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.857 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.857 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Prometheus container image", 2024-04-15T00:31:34.857 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.857 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.858 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.858 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_nvmeof": { 2024-04-15T00:31:34.858 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_nvmeof", 2024-04-15T00:31:34.859 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.859 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.859 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.859 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-15T00:31:34.859 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.859 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.859 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.859 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Nvme-of container image", 2024-04-15T00:31:34.859 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.860 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.860 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.860 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.860 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_prometheus": { 2024-04-15T00:31:34.860 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_prometheus", 2024-04-15T00:31:34.860 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.860 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.860 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.861 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-15T00:31:34.861 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.861 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.861 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.861 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Prometheus container image", 2024-04-15T00:31:34.861 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.861 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.861 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.861 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.862 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_promtail": { 2024-04-15T00:31:34.862 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_promtail", 2024-04-15T00:31:34.862 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.862 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.862 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.862 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-15T00:31:34.862 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.862 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.863 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.863 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Promtail container image", 2024-04-15T00:31:34.863 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.863 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.863 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.863 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_snmp_gateway": { 2024-04-15T00:31:34.863 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_snmp_gateway", 2024-04-15T00:31:34.863 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.864 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.864 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.864 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-15T00:31:34.864 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.864 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.864 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.864 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "SNMP Gateway container image", 2024-04-15T00:31:34.864 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.864 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.865 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.865 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.865 INFO:teuthology.orchestra.run.smithi031.stdout: "container_init": { 2024-04-15T00:31:34.865 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_init", 2024-04-15T00:31:34.865 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.865 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.865 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.865 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:34.866 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.866 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.866 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.866 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Run podman/docker with `--init`", 2024-04-15T00:31:34.866 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.866 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.866 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.866 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.867 INFO:teuthology.orchestra.run.smithi031.stdout: "daemon_cache_timeout": { 2024-04-15T00:31:34.867 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "daemon_cache_timeout", 2024-04-15T00:31:34.867 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:34.867 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.867 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.867 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-04-15T00:31:34.867 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.867 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.867 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.868 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-15T00:31:34.868 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.868 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.868 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.868 INFO:teuthology.orchestra.run.smithi031.stdout: "default_cephadm_command_timeout": { 2024-04-15T00:31:34.868 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "default_cephadm_command_timeout", 2024-04-15T00:31:34.868 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:34.869 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.869 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.869 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "900", 2024-04-15T00:31:34.869 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.869 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.869 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.869 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-15T00:31:34.869 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.869 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.870 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.870 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.870 INFO:teuthology.orchestra.run.smithi031.stdout: "default_registry": { 2024-04-15T00:31:34.870 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "default_registry", 2024-04-15T00:31:34.870 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.870 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.870 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.870 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "docker.io", 2024-04-15T00:31:34.870 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.871 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.871 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.871 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-15T00:31:34.871 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.871 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.871 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.871 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.871 INFO:teuthology.orchestra.run.smithi031.stdout: "device_cache_timeout": { 2024-04-15T00:31:34.871 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "device_cache_timeout", 2024-04-15T00:31:34.872 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:34.872 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.872 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.872 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "1800", 2024-04-15T00:31:34.872 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.872 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.872 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.872 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "seconds to cache device inventory", 2024-04-15T00:31:34.872 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.873 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.873 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.873 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.873 INFO:teuthology.orchestra.run.smithi031.stdout: "device_enhanced_scan": { 2024-04-15T00:31:34.873 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "device_enhanced_scan", 2024-04-15T00:31:34.873 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.873 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.873 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.874 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:34.874 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.874 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.874 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.874 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-15T00:31:34.874 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.874 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.874 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.874 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.875 INFO:teuthology.orchestra.run.smithi031.stdout: "facts_cache_timeout": { 2024-04-15T00:31:34.875 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "facts_cache_timeout", 2024-04-15T00:31:34.875 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:34.875 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.875 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.875 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-04-15T00:31:34.875 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.875 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.875 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.876 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "seconds to cache host facts data", 2024-04-15T00:31:34.876 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.876 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.876 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.876 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.876 INFO:teuthology.orchestra.run.smithi031.stdout: "grafana_dashboards_path": { 2024-04-15T00:31:34.876 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "grafana_dashboards_path", 2024-04-15T00:31:34.876 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.876 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.877 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.877 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-15T00:31:34.877 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.877 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.877 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.877 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-15T00:31:34.877 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.877 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.877 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.878 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.878 INFO:teuthology.orchestra.run.smithi031.stdout: "host_check_interval": { 2024-04-15T00:31:34.878 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "host_check_interval", 2024-04-15T00:31:34.878 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:34.878 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.878 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.878 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-04-15T00:31:34.878 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.878 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.879 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.879 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to perform a host check", 2024-04-15T00:31:34.879 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.879 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.879 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.879 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.879 INFO:teuthology.orchestra.run.smithi031.stdout: "hw_monitoring": { 2024-04-15T00:31:34.879 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "hw_monitoring", 2024-04-15T00:31:34.879 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.880 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.880 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.880 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:34.880 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.880 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.880 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.880 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-15T00:31:34.880 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.881 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.881 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.881 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.881 INFO:teuthology.orchestra.run.smithi031.stdout: "inventory_list_all": { 2024-04-15T00:31:34.881 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "inventory_list_all", 2024-04-15T00:31:34.881 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.881 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.881 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.881 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:34.882 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.882 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.882 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.882 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-15T00:31:34.882 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.882 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.882 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.882 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.883 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:34.883 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:34.883 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.883 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.883 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.883 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:34.883 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.883 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.883 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:34.884 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:34.884 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:34.884 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:34.884 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:34.884 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:34.884 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:34.884 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:34.884 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.884 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.885 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.885 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.885 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.885 INFO:teuthology.orchestra.run.smithi031.stdout: "log_refresh_metadata": { 2024-04-15T00:31:34.885 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_refresh_metadata", 2024-04-15T00:31:34.885 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.885 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.885 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.885 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:34.886 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.886 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.886 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.886 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-15T00:31:34.886 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.886 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.886 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.886 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.887 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:34.887 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:34.887 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.887 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.887 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.887 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:34.887 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.887 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.888 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.888 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-15T00:31:34.888 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.888 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.888 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.888 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.888 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:34.888 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:34.888 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.889 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.889 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.889 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:34.889 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.889 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.889 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:34.889 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:34.889 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:34.889 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:34.890 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:34.890 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:34.890 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:34.890 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:34.890 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.890 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.890 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.890 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.890 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.891 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:34.891 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:34.891 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.891 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.891 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.891 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:34.891 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.891 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.891 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.892 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.892 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.892 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.892 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.892 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.892 INFO:teuthology.orchestra.run.smithi031.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-15T00:31:34.892 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-15T00:31:34.892 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.893 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.893 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.893 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:34.893 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.893 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.893 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.893 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-15T00:31:34.893 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.893 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.894 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.894 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.894 INFO:teuthology.orchestra.run.smithi031.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-15T00:31:34.894 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-15T00:31:34.894 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.894 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.894 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.894 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "*", 2024-04-15T00:31:34.894 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.895 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.895 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.895 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-15T00:31:34.895 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.895 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.895 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.895 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.895 INFO:teuthology.orchestra.run.smithi031.stdout: "max_count_per_host": { 2024-04-15T00:31:34.895 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_count_per_host", 2024-04-15T00:31:34.896 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:34.896 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.896 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.896 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-04-15T00:31:34.896 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.896 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.896 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.896 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "max number of daemons per service per host", 2024-04-15T00:31:34.896 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.897 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.897 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.897 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.897 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd_draining_count": { 2024-04-15T00:31:34.897 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_osd_draining_count", 2024-04-15T00:31:34.897 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:34.897 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.897 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.898 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-04-15T00:31:34.898 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.898 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.898 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.898 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-15T00:31:34.898 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.898 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.898 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.898 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.899 INFO:teuthology.orchestra.run.smithi031.stdout: "migration_current": { 2024-04-15T00:31:34.899 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "migration_current", 2024-04-15T00:31:34.899 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:34.899 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.899 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.899 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:34.899 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.899 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.899 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.900 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "internal - do not modify", 2024-04-15T00:31:34.900 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.900 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.900 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.900 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.900 INFO:teuthology.orchestra.run.smithi031.stdout: "mode": { 2024-04-15T00:31:34.900 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mode", 2024-04-15T00:31:34.900 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.900 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.901 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.901 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "root", 2024-04-15T00:31:34.901 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.901 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.901 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:34.901 INFO:teuthology.orchestra.run.smithi031.stdout: "cephadm-package", 2024-04-15T00:31:34.901 INFO:teuthology.orchestra.run.smithi031.stdout: "root" 2024-04-15T00:31:34.901 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:34.901 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "mode for remote execution of cephadm", 2024-04-15T00:31:34.902 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.902 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.902 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.902 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.902 INFO:teuthology.orchestra.run.smithi031.stdout: "oob_default_addr": { 2024-04-15T00:31:34.902 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "oob_default_addr", 2024-04-15T00:31:34.902 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.902 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.903 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.903 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "169.254.1.1", 2024-04-15T00:31:34.903 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.903 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.903 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.903 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-15T00:31:34.903 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.903 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.903 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.904 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.904 INFO:teuthology.orchestra.run.smithi031.stdout: "prometheus_alerts_path": { 2024-04-15T00:31:34.904 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "prometheus_alerts_path", 2024-04-15T00:31:34.904 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.904 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.904 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.904 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-15T00:31:34.904 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.904 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.905 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.905 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-15T00:31:34.905 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.905 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.905 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.905 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.905 INFO:teuthology.orchestra.run.smithi031.stdout: "registry_insecure": { 2024-04-15T00:31:34.905 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "registry_insecure", 2024-04-15T00:31:34.906 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.906 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.906 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.906 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:34.906 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.906 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.906 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.906 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-15T00:31:34.906 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.907 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.907 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.907 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.907 INFO:teuthology.orchestra.run.smithi031.stdout: "registry_password": { 2024-04-15T00:31:34.907 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "registry_password", 2024-04-15T00:31:34.907 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.907 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.907 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.908 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:34.908 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.908 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.908 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.908 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-15T00:31:34.908 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.908 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.908 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.908 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.909 INFO:teuthology.orchestra.run.smithi031.stdout: "registry_url": { 2024-04-15T00:31:34.909 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "registry_url", 2024-04-15T00:31:34.909 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.909 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.909 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.909 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:34.909 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.909 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.909 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.910 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-15T00:31:34.910 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.910 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.910 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.910 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.910 INFO:teuthology.orchestra.run.smithi031.stdout: "registry_username": { 2024-04-15T00:31:34.910 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "registry_username", 2024-04-15T00:31:34.910 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.911 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.911 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.911 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:34.911 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.911 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.911 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.911 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-15T00:31:34.911 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.911 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.912 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.912 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.912 INFO:teuthology.orchestra.run.smithi031.stdout: "secure_monitoring_stack": { 2024-04-15T00:31:34.912 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "secure_monitoring_stack", 2024-04-15T00:31:34.912 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.912 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.912 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.912 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:34.913 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.913 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.913 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.913 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-15T00:31:34.913 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.913 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.913 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.913 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.913 INFO:teuthology.orchestra.run.smithi031.stdout: "service_discovery_port": { 2024-04-15T00:31:34.914 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "service_discovery_port", 2024-04-15T00:31:34.914 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:34.914 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.914 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.914 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8765", 2024-04-15T00:31:34.914 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.914 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.914 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.914 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "cephadm service discovery port", 2024-04-15T00:31:34.915 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.915 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.915 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.915 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.915 INFO:teuthology.orchestra.run.smithi031.stdout: "ssh_config_file": { 2024-04-15T00:31:34.915 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssh_config_file", 2024-04-15T00:31:34.915 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.915 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.915 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.916 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:34.916 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.916 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.916 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.916 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-15T00:31:34.916 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.916 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.916 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.917 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.917 INFO:teuthology.orchestra.run.smithi031.stdout: "use_agent": { 2024-04-15T00:31:34.917 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "use_agent", 2024-04-15T00:31:34.917 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.917 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.917 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.917 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:34.917 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.917 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.918 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.918 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-15T00:31:34.918 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.918 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.918 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.918 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.918 INFO:teuthology.orchestra.run.smithi031.stdout: "use_repo_digest": { 2024-04-15T00:31:34.918 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "use_repo_digest", 2024-04-15T00:31:34.918 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.919 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.919 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.919 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:34.919 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.919 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.919 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.919 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-15T00:31:34.919 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.919 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.920 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.920 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.920 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_on_failed_host_check": { 2024-04-15T00:31:34.920 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_on_failed_host_check", 2024-04-15T00:31:34.920 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.920 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.920 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.920 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:34.920 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.921 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.921 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.921 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "raise a health warning if the host check fails", 2024-04-15T00:31:34.921 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.921 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.921 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.921 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.921 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_on_stray_daemons": { 2024-04-15T00:31:34.921 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_on_stray_daemons", 2024-04-15T00:31:34.922 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.922 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.922 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.922 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:34.922 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.922 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.922 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.922 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-15T00:31:34.923 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.923 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.923 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.923 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.923 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_on_stray_hosts": { 2024-04-15T00:31:34.923 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_on_stray_hosts", 2024-04-15T00:31:34.923 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.923 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.923 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.924 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:34.924 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.924 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.924 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.924 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-15T00:31:34.924 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.924 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.924 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.924 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:34.925 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:34.925 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.925 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:34.925 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crash", 2024-04-15T00:31:34.925 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:34.925 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:34.925 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:34.925 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:34.925 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:34.926 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.926 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.926 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.926 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:34.926 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.926 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.926 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:34.926 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:34.926 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:34.927 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:34.927 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:34.927 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:34.927 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:34.927 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:34.927 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.927 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.927 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.928 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.928 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.928 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:34.928 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:34.928 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.928 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.928 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.928 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:34.928 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.929 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.929 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.929 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.929 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.929 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.929 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.929 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.929 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:34.929 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:34.930 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.930 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.930 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.930 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:34.930 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.930 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.930 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:34.930 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:34.931 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:34.931 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:34.931 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:34.931 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:34.931 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:34.931 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:34.931 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.931 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.931 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.932 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.932 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.932 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:34.932 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:34.932 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.932 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.932 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.932 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:34.932 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.933 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.933 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.933 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.933 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.933 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.933 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.933 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.933 INFO:teuthology.orchestra.run.smithi031.stdout: "retain_interval": { 2024-04-15T00:31:34.933 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "retain_interval", 2024-04-15T00:31:34.934 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:34.934 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.934 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.934 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "31536000", 2024-04-15T00:31:34.934 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.934 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.934 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.934 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-15T00:31:34.935 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.935 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.935 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.935 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.935 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_recent_interval": { 2024-04-15T00:31:34.935 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_recent_interval", 2024-04-15T00:31:34.935 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:34.935 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.935 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:34.936 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "1209600", 2024-04-15T00:31:34.936 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.936 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.936 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.936 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-15T00:31:34.936 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.936 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.936 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.936 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:34.937 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:34.937 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.937 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:34.937 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "dashboard", 2024-04-15T00:31:34.937 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:34.937 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:34.937 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:34.937 INFO:teuthology.orchestra.run.smithi031.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-15T00:31:34.937 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-15T00:31:34.938 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:34.938 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.938 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.938 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-04-15T00:31:34.938 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.938 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.938 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.938 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.938 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.939 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.939 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.939 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.939 INFO:teuthology.orchestra.run.smithi031.stdout: "ALERTMANAGER_API_HOST": { 2024-04-15T00:31:34.939 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-15T00:31:34.939 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.939 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.939 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.939 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:34.940 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.940 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.940 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.940 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.940 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.940 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.940 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.940 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.940 INFO:teuthology.orchestra.run.smithi031.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-15T00:31:34.941 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-15T00:31:34.941 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.941 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.941 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.941 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:34.941 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.941 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.941 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.942 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.942 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.942 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.942 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.942 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.942 INFO:teuthology.orchestra.run.smithi031.stdout: "AUDIT_API_ENABLED": { 2024-04-15T00:31:34.942 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "AUDIT_API_ENABLED", 2024-04-15T00:31:34.942 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.942 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.943 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.943 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:34.943 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.943 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.943 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.943 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.943 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.943 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.943 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.944 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.944 INFO:teuthology.orchestra.run.smithi031.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-15T00:31:34.944 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-15T00:31:34.944 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.944 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.944 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.944 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:34.944 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.944 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.945 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.945 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.945 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.945 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.945 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.945 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.945 INFO:teuthology.orchestra.run.smithi031.stdout: "ENABLE_BROWSABLE_API": { 2024-04-15T00:31:34.945 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-15T00:31:34.945 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.946 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.946 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.946 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:34.946 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.946 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.946 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.947 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.947 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.947 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.947 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.947 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.947 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-15T00:31:34.947 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-15T00:31:34.947 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.948 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.948 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.948 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:34.948 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.948 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.948 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.948 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.948 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.948 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.949 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.949 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.949 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-15T00:31:34.949 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-15T00:31:34.949 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.949 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.949 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.949 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:34.950 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.950 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.950 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.950 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.950 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.950 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.950 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.950 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.951 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-15T00:31:34.951 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-15T00:31:34.951 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.951 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.951 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.951 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:34.951 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.951 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.951 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.952 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.952 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.952 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.952 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.952 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.952 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-15T00:31:34.952 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-15T00:31:34.953 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.953 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.953 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.953 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:34.953 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.953 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.953 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.953 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.954 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.954 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.954 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.954 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.954 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-15T00:31:34.954 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-15T00:31:34.954 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.954 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.955 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.955 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:34.955 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.955 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.955 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.955 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.955 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.955 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.955 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.956 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.956 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-15T00:31:34.956 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-15T00:31:34.956 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.956 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.956 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.956 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:34.956 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.956 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.957 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.957 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.957 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.957 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.957 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.957 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.957 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-15T00:31:34.958 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-15T00:31:34.958 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.958 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.958 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.958 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:34.958 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.958 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.958 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.958 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.959 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.959 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.959 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.959 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.959 INFO:teuthology.orchestra.run.smithi031.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-15T00:31:34.959 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-15T00:31:34.959 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.960 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.960 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.960 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:34.960 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.960 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.960 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.960 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.960 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.960 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.961 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.961 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.961 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_API_PASSWORD": { 2024-04-15T00:31:34.961 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-15T00:31:34.961 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.961 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.961 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.961 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "admin", 2024-04-15T00:31:34.962 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.962 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.962 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.962 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.962 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.962 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.962 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.962 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.962 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-15T00:31:34.963 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-15T00:31:34.963 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.963 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.963 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.963 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:34.963 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.963 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.963 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.963 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.964 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.964 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.964 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.964 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.964 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_API_URL": { 2024-04-15T00:31:34.964 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_API_URL", 2024-04-15T00:31:34.964 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.964 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.964 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.965 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:34.965 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.965 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.965 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.965 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.965 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.965 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.965 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.966 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.966 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_API_USERNAME": { 2024-04-15T00:31:34.966 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-15T00:31:34.966 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.966 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.966 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.966 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "admin", 2024-04-15T00:31:34.966 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.966 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.967 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.967 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.967 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.967 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.967 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.967 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.967 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-15T00:31:34.967 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-15T00:31:34.967 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.968 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.968 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.968 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:34.968 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.968 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.968 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.968 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.968 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.968 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.969 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.969 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.969 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-15T00:31:34.969 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-15T00:31:34.969 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.969 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.969 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.969 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:34.969 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.970 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.970 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.970 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.970 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.970 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.970 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.970 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.970 INFO:teuthology.orchestra.run.smithi031.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-15T00:31:34.971 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-15T00:31:34.971 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.971 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.971 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.971 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:34.971 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.971 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.971 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.972 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.972 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.972 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.972 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.972 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.972 INFO:teuthology.orchestra.run.smithi031.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-15T00:31:34.972 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-15T00:31:34.972 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.972 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.973 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.973 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:34.973 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.973 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.973 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.973 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.973 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.973 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.973 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.974 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.974 INFO:teuthology.orchestra.run.smithi031.stdout: "PROMETHEUS_API_HOST": { 2024-04-15T00:31:34.974 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-15T00:31:34.974 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.974 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.974 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.974 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:34.974 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.974 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.975 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.975 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.975 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.975 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.975 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.975 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.975 INFO:teuthology.orchestra.run.smithi031.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-15T00:31:34.975 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-15T00:31:34.975 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.976 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.976 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.976 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:34.976 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.976 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.976 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.976 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.976 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.976 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.977 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.977 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.977 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-15T00:31:34.977 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-15T00:31:34.977 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.977 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.977 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.977 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:34.977 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.978 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.978 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.978 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.978 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.978 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.978 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.978 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.978 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-15T00:31:34.979 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-15T00:31:34.979 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.979 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.979 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.979 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:34.979 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.979 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.979 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.979 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.980 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.980 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.980 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.980 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.980 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-15T00:31:34.980 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-15T00:31:34.980 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.980 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.980 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.981 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:34.981 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.981 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.981 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.981 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.981 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.981 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.981 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.981 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.982 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-15T00:31:34.982 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-15T00:31:34.982 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.982 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.982 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.982 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:34.982 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.982 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.982 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.983 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.983 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.983 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.983 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.983 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.983 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-15T00:31:34.983 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-15T00:31:34.983 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.984 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.984 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.984 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:34.984 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.984 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.985 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.985 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.985 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.985 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.985 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.986 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.986 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-15T00:31:34.986 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-15T00:31:34.986 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.986 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.986 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.986 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:34.987 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.987 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.987 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.987 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.987 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.987 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.987 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.987 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.987 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-15T00:31:34.988 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-15T00:31:34.988 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.988 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.988 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.988 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:34.988 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.988 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.988 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.988 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.989 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.989 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.989 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.989 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.989 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_ENABLED": { 2024-04-15T00:31:34.989 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-15T00:31:34.989 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:34.989 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.989 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.990 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:34.990 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.990 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.990 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.990 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.990 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.990 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.990 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.991 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.991 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-15T00:31:34.991 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-15T00:31:34.991 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.991 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.991 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.991 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-15T00:31:34.991 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.991 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.992 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.992 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.992 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.992 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.992 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.992 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.992 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-15T00:31:34.992 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-15T00:31:34.993 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:34.993 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.993 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.993 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-04-15T00:31:34.993 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.993 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.993 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.993 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.993 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.994 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.994 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.994 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.994 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-15T00:31:34.994 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-15T00:31:34.994 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:34.994 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.994 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.995 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8", 2024-04-15T00:31:34.995 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.995 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.995 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.995 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.995 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.995 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.995 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.995 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.996 INFO:teuthology.orchestra.run.smithi031.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-15T00:31:34.996 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-15T00:31:34.996 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:34.996 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.996 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.996 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "45", 2024-04-15T00:31:34.996 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.996 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.996 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.997 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.997 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.997 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.997 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.997 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.997 INFO:teuthology.orchestra.run.smithi031.stdout: "RGW_API_ACCESS_KEY": { 2024-04-15T00:31:34.997 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-15T00:31:34.997 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.997 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.998 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.998 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:34.998 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:34.998 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:34.998 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:34.998 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:34.998 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:34.998 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:34.999 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:34.999 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:34.999 INFO:teuthology.orchestra.run.smithi031.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-15T00:31:34.999 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-15T00:31:34.999 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:34.999 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:34.999 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:34.999 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "admin", 2024-04-15T00:31:34.999 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.000 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.000 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.000 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.000 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.000 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.000 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.000 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.000 INFO:teuthology.orchestra.run.smithi031.stdout: "RGW_API_SECRET_KEY": { 2024-04-15T00:31:35.001 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-15T00:31:35.001 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.001 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.002 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.002 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.002 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.002 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.003 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.003 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.003 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.003 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.003 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.003 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.003 INFO:teuthology.orchestra.run.smithi031.stdout: "RGW_API_SSL_VERIFY": { 2024-04-15T00:31:35.003 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-15T00:31:35.003 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.004 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.004 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.004 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.004 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.004 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.004 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.004 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.004 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.004 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.005 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.005 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.005 INFO:teuthology.orchestra.run.smithi031.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-15T00:31:35.005 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-15T00:31:35.005 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.005 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.005 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.005 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-04-15T00:31:35.005 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.006 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.006 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.006 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.006 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.006 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.006 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.006 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.006 INFO:teuthology.orchestra.run.smithi031.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-15T00:31:35.007 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-15T00:31:35.007 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.007 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.007 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.007 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-04-15T00:31:35.007 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.007 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.007 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.007 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.008 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.008 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.008 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.008 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.008 INFO:teuthology.orchestra.run.smithi031.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-15T00:31:35.008 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-15T00:31:35.008 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.008 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.008 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.009 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5", 2024-04-15T00:31:35.009 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.009 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.009 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.009 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.009 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.009 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.009 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.009 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.010 INFO:teuthology.orchestra.run.smithi031.stdout: "cross_origin_url": { 2024-04-15T00:31:35.010 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cross_origin_url", 2024-04-15T00:31:35.010 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.010 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.010 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.010 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.010 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.010 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.011 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.011 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.011 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.011 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.011 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.011 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.011 INFO:teuthology.orchestra.run.smithi031.stdout: "crt_file": { 2024-04-15T00:31:35.011 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crt_file", 2024-04-15T00:31:35.011 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.012 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.012 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.012 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.012 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.012 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.012 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.012 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.012 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.013 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.013 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.013 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.013 INFO:teuthology.orchestra.run.smithi031.stdout: "debug": { 2024-04-15T00:31:35.013 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "debug", 2024-04-15T00:31:35.013 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.013 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.014 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.014 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.014 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.014 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.014 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.014 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Enable/disable debug options", 2024-04-15T00:31:35.014 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.014 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.015 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.015 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.015 INFO:teuthology.orchestra.run.smithi031.stdout: "jwt_token_ttl": { 2024-04-15T00:31:35.015 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "jwt_token_ttl", 2024-04-15T00:31:35.015 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.015 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.015 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.016 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "28800", 2024-04-15T00:31:35.016 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.016 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.016 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.016 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.016 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.016 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.016 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.017 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.017 INFO:teuthology.orchestra.run.smithi031.stdout: "key_file": { 2024-04-15T00:31:35.017 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "key_file", 2024-04-15T00:31:35.017 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.017 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.017 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.017 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.018 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.018 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.018 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.018 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.018 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.018 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.018 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.018 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.018 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.019 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.019 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.019 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.019 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.019 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.019 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.019 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.019 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.019 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.020 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.020 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.020 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.020 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.021 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.021 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.022 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.022 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.022 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.022 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.022 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.022 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.022 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.022 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.023 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.023 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.023 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.023 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.023 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.023 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.023 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.023 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.023 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.024 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.024 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.024 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.024 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.024 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.024 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.024 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.024 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.025 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.025 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.025 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.025 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.025 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.025 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.025 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.025 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.025 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.026 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.026 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.026 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.026 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.026 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.026 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.026 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.026 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.026 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.027 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.027 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.027 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.027 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.027 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.027 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.028 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.028 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.029 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.029 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.029 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.029 INFO:teuthology.orchestra.run.smithi031.stdout: "motd": { 2024-04-15T00:31:35.029 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "motd", 2024-04-15T00:31:35.029 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.029 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.029 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.030 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.030 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.030 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.030 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.030 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "The message of the day", 2024-04-15T00:31:35.030 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.030 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.030 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.031 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.031 INFO:teuthology.orchestra.run.smithi031.stdout: "redirect_resolve_ip_addr": { 2024-04-15T00:31:35.031 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "redirect_resolve_ip_addr", 2024-04-15T00:31:35.031 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.031 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.031 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.031 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.031 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.031 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.032 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.032 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.032 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.032 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.032 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.032 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.033 INFO:teuthology.orchestra.run.smithi031.stdout: "server_addr": { 2024-04-15T00:31:35.033 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_addr", 2024-04-15T00:31:35.033 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.033 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.033 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.033 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "::", 2024-04-15T00:31:35.033 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.033 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.034 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.034 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.034 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.034 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.034 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.035 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.035 INFO:teuthology.orchestra.run.smithi031.stdout: "server_port": { 2024-04-15T00:31:35.035 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_port", 2024-04-15T00:31:35.035 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.035 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.035 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.035 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8080", 2024-04-15T00:31:35.035 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.035 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.036 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.036 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.036 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.036 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.036 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.036 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.036 INFO:teuthology.orchestra.run.smithi031.stdout: "ssl": { 2024-04-15T00:31:35.036 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssl", 2024-04-15T00:31:35.037 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.037 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.037 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.037 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.037 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.037 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.037 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.037 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.037 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.038 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.038 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.038 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.038 INFO:teuthology.orchestra.run.smithi031.stdout: "ssl_server_port": { 2024-04-15T00:31:35.038 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssl_server_port", 2024-04-15T00:31:35.038 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.038 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.038 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.039 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8443", 2024-04-15T00:31:35.039 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.039 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.039 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.039 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.039 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.040 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.040 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.040 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.040 INFO:teuthology.orchestra.run.smithi031.stdout: "standby_behaviour": { 2024-04-15T00:31:35.040 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "standby_behaviour", 2024-04-15T00:31:35.040 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.040 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.040 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.040 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "redirect", 2024-04-15T00:31:35.041 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.041 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.041 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.041 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.041 INFO:teuthology.orchestra.run.smithi031.stdout: "redirect" 2024-04-15T00:31:35.041 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.041 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.041 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.042 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.042 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.042 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.042 INFO:teuthology.orchestra.run.smithi031.stdout: "standby_error_status_code": { 2024-04-15T00:31:35.042 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "standby_error_status_code", 2024-04-15T00:31:35.042 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.042 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.042 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.043 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "500", 2024-04-15T00:31:35.043 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "400", 2024-04-15T00:31:35.043 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "599", 2024-04-15T00:31:35.043 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.043 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.043 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.043 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.043 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.043 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.044 INFO:teuthology.orchestra.run.smithi031.stdout: "url_prefix": { 2024-04-15T00:31:35.044 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "url_prefix", 2024-04-15T00:31:35.044 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.044 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.044 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.045 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.045 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.045 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.045 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.045 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.045 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.045 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.045 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.046 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.046 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.046 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.046 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.046 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "devicehealth", 2024-04-15T00:31:35.046 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.046 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.046 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.047 INFO:teuthology.orchestra.run.smithi031.stdout: "enable_monitoring": { 2024-04-15T00:31:35.047 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "enable_monitoring", 2024-04-15T00:31:35.047 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.047 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.047 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.047 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.047 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.047 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.047 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.048 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "monitor device health metrics", 2024-04-15T00:31:35.048 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.048 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.048 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.048 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.048 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.048 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.048 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.048 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.049 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.049 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.049 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.049 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.049 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.049 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.049 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.049 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.050 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.050 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.050 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.050 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.050 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.050 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.050 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.050 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.050 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.051 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.051 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.051 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.051 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.051 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.051 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.051 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.051 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.052 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.052 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.052 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.052 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.052 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.052 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.052 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.052 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.052 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.053 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.053 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.053 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.053 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.053 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.053 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.053 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.053 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.054 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.054 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.054 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.054 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.054 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.055 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.055 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.055 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.055 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.055 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.055 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.055 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.056 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.056 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.056 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.056 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.056 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.056 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.056 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.056 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.057 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.057 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.057 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.057 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.057 INFO:teuthology.orchestra.run.smithi031.stdout: "mark_out_threshold": { 2024-04-15T00:31:35.057 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mark_out_threshold", 2024-04-15T00:31:35.057 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:35.057 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.057 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.058 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "2419200", 2024-04-15T00:31:35.058 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.058 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.058 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.058 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-15T00:31:35.058 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.058 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.058 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.059 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.059 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": { 2024-04-15T00:31:35.059 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "pool_name", 2024-04-15T00:31:35.059 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.059 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.059 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.059 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "device_health_metrics", 2024-04-15T00:31:35.059 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.059 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.060 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.060 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-15T00:31:35.060 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.060 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.060 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.060 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.060 INFO:teuthology.orchestra.run.smithi031.stdout: "retention_period": { 2024-04-15T00:31:35.060 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "retention_period", 2024-04-15T00:31:35.061 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:35.061 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.061 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.061 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "15552000", 2024-04-15T00:31:35.061 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.061 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.061 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.061 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how long to retain device health metrics", 2024-04-15T00:31:35.061 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.062 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.062 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.062 INFO:teuthology.orchestra.run.smithi031.stdout: "scrape_frequency": { 2024-04-15T00:31:35.062 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "scrape_frequency", 2024-04-15T00:31:35.062 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:35.062 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.062 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.063 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "86400", 2024-04-15T00:31:35.063 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.063 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.063 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.063 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-15T00:31:35.063 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.063 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.063 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.064 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.064 INFO:teuthology.orchestra.run.smithi031.stdout: "self_heal": { 2024-04-15T00:31:35.064 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "self_heal", 2024-04-15T00:31:35.064 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.064 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.064 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.064 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.064 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.064 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.065 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.065 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-15T00:31:35.065 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.065 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.066 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.066 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.066 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-04-15T00:31:35.066 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-04-15T00:31:35.066 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:35.066 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.066 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.066 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-04-15T00:31:35.066 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.067 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.067 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.067 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to wake up and check device health", 2024-04-15T00:31:35.067 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.067 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.067 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.067 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.067 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_threshold": { 2024-04-15T00:31:35.068 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_threshold", 2024-04-15T00:31:35.068 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:35.068 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.068 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.068 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "7257600", 2024-04-15T00:31:35.068 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.068 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.068 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.068 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-15T00:31:35.069 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.069 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.069 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.069 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.069 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.069 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.069 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.069 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "diskprediction_local", 2024-04-15T00:31:35.069 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.070 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.070 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.070 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.070 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.070 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.070 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.070 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.070 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.071 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.071 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.071 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.071 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.071 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.071 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.071 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.071 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.071 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.072 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.072 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.072 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.072 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.072 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.072 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.072 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.072 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.073 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.073 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.073 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.073 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.073 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.073 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.073 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.073 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.073 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.074 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.074 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.074 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.074 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.074 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.074 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.074 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.074 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.074 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.075 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.075 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.075 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.075 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.076 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.076 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.076 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.076 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.076 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.076 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.077 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.077 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.077 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.077 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.077 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.077 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.077 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.077 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.077 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.078 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.078 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.078 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.078 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.078 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.078 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.078 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.078 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.079 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.079 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.079 INFO:teuthology.orchestra.run.smithi031.stdout: "predict_interval": { 2024-04-15T00:31:35.079 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "predict_interval", 2024-04-15T00:31:35.079 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.079 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.079 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.079 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "86400", 2024-04-15T00:31:35.080 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.080 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.080 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.080 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.080 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.080 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.080 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.080 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.080 INFO:teuthology.orchestra.run.smithi031.stdout: "predictor_model": { 2024-04-15T00:31:35.081 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "predictor_model", 2024-04-15T00:31:35.081 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.081 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.081 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.081 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "prophetstor", 2024-04-15T00:31:35.081 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.081 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.081 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.081 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.082 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.082 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.082 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.082 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.082 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-04-15T00:31:35.082 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-04-15T00:31:35.082 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.082 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.083 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.083 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-04-15T00:31:35.083 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.083 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.083 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.083 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.083 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.083 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.083 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.084 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.084 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.084 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.084 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.084 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "influx", 2024-04-15T00:31:35.084 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": false, 2024-04-15T00:31:35.084 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "influxdb python module not found", 2024-04-15T00:31:35.084 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.085 INFO:teuthology.orchestra.run.smithi031.stdout: "batch_size": { 2024-04-15T00:31:35.085 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "batch_size", 2024-04-15T00:31:35.085 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.085 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.085 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.085 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5000", 2024-04-15T00:31:35.085 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.085 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.085 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.086 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-15T00:31:35.086 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.086 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.086 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.086 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.087 INFO:teuthology.orchestra.run.smithi031.stdout: "database": { 2024-04-15T00:31:35.087 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "database", 2024-04-15T00:31:35.087 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.087 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.087 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.087 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "ceph", 2024-04-15T00:31:35.087 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.087 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.088 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.088 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-15T00:31:35.088 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.088 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.088 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.088 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.088 INFO:teuthology.orchestra.run.smithi031.stdout: "hostname": { 2024-04-15T00:31:35.088 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "hostname", 2024-04-15T00:31:35.089 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.089 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.089 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.089 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.089 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.089 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.089 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.089 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "InfluxDB server hostname", 2024-04-15T00:31:35.089 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.090 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.090 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.090 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.090 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-04-15T00:31:35.090 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-04-15T00:31:35.090 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:35.090 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.090 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.091 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "30", 2024-04-15T00:31:35.091 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "5", 2024-04-15T00:31:35.091 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.091 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.091 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-15T00:31:35.091 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.091 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.091 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.092 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.092 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.092 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.092 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.092 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.092 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.092 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.092 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.093 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.093 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.093 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.093 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.093 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.093 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.093 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.093 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.093 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.094 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.094 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.094 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.094 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.094 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.094 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.094 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.094 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.095 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.095 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.095 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.095 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.095 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.095 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.095 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.096 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.096 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.096 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.096 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.096 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.096 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.097 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.097 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.097 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.097 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.097 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.097 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.097 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.097 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.097 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.098 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.098 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.098 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.098 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.098 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.098 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.098 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.098 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.099 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.099 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.099 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.099 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.099 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.099 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.099 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.099 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.099 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.100 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.100 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.100 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.100 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.100 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.100 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.100 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.100 INFO:teuthology.orchestra.run.smithi031.stdout: "password": { 2024-04-15T00:31:35.101 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "password", 2024-04-15T00:31:35.101 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.101 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.101 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.101 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.101 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.101 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.101 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.102 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "password of InfluxDB server user", 2024-04-15T00:31:35.102 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.102 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.102 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.102 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.102 INFO:teuthology.orchestra.run.smithi031.stdout: "port": { 2024-04-15T00:31:35.102 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "port", 2024-04-15T00:31:35.102 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.102 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.103 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.103 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8086", 2024-04-15T00:31:35.103 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.103 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.103 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.103 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "InfluxDB server port", 2024-04-15T00:31:35.103 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.103 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.104 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.104 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.104 INFO:teuthology.orchestra.run.smithi031.stdout: "ssl": { 2024-04-15T00:31:35.104 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssl", 2024-04-15T00:31:35.104 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.104 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.104 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.104 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "false", 2024-04-15T00:31:35.104 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.105 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.105 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.105 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-15T00:31:35.105 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.105 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.105 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.105 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.105 INFO:teuthology.orchestra.run.smithi031.stdout: "threads": { 2024-04-15T00:31:35.106 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "threads", 2024-04-15T00:31:35.106 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.106 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.106 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.106 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5", 2024-04-15T00:31:35.106 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1", 2024-04-15T00:31:35.106 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "32", 2024-04-15T00:31:35.106 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.107 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-15T00:31:35.107 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.107 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.107 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.107 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.107 INFO:teuthology.orchestra.run.smithi031.stdout: "username": { 2024-04-15T00:31:35.107 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "username", 2024-04-15T00:31:35.107 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.107 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.108 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.108 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.108 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.108 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.108 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.108 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "username of InfluxDB server user", 2024-04-15T00:31:35.108 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.108 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.109 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.109 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.109 INFO:teuthology.orchestra.run.smithi031.stdout: "verify_ssl": { 2024-04-15T00:31:35.109 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "verify_ssl", 2024-04-15T00:31:35.109 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.109 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.109 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.109 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "true", 2024-04-15T00:31:35.109 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.110 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.110 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.110 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-15T00:31:35.110 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.110 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.110 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.110 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.110 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.111 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.111 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.111 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "insights", 2024-04-15T00:31:35.111 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.111 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.111 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.111 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.111 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.112 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.112 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.112 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.112 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.112 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.112 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.112 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.112 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.112 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.113 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.113 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.113 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.113 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.113 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.113 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.113 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.113 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.114 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.114 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.114 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.114 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.114 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.114 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.114 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.114 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.114 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.115 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.115 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.115 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.115 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.115 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.115 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.116 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.116 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.116 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.116 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.116 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.116 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.116 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.116 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.117 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.117 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.117 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.117 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.117 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.117 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.117 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.117 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.117 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.118 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.118 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.118 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.118 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.118 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.118 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.118 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.118 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.119 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.119 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.119 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.119 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.119 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.119 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.119 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.119 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.119 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.120 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.120 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.120 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.120 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.120 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.120 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "iostat", 2024-04-15T00:31:35.120 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.120 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.121 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.121 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.121 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.121 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.121 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.121 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.121 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.121 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.121 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.122 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.122 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.122 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.122 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.122 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.122 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.122 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.122 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.123 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.123 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.123 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.123 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.123 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.123 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.123 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.123 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.123 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.124 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.124 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.124 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.124 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.124 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.124 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.124 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.124 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.125 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.125 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.125 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.125 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.125 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.125 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.125 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.125 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.125 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.126 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.126 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.126 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.126 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.126 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.126 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.126 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.126 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.127 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.127 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.127 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.127 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.127 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.127 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.127 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.128 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.128 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.128 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.128 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.128 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.129 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.129 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.129 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.129 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.129 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.129 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.129 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.129 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.129 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.130 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.130 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.130 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "localpool", 2024-04-15T00:31:35.130 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.130 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.130 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.130 INFO:teuthology.orchestra.run.smithi031.stdout: "failure_domain": { 2024-04-15T00:31:35.130 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "failure_domain", 2024-04-15T00:31:35.131 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.131 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.131 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.131 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "host", 2024-04-15T00:31:35.131 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.131 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.131 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.131 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "failure domain for any created local pool", 2024-04-15T00:31:35.132 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-15T00:31:35.132 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.132 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.132 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.132 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.132 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.132 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.132 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.132 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.133 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.133 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.133 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.133 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.133 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.133 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.133 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.133 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.134 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.134 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.134 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.134 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.134 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.134 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.134 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.134 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.134 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.135 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.135 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.135 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.135 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.135 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.135 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.135 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.135 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.136 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.136 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.136 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.136 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.136 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.136 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.136 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.136 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.137 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.137 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.137 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.137 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.137 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.137 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.137 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.137 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.137 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.138 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.138 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.138 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.138 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.138 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.138 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.138 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.138 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.139 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.139 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.139 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.139 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.139 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.139 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.139 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.139 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.139 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.140 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.140 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.140 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.140 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.140 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.140 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.140 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": { 2024-04-15T00:31:35.140 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "min_size", 2024-04-15T00:31:35.141 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.141 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.141 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.141 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.141 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.141 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.141 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.141 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "default min_size for any created local pool", 2024-04-15T00:31:35.141 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-15T00:31:35.142 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.142 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.142 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.142 INFO:teuthology.orchestra.run.smithi031.stdout: "num_rep": { 2024-04-15T00:31:35.142 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "num_rep", 2024-04-15T00:31:35.142 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.142 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.142 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.143 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "3", 2024-04-15T00:31:35.143 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.143 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.143 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.143 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "default replica count for any created local pool", 2024-04-15T00:31:35.143 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.143 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.143 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.143 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.144 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": { 2024-04-15T00:31:35.144 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "pg_num", 2024-04-15T00:31:35.144 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.144 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.144 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.144 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "128", 2024-04-15T00:31:35.144 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.144 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.145 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.145 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "default pg_num for any created local pool", 2024-04-15T00:31:35.145 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.145 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.145 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.145 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.145 INFO:teuthology.orchestra.run.smithi031.stdout: "prefix": { 2024-04-15T00:31:35.145 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "prefix", 2024-04-15T00:31:35.145 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.146 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.146 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.146 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.146 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.146 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.146 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.146 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "name prefix for any created local pool", 2024-04-15T00:31:35.146 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.147 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.147 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.147 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.147 INFO:teuthology.orchestra.run.smithi031.stdout: "subtree": { 2024-04-15T00:31:35.147 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "subtree", 2024-04-15T00:31:35.147 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.147 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.147 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.147 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "rack", 2024-04-15T00:31:35.148 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.148 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.148 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.148 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-15T00:31:35.148 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-15T00:31:35.148 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.148 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.148 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.149 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.149 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.149 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.149 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mds_autoscaler", 2024-04-15T00:31:35.149 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.149 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.149 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.149 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.149 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.150 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.150 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.150 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.150 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.150 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.150 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.150 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.150 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.151 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.151 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.151 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.151 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.151 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.151 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.151 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.151 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.151 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.152 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.152 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.152 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.152 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.152 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.152 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.152 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.152 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.153 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.153 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.153 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.153 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.153 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.153 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.153 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.153 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.153 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.154 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.154 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.154 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.154 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.154 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.154 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.154 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.155 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.155 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.155 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.155 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.155 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.155 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.155 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.155 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.156 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.156 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.156 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.156 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.156 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.156 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.156 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.156 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.158 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.158 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.158 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.158 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.159 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.159 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.159 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.159 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.159 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.159 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.159 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.159 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.160 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.160 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.160 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mirroring", 2024-04-15T00:31:35.160 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.160 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.160 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.160 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.160 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.160 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.161 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.161 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.161 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.161 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.161 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.161 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.161 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.161 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.162 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.162 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.162 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.162 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.162 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.162 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.162 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.162 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.162 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.163 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.163 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.163 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.163 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.163 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.163 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.163 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.163 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.164 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.164 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.164 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.164 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.164 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.164 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.164 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.164 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.164 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.165 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.165 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.165 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.165 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.165 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.165 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.165 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.165 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.165 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.166 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.166 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.166 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.166 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.166 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.166 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.166 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.166 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.167 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.167 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.167 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.167 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.167 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.167 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.167 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.167 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.167 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.168 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.168 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.168 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.168 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.168 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.168 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.168 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.168 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.169 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.169 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.169 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "nfs", 2024-04-15T00:31:35.169 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.169 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.169 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.169 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.169 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.169 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.170 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.170 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.170 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.170 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.170 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.170 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.170 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.170 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.171 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.171 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.171 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.171 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.171 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.171 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.171 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.171 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.171 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.172 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.172 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.172 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.172 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.172 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.172 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.172 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.172 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.172 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.173 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.173 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.173 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.173 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.173 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.173 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.173 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.173 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.174 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.174 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.174 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.174 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.174 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.174 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.174 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.174 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.174 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.175 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.175 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.175 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.175 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.175 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.175 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.175 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.175 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.176 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.176 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.176 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.176 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.176 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.176 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.176 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.176 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.176 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.177 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.177 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.177 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.177 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.177 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.177 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.177 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.177 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.177 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.178 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.178 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "orchestrator", 2024-04-15T00:31:35.178 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.178 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.178 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.178 INFO:teuthology.orchestra.run.smithi031.stdout: "fail_fs": { 2024-04-15T00:31:35.178 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "fail_fs", 2024-04-15T00:31:35.178 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.179 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.179 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.179 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.179 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.179 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.179 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.179 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-15T00:31:35.179 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.179 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.180 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.180 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.180 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.180 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.180 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.180 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.180 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.180 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.180 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.181 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.181 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.181 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.181 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.181 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.181 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.181 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.181 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.182 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.182 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.182 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.182 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.182 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.182 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.182 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.182 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.183 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.183 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.183 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.183 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.183 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.183 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.183 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.183 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.183 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.184 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.184 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.184 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.184 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.184 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.184 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.184 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.184 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.185 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.185 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.185 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.185 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.185 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.185 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.185 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.185 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.185 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.186 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.186 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.186 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.186 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.186 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.186 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.186 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.186 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.186 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.187 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.187 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.187 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.187 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.187 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.187 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.187 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.187 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.188 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.188 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.188 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.188 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.188 INFO:teuthology.orchestra.run.smithi031.stdout: "orchestrator": { 2024-04-15T00:31:35.188 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "orchestrator", 2024-04-15T00:31:35.188 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.188 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.188 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.189 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.189 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.189 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.189 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.189 INFO:teuthology.orchestra.run.smithi031.stdout: "cephadm", 2024-04-15T00:31:35.189 INFO:teuthology.orchestra.run.smithi031.stdout: "rook", 2024-04-15T00:31:35.189 INFO:teuthology.orchestra.run.smithi031.stdout: "test_orchestrator" 2024-04-15T00:31:35.189 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.190 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Orchestrator backend", 2024-04-15T00:31:35.190 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.190 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.190 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.190 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.190 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.190 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.190 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.190 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "osd_perf_query", 2024-04-15T00:31:35.191 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.191 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.191 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.191 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.191 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.191 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.191 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.191 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.191 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.192 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.192 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.192 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.192 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.192 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.192 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.192 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.192 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.193 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.193 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.193 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.193 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.193 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.193 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.193 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.193 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.193 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.194 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.194 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.194 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.194 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.194 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.194 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.194 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.194 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.194 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.195 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.195 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.195 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.195 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.195 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.195 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.195 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.195 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.196 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.196 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.196 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.196 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.196 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.196 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.196 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.196 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.197 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.197 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.197 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.197 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.197 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.197 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.197 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.197 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.197 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.198 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.198 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.198 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.198 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.198 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.198 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.198 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.198 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.198 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.199 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.199 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.199 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.199 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.199 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.199 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.199 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.199 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "osd_support", 2024-04-15T00:31:35.200 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.200 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.200 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.200 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.200 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.200 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.200 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.200 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.200 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.201 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.201 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.201 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.201 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.201 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.201 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.201 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.201 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.201 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.202 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.202 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.202 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.202 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.202 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.202 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.202 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.202 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.203 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.203 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.203 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.203 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.203 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.203 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.203 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.203 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.203 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.204 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.204 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.204 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.204 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.204 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.204 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.204 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.204 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.205 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.205 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.205 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.205 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.205 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.205 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.205 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.205 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.206 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.206 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.206 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.206 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.206 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.206 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.206 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.206 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.206 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.207 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.207 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.207 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.207 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.207 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.207 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.207 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.207 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.207 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.208 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.208 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.208 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.208 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.208 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.208 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.208 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.208 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "pg_autoscaler", 2024-04-15T00:31:35.209 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.209 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.209 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.209 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.209 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.209 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.209 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.209 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.210 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.211 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.211 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.211 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.211 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.211 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.211 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.211 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.211 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.212 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.212 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.212 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.212 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.212 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.212 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.212 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.212 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.213 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.213 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.213 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.213 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.213 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.213 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.213 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.213 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.213 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.214 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.214 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.214 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.214 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.214 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.214 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.214 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.214 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.215 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.215 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.215 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.215 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.215 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.215 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.215 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.215 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.215 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.216 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.216 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.216 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.216 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.216 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.216 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.216 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.216 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.217 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.217 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.217 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.217 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.217 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.217 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.217 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.217 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.217 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.218 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.218 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.218 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.218 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.218 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.218 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-04-15T00:31:35.218 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-04-15T00:31:35.218 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:35.219 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.219 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.219 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-04-15T00:31:35.219 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.219 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.219 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.219 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.219 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.219 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.220 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.220 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.220 INFO:teuthology.orchestra.run.smithi031.stdout: "threshold": { 2024-04-15T00:31:35.220 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "threshold", 2024-04-15T00:31:35.220 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-04-15T00:31:35.220 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.220 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.220 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "3.0", 2024-04-15T00:31:35.221 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1.0", 2024-04-15T00:31:35.221 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.221 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.221 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "scaling threshold", 2024-04-15T00:31:35.221 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-15T00:31:35.221 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.221 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.221 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.221 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.222 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.222 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.222 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "progress", 2024-04-15T00:31:35.222 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.222 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.222 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.222 INFO:teuthology.orchestra.run.smithi031.stdout: "allow_pg_recovery_event": { 2024-04-15T00:31:35.222 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "allow_pg_recovery_event", 2024-04-15T00:31:35.223 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.223 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.223 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.223 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.223 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.223 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.223 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.223 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-15T00:31:35.223 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.224 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.224 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.225 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.225 INFO:teuthology.orchestra.run.smithi031.stdout: "enabled": { 2024-04-15T00:31:35.225 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "enabled", 2024-04-15T00:31:35.226 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.226 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.226 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.226 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.226 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.226 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.226 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.226 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.227 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.227 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.227 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.227 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.227 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.227 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.227 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.227 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.227 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.228 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.228 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.228 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.228 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.228 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.228 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.228 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.228 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.229 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.229 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.229 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.229 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.229 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.229 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.229 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.229 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.229 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.230 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.230 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.230 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.230 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.230 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.230 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.230 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.231 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.231 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.231 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.231 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.231 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.231 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.231 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.231 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.231 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.232 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.232 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.232 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.232 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.232 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.232 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.232 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.232 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.233 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.233 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.233 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.233 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.233 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.233 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.233 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.233 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.233 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.234 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.234 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.234 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.234 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.234 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.234 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.234 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.235 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.235 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.235 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.235 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.235 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.235 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.235 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.235 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.237 INFO:teuthology.orchestra.run.smithi031.stdout: "max_completed_events": { 2024-04-15T00:31:35.238 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_completed_events", 2024-04-15T00:31:35.239 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.239 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.239 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.239 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "50", 2024-04-15T00:31:35.239 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.239 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.239 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.239 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "number of past completed events to remember", 2024-04-15T00:31:35.240 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.240 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.240 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.240 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.240 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-04-15T00:31:35.240 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-04-15T00:31:35.240 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:35.240 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.240 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.241 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5", 2024-04-15T00:31:35.241 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.241 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.241 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.241 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how long the module is going to sleep", 2024-04-15T00:31:35.241 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.241 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.241 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.242 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.242 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.242 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.242 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.242 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "prometheus", 2024-04-15T00:31:35.242 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.242 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.242 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.242 INFO:teuthology.orchestra.run.smithi031.stdout: "cache": { 2024-04-15T00:31:35.243 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cache", 2024-04-15T00:31:35.243 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.243 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.243 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.243 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.243 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.243 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.243 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.244 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.244 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.244 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.244 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.244 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.244 INFO:teuthology.orchestra.run.smithi031.stdout: "exclude_perf_counters": { 2024-04-15T00:31:35.244 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "exclude_perf_counters", 2024-04-15T00:31:35.244 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.244 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.245 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.245 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.245 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.245 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.245 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.245 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-15T00:31:35.245 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-15T00:31:35.245 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.246 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.246 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.246 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.246 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.246 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.246 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.246 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.246 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.246 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.247 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.247 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.247 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.247 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.247 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.247 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.247 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.247 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.247 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.248 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.248 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.248 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.248 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.248 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.248 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.248 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.248 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.249 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.249 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.249 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.249 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.249 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.249 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.249 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.249 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.249 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.250 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.250 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.250 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.250 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.250 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.250 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.250 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.250 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.251 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.251 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.251 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.251 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.251 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.251 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.251 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.251 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.251 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.252 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.252 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.252 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.252 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.252 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.252 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.252 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.252 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.252 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.253 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.253 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.253 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.253 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.253 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.253 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.253 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.253 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.254 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.254 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.254 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.254 INFO:teuthology.orchestra.run.smithi031.stdout: "rbd_stats_pools": { 2024-04-15T00:31:35.254 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rbd_stats_pools", 2024-04-15T00:31:35.254 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.254 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.254 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.255 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.255 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.255 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.255 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.255 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.255 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.255 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.255 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.256 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.256 INFO:teuthology.orchestra.run.smithi031.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-15T00:31:35.256 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-15T00:31:35.256 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.256 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.256 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.256 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "300", 2024-04-15T00:31:35.256 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.256 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.257 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.257 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.257 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.257 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.257 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.257 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.257 INFO:teuthology.orchestra.run.smithi031.stdout: "scrape_interval": { 2024-04-15T00:31:35.257 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "scrape_interval", 2024-04-15T00:31:35.258 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-04-15T00:31:35.258 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.258 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.258 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "15.0", 2024-04-15T00:31:35.258 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.258 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.258 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.258 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.259 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.259 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.259 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.259 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.259 INFO:teuthology.orchestra.run.smithi031.stdout: "server_addr": { 2024-04-15T00:31:35.259 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_addr", 2024-04-15T00:31:35.259 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.259 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.259 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.260 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "::", 2024-04-15T00:31:35.260 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.260 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.260 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.260 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-15T00:31:35.260 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.260 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.260 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.260 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.261 INFO:teuthology.orchestra.run.smithi031.stdout: "server_port": { 2024-04-15T00:31:35.261 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_port", 2024-04-15T00:31:35.261 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.261 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.261 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.261 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "9283", 2024-04-15T00:31:35.261 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.261 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.262 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.262 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-15T00:31:35.262 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.262 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.262 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.262 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.262 INFO:teuthology.orchestra.run.smithi031.stdout: "stale_cache_strategy": { 2024-04-15T00:31:35.262 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "stale_cache_strategy", 2024-04-15T00:31:35.263 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.263 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.263 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.263 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "log", 2024-04-15T00:31:35.263 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.263 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.263 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.264 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.264 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.264 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.264 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.264 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.264 INFO:teuthology.orchestra.run.smithi031.stdout: "standby_behaviour": { 2024-04-15T00:31:35.264 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "standby_behaviour", 2024-04-15T00:31:35.264 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.264 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.265 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.265 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "default", 2024-04-15T00:31:35.265 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.265 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.265 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.265 INFO:teuthology.orchestra.run.smithi031.stdout: "default", 2024-04-15T00:31:35.265 INFO:teuthology.orchestra.run.smithi031.stdout: "error" 2024-04-15T00:31:35.265 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.266 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.266 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.266 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.266 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.266 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.266 INFO:teuthology.orchestra.run.smithi031.stdout: "standby_error_status_code": { 2024-04-15T00:31:35.266 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "standby_error_status_code", 2024-04-15T00:31:35.266 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.266 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.267 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.267 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "500", 2024-04-15T00:31:35.267 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "400", 2024-04-15T00:31:35.267 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "599", 2024-04-15T00:31:35.267 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.267 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.267 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.267 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.268 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.268 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.268 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.268 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.268 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.268 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rbd_support", 2024-04-15T00:31:35.268 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.268 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.268 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.269 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.269 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.269 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.269 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.269 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.269 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.269 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.269 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.270 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.270 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.270 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.270 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.270 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.270 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.270 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.270 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.270 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.271 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.271 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.271 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.271 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.271 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.271 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.271 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.272 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.272 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.272 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.272 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.272 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.272 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.272 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.272 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.272 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.273 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.273 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.273 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.273 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.273 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.273 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.273 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.274 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.274 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.274 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.274 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.274 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.274 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.274 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.274 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.274 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.275 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.275 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.275 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.275 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.275 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.275 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.275 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.275 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.276 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.276 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.276 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.276 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.276 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.276 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.276 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.276 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.276 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.277 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.277 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.277 INFO:teuthology.orchestra.run.smithi031.stdout: "max_concurrent_snap_create": { 2024-04-15T00:31:35.277 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_concurrent_snap_create", 2024-04-15T00:31:35.277 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.277 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.277 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.277 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-04-15T00:31:35.278 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.278 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.278 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.278 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.278 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.278 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.278 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.278 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.279 INFO:teuthology.orchestra.run.smithi031.stdout: "mirror_snapshot_schedule": { 2024-04-15T00:31:35.279 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mirror_snapshot_schedule", 2024-04-15T00:31:35.279 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.279 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.279 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.279 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.279 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.279 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.280 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.280 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.280 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.280 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.280 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.280 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.280 INFO:teuthology.orchestra.run.smithi031.stdout: "trash_purge_schedule": { 2024-04-15T00:31:35.280 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "trash_purge_schedule", 2024-04-15T00:31:35.280 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.281 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.281 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.281 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.281 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.281 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.281 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.281 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.281 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.281 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.282 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.282 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.282 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.282 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.282 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.282 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "restful", 2024-04-15T00:31:35.282 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.282 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.283 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.283 INFO:teuthology.orchestra.run.smithi031.stdout: "enable_auth": { 2024-04-15T00:31:35.283 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "enable_auth", 2024-04-15T00:31:35.283 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.283 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.283 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.283 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.283 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.283 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.284 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.284 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.284 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.284 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.284 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.284 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.284 INFO:teuthology.orchestra.run.smithi031.stdout: "key_file": { 2024-04-15T00:31:35.284 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "key_file", 2024-04-15T00:31:35.284 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.285 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.285 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.285 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.285 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.285 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.285 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.285 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.285 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.286 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.286 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.286 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.286 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.286 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.286 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.286 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.286 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.286 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.287 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.287 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.287 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.287 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.287 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.287 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.287 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.287 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.288 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.288 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.288 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.288 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.288 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.288 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.288 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.288 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.288 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.289 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.289 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.289 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.289 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.289 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.289 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.289 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.289 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.289 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.290 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.290 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.290 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.290 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.290 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.290 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.290 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.290 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.291 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.291 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.291 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.291 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.291 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.291 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.291 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.291 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.291 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.292 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.292 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.292 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.292 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.292 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.292 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.292 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.292 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.292 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.293 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.293 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.293 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.293 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.293 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.293 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.293 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.293 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.294 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.294 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.294 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.294 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.294 INFO:teuthology.orchestra.run.smithi031.stdout: "server_addr": { 2024-04-15T00:31:35.294 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_addr", 2024-04-15T00:31:35.294 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.294 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.295 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.295 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.295 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.295 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.295 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.295 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.295 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.295 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.295 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.296 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.296 INFO:teuthology.orchestra.run.smithi031.stdout: "server_port": { 2024-04-15T00:31:35.296 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_port", 2024-04-15T00:31:35.296 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.296 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.296 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.296 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.296 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.296 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.297 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.297 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.297 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.297 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.297 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.297 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.297 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.297 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.297 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.298 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rgw", 2024-04-15T00:31:35.298 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.298 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.298 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.298 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.298 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.298 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.298 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.299 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.299 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.299 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.299 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.299 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.299 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.299 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.299 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.300 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.300 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.300 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.300 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.300 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.300 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.300 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.301 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.301 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.301 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.301 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.301 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.301 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.301 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.301 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.302 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.302 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.302 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.302 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.302 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.302 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.302 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.302 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.303 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.303 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.303 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.303 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.303 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.303 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.303 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.303 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.303 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.304 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.304 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.304 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.304 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.304 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.304 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.304 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.304 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.305 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.305 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.305 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.305 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.305 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.305 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.305 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.305 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.305 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.306 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.306 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.306 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.306 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.306 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.306 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.306 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.306 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.306 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.307 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.307 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.307 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.307 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rook", 2024-04-15T00:31:35.307 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.307 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.307 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.307 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.308 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.308 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.308 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.308 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.308 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.308 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.308 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.308 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.308 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.309 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.309 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.309 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.309 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.309 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.309 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.309 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.309 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.310 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.310 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.310 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.310 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.310 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.310 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.310 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.310 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.310 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.311 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.311 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.311 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.311 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.311 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.311 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.311 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.311 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.312 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.312 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.312 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.312 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.312 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.312 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.312 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.312 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.312 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.313 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.313 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.313 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.313 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.313 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.313 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.313 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.313 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.313 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.314 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.314 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.314 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.314 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.314 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.314 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.314 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.314 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.315 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.315 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.315 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.315 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.315 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.315 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.315 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.315 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.315 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.316 INFO:teuthology.orchestra.run.smithi031.stdout: "storage_class": { 2024-04-15T00:31:35.316 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "storage_class", 2024-04-15T00:31:35.316 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.316 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.316 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.316 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "local", 2024-04-15T00:31:35.316 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.316 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.317 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.317 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-15T00:31:35.317 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.317 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.317 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.317 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.317 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.317 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.317 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.318 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "selftest", 2024-04-15T00:31:35.318 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.318 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.318 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.318 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.318 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.318 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.318 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.318 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.319 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.319 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.319 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.319 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.319 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.319 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.319 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.319 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.320 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.320 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.320 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.320 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.320 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.320 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.320 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.320 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.320 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.321 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.321 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.321 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.321 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.321 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.321 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.321 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.321 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.321 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.322 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.322 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.322 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.322 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.322 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.322 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.322 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.322 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.323 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.323 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.323 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.323 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.323 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.323 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.323 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.323 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.324 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.324 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.324 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.324 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.324 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.324 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.324 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.324 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.324 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.325 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.325 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.325 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.325 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.325 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.325 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.325 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.325 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.326 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.326 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.326 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.326 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.326 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.326 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.326 INFO:teuthology.orchestra.run.smithi031.stdout: "roption1": { 2024-04-15T00:31:35.326 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "roption1", 2024-04-15T00:31:35.326 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.327 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.327 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.327 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.327 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.327 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.327 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.327 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.327 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.328 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.328 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.328 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.328 INFO:teuthology.orchestra.run.smithi031.stdout: "roption2": { 2024-04-15T00:31:35.328 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "roption2", 2024-04-15T00:31:35.328 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.328 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.328 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.328 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "xyz", 2024-04-15T00:31:35.329 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.329 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.329 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.329 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.329 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.329 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.329 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.329 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.329 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption1": { 2024-04-15T00:31:35.330 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption1", 2024-04-15T00:31:35.330 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.330 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.330 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.330 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.330 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.330 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.330 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.331 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.331 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.331 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.331 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.331 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.331 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption2": { 2024-04-15T00:31:35.331 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption2", 2024-04-15T00:31:35.331 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.331 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.332 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.332 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.332 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.332 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.332 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.332 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.332 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.332 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.333 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.333 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.333 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption3": { 2024-04-15T00:31:35.333 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption3", 2024-04-15T00:31:35.333 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-04-15T00:31:35.333 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.333 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.333 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.333 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.334 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.334 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.334 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.334 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.334 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.334 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.334 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.334 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption4": { 2024-04-15T00:31:35.335 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption4", 2024-04-15T00:31:35.335 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.335 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.335 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.335 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.335 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.335 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.335 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.335 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.336 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.336 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.336 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.336 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.336 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption5": { 2024-04-15T00:31:35.336 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption5", 2024-04-15T00:31:35.336 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.336 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.337 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.337 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.337 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.337 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.337 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.337 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.337 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.337 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.337 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.338 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.338 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption6": { 2024-04-15T00:31:35.338 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption6", 2024-04-15T00:31:35.338 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.338 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.338 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.338 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.338 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.339 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.339 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.339 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.339 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.339 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.339 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.339 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.339 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption7": { 2024-04-15T00:31:35.339 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption7", 2024-04-15T00:31:35.340 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.340 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.340 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.340 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.340 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1", 2024-04-15T00:31:35.340 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "42", 2024-04-15T00:31:35.340 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.340 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.340 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.341 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.341 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.341 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.341 INFO:teuthology.orchestra.run.smithi031.stdout: "testkey": { 2024-04-15T00:31:35.341 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "testkey", 2024-04-15T00:31:35.341 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.341 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.341 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.342 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.342 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.342 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.342 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.342 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.342 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.342 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.342 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.342 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.343 INFO:teuthology.orchestra.run.smithi031.stdout: "testlkey": { 2024-04-15T00:31:35.343 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "testlkey", 2024-04-15T00:31:35.343 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.343 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.343 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.343 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.343 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.343 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.344 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.344 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.344 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.344 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.344 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.344 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.344 INFO:teuthology.orchestra.run.smithi031.stdout: "testnewline": { 2024-04-15T00:31:35.344 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "testnewline", 2024-04-15T00:31:35.344 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.345 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.345 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.345 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.345 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.345 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.345 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.345 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.345 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.346 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.346 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.346 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.346 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.346 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.346 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.346 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "snap_schedule", 2024-04-15T00:31:35.346 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.347 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.347 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.347 INFO:teuthology.orchestra.run.smithi031.stdout: "allow_m_granularity": { 2024-04-15T00:31:35.347 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "allow_m_granularity", 2024-04-15T00:31:35.347 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.347 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.347 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.347 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.347 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.348 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.348 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.348 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "allow minute scheduled snapshots", 2024-04-15T00:31:35.348 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.348 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.348 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.348 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.348 INFO:teuthology.orchestra.run.smithi031.stdout: "dump_on_update": { 2024-04-15T00:31:35.348 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "dump_on_update", 2024-04-15T00:31:35.349 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.349 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.349 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.349 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.349 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.349 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.349 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.349 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "dump database to debug log on update", 2024-04-15T00:31:35.350 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.350 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.350 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.350 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.350 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.350 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.350 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.350 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.350 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.351 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.351 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.351 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.351 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.351 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.351 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.351 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.351 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.351 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.352 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.352 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.352 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.352 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.352 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.352 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.352 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.352 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.353 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.353 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.353 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.353 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.353 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.353 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.353 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.353 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.353 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.354 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.354 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.354 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.354 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.354 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.354 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.354 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.354 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.355 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.355 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.355 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.355 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.355 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.355 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.355 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.355 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.355 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.356 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.356 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.356 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.356 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.356 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.356 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.356 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.356 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.356 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.357 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.357 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.357 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.357 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.357 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.357 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.357 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.357 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.358 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.358 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.358 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.358 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.358 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.358 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.358 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.358 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.358 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "stats", 2024-04-15T00:31:35.359 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.359 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.359 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.359 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.359 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.359 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.359 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.359 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.359 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.360 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.360 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.360 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.360 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.360 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.360 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.360 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.360 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.361 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.361 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.361 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.361 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.361 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.361 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.361 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.361 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.361 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.362 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.362 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.362 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.362 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.362 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.362 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.362 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.362 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.363 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.363 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.363 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.363 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.363 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.363 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.363 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.363 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.363 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.364 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.364 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.364 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.364 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.364 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.364 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.364 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.364 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.364 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.365 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.365 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.365 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.365 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.365 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.365 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.365 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.365 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.365 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.366 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.366 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.366 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.366 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.366 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.366 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.366 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.366 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.367 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.367 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.367 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.367 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.367 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.367 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.367 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.367 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "status", 2024-04-15T00:31:35.367 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.368 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.368 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.368 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.368 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.368 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.368 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.368 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.368 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.369 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.369 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.369 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.369 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.369 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.369 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.369 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.369 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.370 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.370 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.370 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.370 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.370 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.370 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.370 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.370 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.370 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.371 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.371 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.371 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.371 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.371 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.371 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.371 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.371 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.372 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.372 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.372 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.372 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.372 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.372 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.372 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.372 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.372 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.373 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.373 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.373 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.373 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.373 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.373 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.373 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.373 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.373 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.374 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.374 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.374 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.374 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.374 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.374 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.374 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.374 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.375 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.375 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.375 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.375 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.375 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.375 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.375 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.375 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.375 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.376 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.376 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.376 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.376 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.376 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.376 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.376 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.376 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "telegraf", 2024-04-15T00:31:35.376 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.377 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.377 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.377 INFO:teuthology.orchestra.run.smithi031.stdout: "address": { 2024-04-15T00:31:35.377 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "address", 2024-04-15T00:31:35.377 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.377 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.377 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.377 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-15T00:31:35.377 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.378 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.378 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.378 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.378 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.378 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.378 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.378 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.378 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-04-15T00:31:35.379 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-04-15T00:31:35.379 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:35.379 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.379 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.379 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "15", 2024-04-15T00:31:35.379 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.379 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.379 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.379 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.380 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.380 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.380 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.380 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.380 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.380 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.380 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.380 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.381 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.381 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.381 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.381 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.381 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.381 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.381 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.381 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.381 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.382 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.382 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.382 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.382 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.382 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.382 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.382 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.382 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.383 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.383 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.383 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.383 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.383 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.383 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.383 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.383 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.383 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.384 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.384 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.384 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.384 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.384 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.384 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.384 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.384 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.385 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.385 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.385 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.385 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.385 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.385 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.385 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.385 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.385 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.386 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.386 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.386 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.386 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.386 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.388 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.388 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.388 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.388 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.388 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.388 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.388 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.389 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.389 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.389 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.389 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.389 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.389 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.389 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.389 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.389 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.390 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.390 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.390 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.390 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.390 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.390 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "telemetry", 2024-04-15T00:31:35.390 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.390 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.391 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.391 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_basic": { 2024-04-15T00:31:35.391 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_basic", 2024-04-15T00:31:35.391 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.391 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.391 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.391 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.391 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.392 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.392 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.392 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-15T00:31:35.392 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.392 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.392 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.392 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.392 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_crash": { 2024-04-15T00:31:35.392 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_crash", 2024-04-15T00:31:35.393 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.393 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.393 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.393 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.393 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.393 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.393 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.393 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-15T00:31:35.394 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.394 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.394 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.394 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.394 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_device": { 2024-04-15T00:31:35.394 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_device", 2024-04-15T00:31:35.394 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.394 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.395 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.395 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.395 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.395 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.395 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.395 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-15T00:31:35.395 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.395 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.395 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.396 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.396 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_ident": { 2024-04-15T00:31:35.396 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_ident", 2024-04-15T00:31:35.396 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.396 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.396 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.396 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.396 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.397 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.397 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.397 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-15T00:31:35.397 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.397 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.397 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.397 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.397 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_perf": { 2024-04-15T00:31:35.397 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_perf", 2024-04-15T00:31:35.398 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.398 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.398 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.398 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.398 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.398 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.398 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.398 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-15T00:31:35.399 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.399 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.399 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.399 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.399 INFO:teuthology.orchestra.run.smithi031.stdout: "contact": { 2024-04-15T00:31:35.399 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "contact", 2024-04-15T00:31:35.399 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.399 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.399 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.400 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.400 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.400 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.400 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.400 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.400 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.400 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.400 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.400 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.401 INFO:teuthology.orchestra.run.smithi031.stdout: "description": { 2024-04-15T00:31:35.401 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "description", 2024-04-15T00:31:35.401 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.401 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.401 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.401 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.401 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.401 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.402 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.402 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.402 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.402 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.402 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.402 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.402 INFO:teuthology.orchestra.run.smithi031.stdout: "device_url": { 2024-04-15T00:31:35.402 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "device_url", 2024-04-15T00:31:35.402 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.403 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.403 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.403 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-15T00:31:35.403 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.403 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.403 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.403 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.403 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.404 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.404 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.404 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.404 INFO:teuthology.orchestra.run.smithi031.stdout: "enabled": { 2024-04-15T00:31:35.404 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "enabled", 2024-04-15T00:31:35.404 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.404 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.404 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.404 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.405 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.405 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.405 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.405 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.405 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.405 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.405 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.405 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.405 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-04-15T00:31:35.406 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-04-15T00:31:35.406 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.406 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.406 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.406 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "24", 2024-04-15T00:31:35.406 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "8", 2024-04-15T00:31:35.406 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.406 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.407 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.407 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.407 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.407 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.407 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.407 INFO:teuthology.orchestra.run.smithi031.stdout: "last_opt_revision": { 2024-04-15T00:31:35.407 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "last_opt_revision", 2024-04-15T00:31:35.407 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.407 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.408 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.408 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "1", 2024-04-15T00:31:35.408 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.408 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.408 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.408 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.408 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.408 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.409 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.409 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.409 INFO:teuthology.orchestra.run.smithi031.stdout: "leaderboard": { 2024-04-15T00:31:35.409 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "leaderboard", 2024-04-15T00:31:35.409 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.409 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.409 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.409 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.409 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.410 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.410 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.410 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.410 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.410 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.410 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.410 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.410 INFO:teuthology.orchestra.run.smithi031.stdout: "leaderboard_description": { 2024-04-15T00:31:35.410 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "leaderboard_description", 2024-04-15T00:31:35.411 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.411 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.411 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.411 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.411 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.411 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.411 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.411 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.412 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.412 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.412 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.412 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.412 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.412 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.412 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.412 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.412 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.413 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.413 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.413 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.413 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.413 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.413 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.413 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.413 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.413 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.414 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.414 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.414 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.414 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.414 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.414 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.414 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.414 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.415 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.415 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.415 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.415 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.415 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.415 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.415 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.415 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.416 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.416 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.416 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.416 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.416 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.416 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.416 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.416 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.416 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.417 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.417 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.417 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.417 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.417 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.417 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.417 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.417 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.418 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.418 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.418 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.418 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.418 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.418 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.418 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.418 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.419 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.419 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.419 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.419 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.419 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.419 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.419 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.419 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.419 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.420 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.420 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.420 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.420 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.420 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.420 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.420 INFO:teuthology.orchestra.run.smithi031.stdout: "organization": { 2024-04-15T00:31:35.420 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "organization", 2024-04-15T00:31:35.421 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.421 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.421 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.421 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.421 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.421 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.421 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.421 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.421 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.422 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.422 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.422 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.422 INFO:teuthology.orchestra.run.smithi031.stdout: "proxy": { 2024-04-15T00:31:35.422 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "proxy", 2024-04-15T00:31:35.422 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.422 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.422 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.422 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.423 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.423 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.423 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.423 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.423 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.423 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.423 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.423 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.424 INFO:teuthology.orchestra.run.smithi031.stdout: "url": { 2024-04-15T00:31:35.424 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "url", 2024-04-15T00:31:35.424 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.424 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.424 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.424 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-15T00:31:35.424 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.424 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.424 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.425 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.425 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.425 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.425 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.425 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.425 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.425 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.425 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.425 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "test_orchestrator", 2024-04-15T00:31:35.426 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.426 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.426 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.426 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.426 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.426 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.426 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.426 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.427 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.427 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.427 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.427 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.427 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.427 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.429 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.429 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.430 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.430 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.430 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.430 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.430 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.430 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.430 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.430 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.430 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.431 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.431 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.431 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.431 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.431 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.431 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.431 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.431 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.432 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.432 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.432 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.432 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.432 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.432 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.432 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.432 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.432 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.433 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.433 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.433 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.433 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.433 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.433 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.433 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.433 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.434 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.434 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.434 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.434 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.434 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.434 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.434 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.434 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.434 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.435 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.435 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.435 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.435 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.435 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.435 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.435 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.435 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.436 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.436 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.436 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.436 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.436 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.436 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.436 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.436 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.437 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.437 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "volumes", 2024-04-15T00:31:35.437 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.437 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.437 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.437 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.437 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.437 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.437 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.438 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.438 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.438 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.438 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.438 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.438 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.438 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.438 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.439 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.439 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.439 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.439 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.439 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.439 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.439 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.439 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.440 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.440 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.440 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.440 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.440 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.440 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.440 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.440 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.440 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.441 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.441 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.441 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.441 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.441 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.441 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.441 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.441 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.442 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.442 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.442 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.442 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.442 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.442 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.442 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.442 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.442 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.443 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.443 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.443 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.443 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.443 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.443 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.443 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.443 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.444 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.444 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.444 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.444 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.444 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.444 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.444 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.444 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.444 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.445 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.445 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.445 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.445 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.445 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.445 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.445 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.445 INFO:teuthology.orchestra.run.smithi031.stdout: "max_concurrent_clones": { 2024-04-15T00:31:35.445 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_concurrent_clones", 2024-04-15T00:31:35.446 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.446 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.446 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.446 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "4", 2024-04-15T00:31:35.446 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.446 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.446 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.446 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-15T00:31:35.447 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.447 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.447 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.447 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.447 INFO:teuthology.orchestra.run.smithi031.stdout: "periodic_async_work": { 2024-04-15T00:31:35.447 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "periodic_async_work", 2024-04-15T00:31:35.447 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.447 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.448 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.448 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.448 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.448 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.448 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.448 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Periodically check for async work", 2024-04-15T00:31:35.448 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.448 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.448 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.449 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.449 INFO:teuthology.orchestra.run.smithi031.stdout: "snapshot_clone_delay": { 2024-04-15T00:31:35.449 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "snapshot_clone_delay", 2024-04-15T00:31:35.449 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.449 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.449 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.449 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-04-15T00:31:35.449 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.449 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.450 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.450 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-15T00:31:35.450 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.450 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.450 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.450 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.450 INFO:teuthology.orchestra.run.smithi031.stdout: "snapshot_clone_no_wait": { 2024-04-15T00:31:35.450 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "snapshot_clone_no_wait", 2024-04-15T00:31:35.451 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.451 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.451 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.451 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.451 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.451 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.451 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.451 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-15T00:31:35.451 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.452 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.452 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.452 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.452 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.452 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.452 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.452 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "zabbix", 2024-04-15T00:31:35.452 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.453 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.453 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.453 INFO:teuthology.orchestra.run.smithi031.stdout: "discovery_interval": { 2024-04-15T00:31:35.453 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "discovery_interval", 2024-04-15T00:31:35.453 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-04-15T00:31:35.453 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.453 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.453 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "100", 2024-04-15T00:31:35.453 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.454 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.454 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.454 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.454 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.454 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.454 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.454 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.454 INFO:teuthology.orchestra.run.smithi031.stdout: "identifier": { 2024-04-15T00:31:35.455 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "identifier", 2024-04-15T00:31:35.455 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.455 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.455 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.455 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.455 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.455 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.455 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.455 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.456 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.456 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.456 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.456 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.456 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-04-15T00:31:35.456 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-04-15T00:31:35.456 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:35.456 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.457 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.457 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-04-15T00:31:35.457 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.457 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.457 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.457 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.457 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.457 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.457 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.458 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.458 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.458 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.458 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.458 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.458 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.458 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.458 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.459 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.459 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.459 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.459 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.459 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.459 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.459 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.459 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.459 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.460 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.460 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.460 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.460 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.460 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.460 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.460 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.460 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.460 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.461 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.461 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.461 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.461 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.461 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.461 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.461 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.461 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.462 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.462 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.462 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.462 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.462 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.462 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.462 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.462 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.463 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.463 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.463 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.463 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.463 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.463 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.463 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.463 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.464 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.464 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.464 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.464 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.464 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.464 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.464 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.464 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.464 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.465 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.465 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.465 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.465 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.465 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.465 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.465 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.465 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.466 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.466 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.466 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.466 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.466 INFO:teuthology.orchestra.run.smithi031.stdout: "zabbix_host": { 2024-04-15T00:31:35.466 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "zabbix_host", 2024-04-15T00:31:35.466 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.466 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.466 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.467 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.467 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.467 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.467 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.467 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.467 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.467 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.467 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.468 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.468 INFO:teuthology.orchestra.run.smithi031.stdout: "zabbix_port": { 2024-04-15T00:31:35.468 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "zabbix_port", 2024-04-15T00:31:35.468 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.468 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.468 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.468 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10051", 2024-04-15T00:31:35.468 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.468 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.469 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.469 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.469 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.469 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.469 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.469 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.469 INFO:teuthology.orchestra.run.smithi031.stdout: "zabbix_sender": { 2024-04-15T00:31:35.469 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "zabbix_sender", 2024-04-15T00:31:35.470 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.470 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.470 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.470 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-15T00:31:35.470 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.470 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.470 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.470 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.471 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.471 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.471 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.471 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.471 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.471 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.471 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-15T00:31:35.471 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.471 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.472 INFO:teuthology.orchestra.run.smithi031.stdout: "modules": [ 2024-04-15T00:31:35.472 INFO:teuthology.orchestra.run.smithi031.stdout: "iostat", 2024-04-15T00:31:35.472 INFO:teuthology.orchestra.run.smithi031.stdout: "nfs", 2024-04-15T00:31:35.472 INFO:teuthology.orchestra.run.smithi031.stdout: "restful" 2024-04-15T00:31:35.472 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.472 INFO:teuthology.orchestra.run.smithi031.stdout: "available_modules": [ 2024-04-15T00:31:35.472 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.472 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "alerts", 2024-04-15T00:31:35.473 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.473 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.473 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.473 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-04-15T00:31:35.473 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-04-15T00:31:35.473 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:35.473 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.473 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.473 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-04-15T00:31:35.474 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.474 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.474 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.474 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How frequently to reexamine health status", 2024-04-15T00:31:35.474 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.474 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.474 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.474 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.475 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.475 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.475 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.475 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.475 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.475 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.475 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.475 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.475 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.476 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.476 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.476 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.476 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.476 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.476 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.476 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.476 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.477 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.477 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.477 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.477 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.477 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.477 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.477 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.477 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.477 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.478 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.478 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.478 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.478 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.478 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.478 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.478 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.478 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.479 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.479 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.479 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.479 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.479 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.479 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.479 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.479 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.479 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.480 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.480 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.480 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.480 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.480 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.480 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.480 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.480 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.480 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.481 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.481 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.481 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.481 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.481 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.481 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.481 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.481 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.482 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.482 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.482 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.482 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.482 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.482 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.482 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.482 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.482 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.483 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.483 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_destination": { 2024-04-15T00:31:35.483 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_destination", 2024-04-15T00:31:35.483 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.483 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.483 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.483 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.483 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.484 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.484 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.484 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Email address to send alerts to", 2024-04-15T00:31:35.484 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.484 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.484 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.484 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.484 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_from_name": { 2024-04-15T00:31:35.484 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_from_name", 2024-04-15T00:31:35.485 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.485 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.485 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.485 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "Ceph", 2024-04-15T00:31:35.485 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.485 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.485 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.485 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Email From: name", 2024-04-15T00:31:35.485 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.486 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.486 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.486 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.486 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_host": { 2024-04-15T00:31:35.486 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_host", 2024-04-15T00:31:35.486 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.486 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.486 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.487 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.487 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.487 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.487 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.487 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "SMTP server", 2024-04-15T00:31:35.487 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.487 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.487 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.487 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.488 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_password": { 2024-04-15T00:31:35.488 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_password", 2024-04-15T00:31:35.488 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.488 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.488 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.488 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.488 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.488 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.489 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.489 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Password to authenticate with", 2024-04-15T00:31:35.489 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.489 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.489 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.489 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.489 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_port": { 2024-04-15T00:31:35.489 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_port", 2024-04-15T00:31:35.490 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.490 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.490 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.490 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "465", 2024-04-15T00:31:35.490 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.490 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.490 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.490 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "SMTP port", 2024-04-15T00:31:35.490 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.491 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.491 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.491 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.491 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_sender": { 2024-04-15T00:31:35.491 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_sender", 2024-04-15T00:31:35.491 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.491 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.491 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.492 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.492 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.492 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.492 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.492 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "SMTP envelope sender", 2024-04-15T00:31:35.492 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.492 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.492 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.492 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.493 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_ssl": { 2024-04-15T00:31:35.493 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_ssl", 2024-04-15T00:31:35.493 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.493 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.493 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.493 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.493 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.493 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.494 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.494 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-15T00:31:35.494 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.494 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.494 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.494 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.494 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_user": { 2024-04-15T00:31:35.494 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_user", 2024-04-15T00:31:35.494 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.495 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.495 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.495 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.495 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.495 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.495 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.495 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "User to authenticate as", 2024-04-15T00:31:35.495 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.496 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.496 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.496 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.496 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.496 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.496 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.496 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "balancer", 2024-04-15T00:31:35.496 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.496 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.497 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.497 INFO:teuthology.orchestra.run.smithi031.stdout: "active": { 2024-04-15T00:31:35.497 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "active", 2024-04-15T00:31:35.497 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.497 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.497 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.497 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.497 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.498 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.498 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.498 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "automatically balance PGs across cluster", 2024-04-15T00:31:35.498 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.498 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.498 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.498 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.498 INFO:teuthology.orchestra.run.smithi031.stdout: "begin_time": { 2024-04-15T00:31:35.498 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "begin_time", 2024-04-15T00:31:35.499 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.499 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.499 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.499 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0000", 2024-04-15T00:31:35.499 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.499 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.499 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.499 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "beginning time of day to automatically balance", 2024-04-15T00:31:35.500 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-15T00:31:35.500 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.500 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.500 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.500 INFO:teuthology.orchestra.run.smithi031.stdout: "begin_weekday": { 2024-04-15T00:31:35.500 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "begin_weekday", 2024-04-15T00:31:35.500 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-04-15T00:31:35.500 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.500 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.501 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-04-15T00:31:35.501 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "0", 2024-04-15T00:31:35.501 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "6", 2024-04-15T00:31:35.501 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.501 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-15T00:31:35.501 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-15T00:31:35.501 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.501 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.501 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.502 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_compat_max_iterations": { 2024-04-15T00:31:35.502 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crush_compat_max_iterations", 2024-04-15T00:31:35.502 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-04-15T00:31:35.502 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.502 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.502 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "25", 2024-04-15T00:31:35.502 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1", 2024-04-15T00:31:35.502 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "250", 2024-04-15T00:31:35.503 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.503 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-15T00:31:35.503 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.503 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.503 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.503 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.503 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_compat_metrics": { 2024-04-15T00:31:35.503 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crush_compat_metrics", 2024-04-15T00:31:35.504 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.504 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.504 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.504 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "pgs,objects,bytes", 2024-04-15T00:31:35.504 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.504 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.504 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.504 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-15T00:31:35.504 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-15T00:31:35.505 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.505 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.505 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.505 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_compat_step": { 2024-04-15T00:31:35.505 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crush_compat_step", 2024-04-15T00:31:35.505 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-04-15T00:31:35.505 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.505 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.505 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0.5", 2024-04-15T00:31:35.506 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "0.001", 2024-04-15T00:31:35.506 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "0.999", 2024-04-15T00:31:35.506 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.506 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "aggressiveness of optimization", 2024-04-15T00:31:35.506 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-15T00:31:35.506 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.506 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.506 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.507 INFO:teuthology.orchestra.run.smithi031.stdout: "end_time": { 2024-04-15T00:31:35.507 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "end_time", 2024-04-15T00:31:35.507 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.507 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.507 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.507 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "2359", 2024-04-15T00:31:35.507 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.507 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.507 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.508 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "ending time of day to automatically balance", 2024-04-15T00:31:35.508 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-15T00:31:35.508 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.508 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.508 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.508 INFO:teuthology.orchestra.run.smithi031.stdout: "end_weekday": { 2024-04-15T00:31:35.508 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "end_weekday", 2024-04-15T00:31:35.508 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-04-15T00:31:35.509 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.509 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.509 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-04-15T00:31:35.509 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "0", 2024-04-15T00:31:35.509 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "6", 2024-04-15T00:31:35.509 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.509 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-15T00:31:35.509 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-15T00:31:35.509 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.510 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.510 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.510 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.510 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.510 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.510 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.510 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.510 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.511 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.511 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.511 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.511 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.511 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.511 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.511 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.511 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.511 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.512 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.512 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.512 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.512 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.512 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.512 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.512 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.512 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.512 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.513 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.513 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.513 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.513 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.513 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.513 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.513 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.513 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.514 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.514 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.514 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.514 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.514 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.514 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.514 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.514 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.515 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.515 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.515 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.515 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.515 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.515 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.515 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.515 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.515 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.516 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.516 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.516 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.516 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.516 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.516 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.516 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.516 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.517 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.517 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.517 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.517 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.517 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.517 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.517 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.517 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.517 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.518 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.518 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.518 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.518 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.518 INFO:teuthology.orchestra.run.smithi031.stdout: "min_score": { 2024-04-15T00:31:35.518 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "min_score", 2024-04-15T00:31:35.518 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-04-15T00:31:35.518 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.518 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.519 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-04-15T00:31:35.519 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.519 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.519 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.519 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-15T00:31:35.519 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.519 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.519 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.520 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.520 INFO:teuthology.orchestra.run.smithi031.stdout: "mode": { 2024-04-15T00:31:35.520 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mode", 2024-04-15T00:31:35.520 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.520 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.520 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.520 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "upmap", 2024-04-15T00:31:35.520 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.520 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.521 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.521 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-compat", 2024-04-15T00:31:35.521 INFO:teuthology.orchestra.run.smithi031.stdout: "none", 2024-04-15T00:31:35.521 INFO:teuthology.orchestra.run.smithi031.stdout: "read", 2024-04-15T00:31:35.521 INFO:teuthology.orchestra.run.smithi031.stdout: "upmap", 2024-04-15T00:31:35.521 INFO:teuthology.orchestra.run.smithi031.stdout: "upmap-read" 2024-04-15T00:31:35.521 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.521 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Balancer mode", 2024-04-15T00:31:35.521 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.522 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.522 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.522 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.522 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_ids": { 2024-04-15T00:31:35.522 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "pool_ids", 2024-04-15T00:31:35.522 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.522 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.522 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.523 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.523 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.523 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.523 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.523 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-15T00:31:35.523 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.523 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.523 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.523 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.524 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-04-15T00:31:35.524 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-04-15T00:31:35.524 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:35.524 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.524 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.524 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-04-15T00:31:35.524 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.524 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.524 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.525 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-15T00:31:35.525 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.525 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.525 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.525 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.525 INFO:teuthology.orchestra.run.smithi031.stdout: "upmap_max_deviation": { 2024-04-15T00:31:35.525 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "upmap_max_deviation", 2024-04-15T00:31:35.525 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.526 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.526 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.526 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5", 2024-04-15T00:31:35.526 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1", 2024-04-15T00:31:35.526 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.526 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.526 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-15T00:31:35.526 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-15T00:31:35.526 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.527 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.527 INFO:teuthology.orchestra.run.smithi031.stdout: "upmap_max_optimizations": { 2024-04-15T00:31:35.527 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "upmap_max_optimizations", 2024-04-15T00:31:35.527 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-04-15T00:31:35.527 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.527 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.527 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-04-15T00:31:35.528 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.528 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.528 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.528 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-15T00:31:35.528 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.528 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.528 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.528 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.529 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.529 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.529 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.529 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cephadm", 2024-04-15T00:31:35.529 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.529 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.529 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.529 INFO:teuthology.orchestra.run.smithi031.stdout: "agent_down_multiplier": { 2024-04-15T00:31:35.529 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "agent_down_multiplier", 2024-04-15T00:31:35.530 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-04-15T00:31:35.530 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.530 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.530 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "3.0", 2024-04-15T00:31:35.530 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.530 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.530 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.530 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-15T00:31:35.530 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.531 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.531 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.531 INFO:teuthology.orchestra.run.smithi031.stdout: "agent_refresh_rate": { 2024-04-15T00:31:35.531 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "agent_refresh_rate", 2024-04-15T00:31:35.531 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:35.531 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.531 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.532 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "20", 2024-04-15T00:31:35.532 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.532 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.532 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.532 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-15T00:31:35.532 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.532 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.532 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.532 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.533 INFO:teuthology.orchestra.run.smithi031.stdout: "agent_starting_port": { 2024-04-15T00:31:35.533 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "agent_starting_port", 2024-04-15T00:31:35.533 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.533 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.533 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.533 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "4721", 2024-04-15T00:31:35.533 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.533 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.533 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.534 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-15T00:31:35.534 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.534 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.534 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.534 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.534 INFO:teuthology.orchestra.run.smithi031.stdout: "allow_ptrace": { 2024-04-15T00:31:35.534 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "allow_ptrace", 2024-04-15T00:31:35.534 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.535 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.535 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.535 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.535 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.535 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.535 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.535 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-15T00:31:35.535 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-15T00:31:35.535 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.536 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.536 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.536 INFO:teuthology.orchestra.run.smithi031.stdout: "autotune_interval": { 2024-04-15T00:31:35.536 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "autotune_interval", 2024-04-15T00:31:35.536 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:35.536 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.536 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.536 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-04-15T00:31:35.536 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.537 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.537 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.537 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-15T00:31:35.537 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.537 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.537 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.537 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.537 INFO:teuthology.orchestra.run.smithi031.stdout: "autotune_memory_target_ratio": { 2024-04-15T00:31:35.537 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "autotune_memory_target_ratio", 2024-04-15T00:31:35.538 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-04-15T00:31:35.538 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.538 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.538 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0.7", 2024-04-15T00:31:35.538 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.538 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.538 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.538 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-15T00:31:35.539 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.539 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.539 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.539 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.539 INFO:teuthology.orchestra.run.smithi031.stdout: "cephadm_log_destination": { 2024-04-15T00:31:35.539 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cephadm_log_destination", 2024-04-15T00:31:35.539 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.539 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.540 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.540 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.540 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.540 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.540 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.540 INFO:teuthology.orchestra.run.smithi031.stdout: "file", 2024-04-15T00:31:35.540 INFO:teuthology.orchestra.run.smithi031.stdout: "file,syslog", 2024-04-15T00:31:35.540 INFO:teuthology.orchestra.run.smithi031.stdout: "syslog" 2024-04-15T00:31:35.540 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.541 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-15T00:31:35.541 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.541 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.541 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.541 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.541 INFO:teuthology.orchestra.run.smithi031.stdout: "cgroups_split": { 2024-04-15T00:31:35.541 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cgroups_split", 2024-04-15T00:31:35.541 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.541 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.542 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.542 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.542 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.542 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.542 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.542 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-15T00:31:35.542 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.542 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.543 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.543 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.543 INFO:teuthology.orchestra.run.smithi031.stdout: "config_checks_enabled": { 2024-04-15T00:31:35.543 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "config_checks_enabled", 2024-04-15T00:31:35.543 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.543 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.543 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.543 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.544 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.544 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.544 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.544 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-15T00:31:35.544 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.544 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.544 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.544 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.544 INFO:teuthology.orchestra.run.smithi031.stdout: "config_dashboard": { 2024-04-15T00:31:35.545 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "config_dashboard", 2024-04-15T00:31:35.545 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.545 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.545 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.545 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.545 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.545 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.545 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.545 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-15T00:31:35.546 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.546 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.546 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.546 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.546 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_alertmanager": { 2024-04-15T00:31:35.546 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_alertmanager", 2024-04-15T00:31:35.546 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.546 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.547 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.547 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-15T00:31:35.547 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.547 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.547 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.547 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Prometheus container image", 2024-04-15T00:31:35.547 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.547 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.547 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.548 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.548 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_base": { 2024-04-15T00:31:35.548 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_base", 2024-04-15T00:31:35.548 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.548 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.548 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.548 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-15T00:31:35.548 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.549 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.549 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.549 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Container image name, without the tag", 2024-04-15T00:31:35.549 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.549 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.549 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.549 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.549 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_elasticsearch": { 2024-04-15T00:31:35.549 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_elasticsearch", 2024-04-15T00:31:35.550 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.550 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.550 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.550 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-15T00:31:35.550 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.550 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.550 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.550 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "elasticsearch container image", 2024-04-15T00:31:35.550 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.551 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.551 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.551 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.551 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_grafana": { 2024-04-15T00:31:35.551 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_grafana", 2024-04-15T00:31:35.551 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.551 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.551 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.552 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-15T00:31:35.552 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.552 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.552 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.552 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Prometheus container image", 2024-04-15T00:31:35.552 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.552 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.552 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.552 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.553 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_haproxy": { 2024-04-15T00:31:35.553 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_haproxy", 2024-04-15T00:31:35.553 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.553 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.553 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.553 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-15T00:31:35.553 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.553 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.554 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.554 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "HAproxy container image", 2024-04-15T00:31:35.554 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.554 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.554 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.554 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.554 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_jaeger_agent": { 2024-04-15T00:31:35.554 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_jaeger_agent", 2024-04-15T00:31:35.554 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.555 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.555 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.555 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-15T00:31:35.555 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.555 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.555 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.555 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Jaeger agent container image", 2024-04-15T00:31:35.555 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.556 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.556 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.556 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.556 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_jaeger_collector": { 2024-04-15T00:31:35.556 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_jaeger_collector", 2024-04-15T00:31:35.556 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.556 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.556 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.556 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-15T00:31:35.557 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.557 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.557 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.557 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Jaeger collector container image", 2024-04-15T00:31:35.557 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.557 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.557 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.557 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.557 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_jaeger_query": { 2024-04-15T00:31:35.558 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_jaeger_query", 2024-04-15T00:31:35.558 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.558 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.558 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.558 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-15T00:31:35.558 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.558 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.558 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.559 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Jaeger query container image", 2024-04-15T00:31:35.559 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.559 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.559 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.559 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_keepalived": { 2024-04-15T00:31:35.559 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_keepalived", 2024-04-15T00:31:35.559 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.559 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.560 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.560 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-15T00:31:35.560 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.560 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.560 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.560 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Keepalived container image", 2024-04-15T00:31:35.560 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.560 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.560 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.561 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.561 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_loki": { 2024-04-15T00:31:35.561 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_loki", 2024-04-15T00:31:35.561 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.561 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.561 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.561 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-15T00:31:35.561 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.562 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.562 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.562 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Loki container image", 2024-04-15T00:31:35.562 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.562 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.562 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.562 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.562 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_node_exporter": { 2024-04-15T00:31:35.563 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_node_exporter", 2024-04-15T00:31:35.563 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.563 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.563 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.563 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-15T00:31:35.563 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.563 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.563 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.563 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Prometheus container image", 2024-04-15T00:31:35.564 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.564 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.564 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.564 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.564 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_nvmeof": { 2024-04-15T00:31:35.564 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_nvmeof", 2024-04-15T00:31:35.564 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.564 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.564 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.565 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-15T00:31:35.565 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.565 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.565 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.565 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Nvme-of container image", 2024-04-15T00:31:35.565 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.565 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.565 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.565 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.566 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_prometheus": { 2024-04-15T00:31:35.566 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_prometheus", 2024-04-15T00:31:35.566 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.566 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.566 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.566 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-15T00:31:35.566 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.566 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.567 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.567 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Prometheus container image", 2024-04-15T00:31:35.567 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.567 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.567 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.567 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.567 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_promtail": { 2024-04-15T00:31:35.567 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_promtail", 2024-04-15T00:31:35.567 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.568 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.568 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.568 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-15T00:31:35.568 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.568 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.568 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.568 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Promtail container image", 2024-04-15T00:31:35.568 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.569 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.569 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.569 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_snmp_gateway": { 2024-04-15T00:31:35.569 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_snmp_gateway", 2024-04-15T00:31:35.569 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.569 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.569 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.569 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-15T00:31:35.570 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.570 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.570 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.570 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "SNMP Gateway container image", 2024-04-15T00:31:35.570 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.570 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.570 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.570 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.570 INFO:teuthology.orchestra.run.smithi031.stdout: "container_init": { 2024-04-15T00:31:35.571 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_init", 2024-04-15T00:31:35.571 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.571 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.571 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.571 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.571 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.571 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.571 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.572 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Run podman/docker with `--init`", 2024-04-15T00:31:35.572 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.572 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.572 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.572 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.572 INFO:teuthology.orchestra.run.smithi031.stdout: "daemon_cache_timeout": { 2024-04-15T00:31:35.572 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "daemon_cache_timeout", 2024-04-15T00:31:35.572 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:35.572 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.573 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.573 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-04-15T00:31:35.573 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.573 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.573 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.573 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-15T00:31:35.573 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.573 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.573 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.574 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.574 INFO:teuthology.orchestra.run.smithi031.stdout: "default_cephadm_command_timeout": { 2024-04-15T00:31:35.574 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "default_cephadm_command_timeout", 2024-04-15T00:31:35.574 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.574 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.574 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.574 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "900", 2024-04-15T00:31:35.574 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.575 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.575 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.575 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-15T00:31:35.575 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.575 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.575 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.575 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.575 INFO:teuthology.orchestra.run.smithi031.stdout: "default_registry": { 2024-04-15T00:31:35.575 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "default_registry", 2024-04-15T00:31:35.576 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.576 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.576 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.576 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "docker.io", 2024-04-15T00:31:35.576 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.576 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.576 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.576 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-15T00:31:35.576 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.577 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.577 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.577 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.577 INFO:teuthology.orchestra.run.smithi031.stdout: "device_cache_timeout": { 2024-04-15T00:31:35.577 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "device_cache_timeout", 2024-04-15T00:31:35.577 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:35.577 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.577 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.578 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "1800", 2024-04-15T00:31:35.578 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.578 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.578 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.578 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "seconds to cache device inventory", 2024-04-15T00:31:35.578 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.578 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.578 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.578 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.579 INFO:teuthology.orchestra.run.smithi031.stdout: "device_enhanced_scan": { 2024-04-15T00:31:35.579 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "device_enhanced_scan", 2024-04-15T00:31:35.579 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.579 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.579 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.579 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.579 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.579 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.579 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.580 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-15T00:31:35.580 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.580 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.580 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.580 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.580 INFO:teuthology.orchestra.run.smithi031.stdout: "facts_cache_timeout": { 2024-04-15T00:31:35.580 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "facts_cache_timeout", 2024-04-15T00:31:35.580 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:35.581 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.581 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.581 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-04-15T00:31:35.581 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.581 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.581 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.581 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "seconds to cache host facts data", 2024-04-15T00:31:35.581 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.581 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.582 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.582 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.582 INFO:teuthology.orchestra.run.smithi031.stdout: "grafana_dashboards_path": { 2024-04-15T00:31:35.582 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "grafana_dashboards_path", 2024-04-15T00:31:35.582 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.582 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.582 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.582 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-15T00:31:35.582 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.583 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.583 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.583 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-15T00:31:35.583 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.583 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.583 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.583 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.583 INFO:teuthology.orchestra.run.smithi031.stdout: "host_check_interval": { 2024-04-15T00:31:35.584 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "host_check_interval", 2024-04-15T00:31:35.584 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:35.584 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.584 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.584 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-04-15T00:31:35.584 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.584 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.584 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.584 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to perform a host check", 2024-04-15T00:31:35.585 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.585 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.585 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.585 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.585 INFO:teuthology.orchestra.run.smithi031.stdout: "hw_monitoring": { 2024-04-15T00:31:35.585 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "hw_monitoring", 2024-04-15T00:31:35.585 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.585 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.585 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.586 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.586 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.586 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.586 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.586 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-15T00:31:35.586 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.586 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.586 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.587 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.587 INFO:teuthology.orchestra.run.smithi031.stdout: "inventory_list_all": { 2024-04-15T00:31:35.587 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "inventory_list_all", 2024-04-15T00:31:35.587 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.587 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.587 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.587 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.587 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.588 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.588 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.588 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-15T00:31:35.588 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.588 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.588 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.588 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.588 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.588 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.589 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.589 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.589 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.589 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.589 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.589 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.589 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.589 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.589 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.590 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.590 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.590 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.590 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.590 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.590 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.590 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.590 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.591 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.591 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.591 INFO:teuthology.orchestra.run.smithi031.stdout: "log_refresh_metadata": { 2024-04-15T00:31:35.591 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_refresh_metadata", 2024-04-15T00:31:35.591 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.591 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.591 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.591 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.591 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.592 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.592 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.592 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-15T00:31:35.592 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.592 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.592 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.592 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.592 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.592 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.593 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.593 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.593 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.593 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.593 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.593 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.593 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.593 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-15T00:31:35.594 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.594 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.594 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.594 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.594 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.594 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.594 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.594 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.594 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.595 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.595 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.595 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.595 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.595 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.595 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.595 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.595 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.595 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.596 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.596 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.596 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.596 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.596 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.596 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.596 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.596 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.597 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.597 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.597 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.597 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.597 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.597 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.597 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.597 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.598 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.598 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.598 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.598 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.598 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.598 INFO:teuthology.orchestra.run.smithi031.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-15T00:31:35.598 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-15T00:31:35.598 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.599 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.599 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.599 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.599 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.599 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.599 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.599 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-15T00:31:35.599 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.599 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.600 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.600 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.600 INFO:teuthology.orchestra.run.smithi031.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-15T00:31:35.600 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-15T00:31:35.600 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.600 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.600 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.600 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "*", 2024-04-15T00:31:35.601 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.601 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.601 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.601 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-15T00:31:35.601 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.601 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.601 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.601 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.601 INFO:teuthology.orchestra.run.smithi031.stdout: "max_count_per_host": { 2024-04-15T00:31:35.602 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_count_per_host", 2024-04-15T00:31:35.602 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.602 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.602 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.602 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-04-15T00:31:35.602 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.602 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.602 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.603 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "max number of daemons per service per host", 2024-04-15T00:31:35.603 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.603 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.603 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.603 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd_draining_count": { 2024-04-15T00:31:35.603 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_osd_draining_count", 2024-04-15T00:31:35.603 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.603 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.604 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.604 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-04-15T00:31:35.604 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.604 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.604 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.604 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-15T00:31:35.604 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.604 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.604 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.605 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.605 INFO:teuthology.orchestra.run.smithi031.stdout: "migration_current": { 2024-04-15T00:31:35.605 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "migration_current", 2024-04-15T00:31:35.605 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.605 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.605 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.605 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.605 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.606 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.606 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.606 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "internal - do not modify", 2024-04-15T00:31:35.606 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.606 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.606 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.606 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.606 INFO:teuthology.orchestra.run.smithi031.stdout: "mode": { 2024-04-15T00:31:35.606 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mode", 2024-04-15T00:31:35.607 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.607 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.607 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.607 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "root", 2024-04-15T00:31:35.607 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.607 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.607 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.607 INFO:teuthology.orchestra.run.smithi031.stdout: "cephadm-package", 2024-04-15T00:31:35.608 INFO:teuthology.orchestra.run.smithi031.stdout: "root" 2024-04-15T00:31:35.608 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.608 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "mode for remote execution of cephadm", 2024-04-15T00:31:35.608 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.608 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.608 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.608 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.608 INFO:teuthology.orchestra.run.smithi031.stdout: "oob_default_addr": { 2024-04-15T00:31:35.608 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "oob_default_addr", 2024-04-15T00:31:35.609 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.609 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.609 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.609 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "169.254.1.1", 2024-04-15T00:31:35.609 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.609 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.609 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.609 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-15T00:31:35.609 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.610 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.610 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.610 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.610 INFO:teuthology.orchestra.run.smithi031.stdout: "prometheus_alerts_path": { 2024-04-15T00:31:35.610 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "prometheus_alerts_path", 2024-04-15T00:31:35.610 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.610 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.610 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.611 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-15T00:31:35.611 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.611 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.611 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.611 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-15T00:31:35.611 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.611 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.611 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.612 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.612 INFO:teuthology.orchestra.run.smithi031.stdout: "registry_insecure": { 2024-04-15T00:31:35.612 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "registry_insecure", 2024-04-15T00:31:35.612 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.612 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.612 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.612 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.612 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.612 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.613 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.613 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-15T00:31:35.613 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.613 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.613 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.613 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.613 INFO:teuthology.orchestra.run.smithi031.stdout: "registry_password": { 2024-04-15T00:31:35.613 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "registry_password", 2024-04-15T00:31:35.614 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.614 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.614 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.614 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.614 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.614 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.614 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.614 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-15T00:31:35.615 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.615 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.615 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.615 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.615 INFO:teuthology.orchestra.run.smithi031.stdout: "registry_url": { 2024-04-15T00:31:35.615 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "registry_url", 2024-04-15T00:31:35.615 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.615 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.616 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.616 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.616 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.616 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.616 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.616 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-15T00:31:35.616 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.617 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.617 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.617 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.617 INFO:teuthology.orchestra.run.smithi031.stdout: "registry_username": { 2024-04-15T00:31:35.617 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "registry_username", 2024-04-15T00:31:35.617 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.617 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.617 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.617 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.618 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.618 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.618 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.618 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-15T00:31:35.618 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.618 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.618 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.618 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.619 INFO:teuthology.orchestra.run.smithi031.stdout: "secure_monitoring_stack": { 2024-04-15T00:31:35.619 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "secure_monitoring_stack", 2024-04-15T00:31:35.619 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.619 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.619 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.619 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.619 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.619 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.620 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.620 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-15T00:31:35.620 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.620 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.620 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.620 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.620 INFO:teuthology.orchestra.run.smithi031.stdout: "service_discovery_port": { 2024-04-15T00:31:35.620 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "service_discovery_port", 2024-04-15T00:31:35.620 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.621 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.621 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.621 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8765", 2024-04-15T00:31:35.621 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.621 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.621 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.621 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "cephadm service discovery port", 2024-04-15T00:31:35.621 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.622 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.622 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.622 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.622 INFO:teuthology.orchestra.run.smithi031.stdout: "ssh_config_file": { 2024-04-15T00:31:35.622 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssh_config_file", 2024-04-15T00:31:35.622 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.622 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.622 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.622 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.623 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.623 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.623 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.623 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-15T00:31:35.623 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.623 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.623 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.623 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.623 INFO:teuthology.orchestra.run.smithi031.stdout: "use_agent": { 2024-04-15T00:31:35.624 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "use_agent", 2024-04-15T00:31:35.624 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.624 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.624 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.624 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.624 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.624 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.624 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.625 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-15T00:31:35.625 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.625 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.625 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.625 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.625 INFO:teuthology.orchestra.run.smithi031.stdout: "use_repo_digest": { 2024-04-15T00:31:35.625 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "use_repo_digest", 2024-04-15T00:31:35.625 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.625 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.626 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.626 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.626 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.626 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.626 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.626 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-15T00:31:35.626 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.626 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.627 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.627 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.627 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_on_failed_host_check": { 2024-04-15T00:31:35.627 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_on_failed_host_check", 2024-04-15T00:31:35.627 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.627 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.627 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.627 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.627 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.628 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.628 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.628 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "raise a health warning if the host check fails", 2024-04-15T00:31:35.628 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.628 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.628 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.628 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.628 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_on_stray_daemons": { 2024-04-15T00:31:35.628 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_on_stray_daemons", 2024-04-15T00:31:35.629 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.629 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.629 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.629 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.629 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.629 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.629 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.629 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-15T00:31:35.629 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.630 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.630 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.630 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.630 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_on_stray_hosts": { 2024-04-15T00:31:35.630 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_on_stray_hosts", 2024-04-15T00:31:35.630 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.630 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.630 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.631 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.631 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.631 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.631 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.631 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-15T00:31:35.631 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.633 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.633 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.634 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.634 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.634 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.634 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.634 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crash", 2024-04-15T00:31:35.634 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.634 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.634 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.635 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.635 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.635 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.635 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.635 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.635 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.635 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.635 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.635 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.636 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.636 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.636 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.636 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.636 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.636 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.636 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.636 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.636 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.637 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.637 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.637 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.637 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.637 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.637 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.637 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.638 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.638 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.638 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.638 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.638 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.638 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.638 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.638 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.639 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.639 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.639 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.639 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.639 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.639 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.639 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.639 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.640 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.640 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.640 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.640 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.640 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.640 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.640 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.640 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.641 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.641 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.641 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.641 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.641 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.641 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.641 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.641 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.641 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.642 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.642 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.642 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.642 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.642 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.642 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.642 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.642 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.643 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.643 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.643 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.643 INFO:teuthology.orchestra.run.smithi031.stdout: "retain_interval": { 2024-04-15T00:31:35.643 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "retain_interval", 2024-04-15T00:31:35.643 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:35.643 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.643 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.643 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "31536000", 2024-04-15T00:31:35.644 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.644 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.644 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.644 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-15T00:31:35.644 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.644 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.644 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.644 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.645 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_recent_interval": { 2024-04-15T00:31:35.645 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_recent_interval", 2024-04-15T00:31:35.645 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:35.645 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.645 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.645 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "1209600", 2024-04-15T00:31:35.645 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.645 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.645 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.646 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-15T00:31:35.646 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.646 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.646 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.646 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.646 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.646 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.646 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.647 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "dashboard", 2024-04-15T00:31:35.647 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.647 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.647 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.647 INFO:teuthology.orchestra.run.smithi031.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-15T00:31:35.647 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-15T00:31:35.647 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.647 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.647 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.648 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-04-15T00:31:35.648 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.648 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.648 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.648 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.648 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.648 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.648 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.649 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.649 INFO:teuthology.orchestra.run.smithi031.stdout: "ALERTMANAGER_API_HOST": { 2024-04-15T00:31:35.649 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-15T00:31:35.649 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.649 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.649 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.649 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.649 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.649 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.650 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.650 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.650 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.650 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.650 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.650 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.650 INFO:teuthology.orchestra.run.smithi031.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-15T00:31:35.650 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-15T00:31:35.651 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.651 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.651 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.651 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.651 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.651 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.651 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.651 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.651 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.652 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.652 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.652 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.652 INFO:teuthology.orchestra.run.smithi031.stdout: "AUDIT_API_ENABLED": { 2024-04-15T00:31:35.652 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "AUDIT_API_ENABLED", 2024-04-15T00:31:35.652 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.652 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.652 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.653 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.653 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.653 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.653 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.653 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.653 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.653 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.653 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.653 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.654 INFO:teuthology.orchestra.run.smithi031.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-15T00:31:35.654 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-15T00:31:35.654 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.654 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.654 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.654 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.654 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.654 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.655 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.655 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.655 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.655 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.655 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.655 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.655 INFO:teuthology.orchestra.run.smithi031.stdout: "ENABLE_BROWSABLE_API": { 2024-04-15T00:31:35.655 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-15T00:31:35.655 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.656 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.656 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.656 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.656 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.656 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.656 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.656 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.656 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.656 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.657 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.657 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.657 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-15T00:31:35.657 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-15T00:31:35.657 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.657 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.657 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.657 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.658 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.658 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.658 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.658 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.658 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.658 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.658 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.658 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.659 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-15T00:31:35.659 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-15T00:31:35.659 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.659 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.659 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.659 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.659 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.659 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.659 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.660 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.660 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.660 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.660 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.660 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.660 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-15T00:31:35.660 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-15T00:31:35.660 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.660 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.661 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.661 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.661 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.661 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.661 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.661 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.661 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.661 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.662 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.662 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.662 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-15T00:31:35.662 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-15T00:31:35.662 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.662 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.662 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.662 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.662 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.663 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.663 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.663 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.663 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.663 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.663 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.663 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.663 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-15T00:31:35.664 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-15T00:31:35.664 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.664 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.664 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.664 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.664 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.664 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.664 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.664 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.665 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.665 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.665 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.665 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.665 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-15T00:31:35.665 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-15T00:31:35.665 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.665 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.666 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.666 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.666 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.666 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.666 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.666 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.666 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.666 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.666 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.667 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.667 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-15T00:31:35.667 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-15T00:31:35.667 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.667 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.667 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.667 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.667 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.668 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.668 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.668 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.668 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.668 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.668 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.668 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.668 INFO:teuthology.orchestra.run.smithi031.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-15T00:31:35.668 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-15T00:31:35.669 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.669 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.669 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.669 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.669 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.669 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.669 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.669 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.669 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.670 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.670 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.670 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.670 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_API_PASSWORD": { 2024-04-15T00:31:35.670 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-15T00:31:35.670 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.670 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.670 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.671 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "admin", 2024-04-15T00:31:35.671 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.671 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.671 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.671 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.671 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.671 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.671 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.671 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.672 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-15T00:31:35.672 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-15T00:31:35.672 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.672 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.672 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.672 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.672 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.672 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.673 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.673 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.673 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.673 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.673 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.673 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.673 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_API_URL": { 2024-04-15T00:31:35.673 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_API_URL", 2024-04-15T00:31:35.673 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.674 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.674 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.674 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.674 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.674 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.674 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.674 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.674 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.674 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.675 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.675 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.675 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_API_USERNAME": { 2024-04-15T00:31:35.675 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-15T00:31:35.675 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.675 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.675 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.675 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "admin", 2024-04-15T00:31:35.676 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.676 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.676 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.676 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.676 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.676 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.676 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.676 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.676 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-15T00:31:35.677 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-15T00:31:35.677 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.677 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.677 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.677 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.677 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.677 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.677 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.678 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.678 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.678 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.678 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.678 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.678 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-15T00:31:35.678 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-15T00:31:35.678 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.679 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.679 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.679 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.679 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.679 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.679 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.679 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.679 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.679 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.680 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.680 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.680 INFO:teuthology.orchestra.run.smithi031.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-15T00:31:35.680 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-15T00:31:35.680 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.680 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.680 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.680 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.681 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.681 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.681 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.681 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.681 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.681 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.681 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.681 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.681 INFO:teuthology.orchestra.run.smithi031.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-15T00:31:35.682 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-15T00:31:35.682 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.682 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.682 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.682 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.682 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.682 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.682 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.682 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.683 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.683 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.683 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.683 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.683 INFO:teuthology.orchestra.run.smithi031.stdout: "PROMETHEUS_API_HOST": { 2024-04-15T00:31:35.683 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-15T00:31:35.683 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.683 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.684 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.684 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.684 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.684 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.684 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.684 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.684 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.684 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.684 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.685 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.685 INFO:teuthology.orchestra.run.smithi031.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-15T00:31:35.685 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-15T00:31:35.685 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.685 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.685 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.685 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.685 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.685 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.686 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.686 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.686 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.686 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.686 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.686 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.686 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-15T00:31:35.686 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-15T00:31:35.687 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.687 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.687 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.687 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.687 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.687 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.687 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.687 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.687 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.688 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.688 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.688 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.688 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-15T00:31:35.688 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-15T00:31:35.688 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.688 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.688 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.688 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.689 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.689 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.689 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.689 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.689 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.689 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.689 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.689 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.690 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-15T00:31:35.690 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-15T00:31:35.690 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.690 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.690 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.690 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.690 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.690 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.690 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.691 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.691 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.691 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.691 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.691 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.691 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-15T00:31:35.691 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-15T00:31:35.691 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.692 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.692 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.692 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.692 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.692 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.692 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.692 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.692 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.692 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.693 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.693 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.693 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-15T00:31:35.693 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-15T00:31:35.693 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.693 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.693 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.693 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.693 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.694 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.694 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.694 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.694 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.694 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.694 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.694 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.694 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-15T00:31:35.695 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-15T00:31:35.695 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.695 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.695 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.695 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.695 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.695 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.695 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.696 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.696 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.696 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.696 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.696 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.696 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-15T00:31:35.696 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-15T00:31:35.696 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.696 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.697 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.697 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.697 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.697 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.697 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.697 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.697 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.697 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.697 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.698 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.698 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_ENABLED": { 2024-04-15T00:31:35.698 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-15T00:31:35.698 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.698 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.698 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.698 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.698 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.699 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.699 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.699 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.699 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.699 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.699 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.699 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.699 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-15T00:31:35.699 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-15T00:31:35.700 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.700 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.700 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.700 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-15T00:31:35.700 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.700 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.700 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.700 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.701 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.701 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.701 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.701 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.701 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-15T00:31:35.701 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-15T00:31:35.701 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.701 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.701 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.702 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-04-15T00:31:35.702 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.702 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.702 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.702 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.702 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.702 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.702 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.702 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.703 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-15T00:31:35.703 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-15T00:31:35.703 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.703 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.703 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.703 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8", 2024-04-15T00:31:35.703 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.703 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.704 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.704 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.704 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.704 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.704 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.704 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.704 INFO:teuthology.orchestra.run.smithi031.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-15T00:31:35.704 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-15T00:31:35.704 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.705 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.705 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.705 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "45", 2024-04-15T00:31:35.705 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.705 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.705 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.705 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.705 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.705 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.706 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.706 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.706 INFO:teuthology.orchestra.run.smithi031.stdout: "RGW_API_ACCESS_KEY": { 2024-04-15T00:31:35.706 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-15T00:31:35.706 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.706 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.706 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.706 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.706 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.707 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.707 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.707 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.707 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.707 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.707 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.707 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.707 INFO:teuthology.orchestra.run.smithi031.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-15T00:31:35.708 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-15T00:31:35.708 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.708 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.708 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.708 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "admin", 2024-04-15T00:31:35.708 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.708 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.708 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.708 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.709 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.709 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.709 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.709 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.709 INFO:teuthology.orchestra.run.smithi031.stdout: "RGW_API_SECRET_KEY": { 2024-04-15T00:31:35.709 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-15T00:31:35.709 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.709 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.709 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.710 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.710 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.710 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.710 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.710 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.710 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.710 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.710 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.711 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.711 INFO:teuthology.orchestra.run.smithi031.stdout: "RGW_API_SSL_VERIFY": { 2024-04-15T00:31:35.711 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-15T00:31:35.711 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.711 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.711 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.711 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.711 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.711 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.712 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.712 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.712 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.712 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.712 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.712 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.712 INFO:teuthology.orchestra.run.smithi031.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-15T00:31:35.712 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-15T00:31:35.713 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.713 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.713 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.713 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-04-15T00:31:35.713 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.713 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.713 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.713 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.713 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.714 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.714 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.714 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.714 INFO:teuthology.orchestra.run.smithi031.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-15T00:31:35.714 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-15T00:31:35.714 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.714 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.714 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.715 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-04-15T00:31:35.715 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.715 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.715 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.715 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.715 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.715 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.715 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.715 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.716 INFO:teuthology.orchestra.run.smithi031.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-15T00:31:35.716 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-15T00:31:35.716 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.716 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.716 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.716 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5", 2024-04-15T00:31:35.716 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.716 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.717 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.717 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.717 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.717 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.717 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.717 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.717 INFO:teuthology.orchestra.run.smithi031.stdout: "cross_origin_url": { 2024-04-15T00:31:35.717 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cross_origin_url", 2024-04-15T00:31:35.717 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.718 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.718 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.718 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.718 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.718 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.718 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.718 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.718 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.719 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.719 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.719 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.719 INFO:teuthology.orchestra.run.smithi031.stdout: "crt_file": { 2024-04-15T00:31:35.719 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crt_file", 2024-04-15T00:31:35.719 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.719 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.719 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.719 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.720 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.720 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.720 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.720 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.720 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.720 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.720 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.720 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.720 INFO:teuthology.orchestra.run.smithi031.stdout: "debug": { 2024-04-15T00:31:35.721 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "debug", 2024-04-15T00:31:35.721 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.721 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.721 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.721 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.721 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.721 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.721 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.721 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Enable/disable debug options", 2024-04-15T00:31:35.722 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.722 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.722 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.722 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.722 INFO:teuthology.orchestra.run.smithi031.stdout: "jwt_token_ttl": { 2024-04-15T00:31:35.722 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "jwt_token_ttl", 2024-04-15T00:31:35.722 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.722 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.723 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.723 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "28800", 2024-04-15T00:31:35.723 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.723 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.723 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.723 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.723 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.723 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.723 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.724 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.724 INFO:teuthology.orchestra.run.smithi031.stdout: "key_file": { 2024-04-15T00:31:35.724 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "key_file", 2024-04-15T00:31:35.724 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.724 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.724 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.724 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.724 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.724 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.725 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.725 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.725 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.725 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.725 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.725 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.725 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.725 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.726 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.726 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.726 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.726 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.726 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.726 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.726 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.726 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.726 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.727 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.727 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.727 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.727 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.727 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.727 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.727 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.727 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.728 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.728 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.728 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.728 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.728 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.728 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.728 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.728 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.728 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.729 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.729 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.729 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.729 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.729 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.729 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.729 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.729 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.729 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.730 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.730 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.730 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.730 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.730 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.730 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.730 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.730 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.731 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.731 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.731 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.731 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.731 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.731 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.731 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.731 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.731 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.732 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.732 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.732 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.732 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.732 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.732 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.732 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.732 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.733 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.733 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.733 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.733 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.733 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.733 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.733 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.733 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.733 INFO:teuthology.orchestra.run.smithi031.stdout: "motd": { 2024-04-15T00:31:35.734 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "motd", 2024-04-15T00:31:35.734 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.734 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.734 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.734 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.734 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.734 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.734 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.735 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "The message of the day", 2024-04-15T00:31:35.735 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.735 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.735 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.735 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.735 INFO:teuthology.orchestra.run.smithi031.stdout: "redirect_resolve_ip_addr": { 2024-04-15T00:31:35.735 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "redirect_resolve_ip_addr", 2024-04-15T00:31:35.735 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.735 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.736 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.736 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.736 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.736 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.736 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.736 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.736 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.736 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.736 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.737 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.737 INFO:teuthology.orchestra.run.smithi031.stdout: "server_addr": { 2024-04-15T00:31:35.737 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_addr", 2024-04-15T00:31:35.737 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.737 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.737 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.737 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "::", 2024-04-15T00:31:35.737 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.737 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.738 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.738 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.738 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.738 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.738 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.738 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.738 INFO:teuthology.orchestra.run.smithi031.stdout: "server_port": { 2024-04-15T00:31:35.738 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_port", 2024-04-15T00:31:35.739 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.739 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.739 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.739 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8080", 2024-04-15T00:31:35.739 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.739 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.739 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.739 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.739 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.740 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.740 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.740 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.740 INFO:teuthology.orchestra.run.smithi031.stdout: "ssl": { 2024-04-15T00:31:35.740 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssl", 2024-04-15T00:31:35.740 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.740 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.740 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.740 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.741 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.741 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.741 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.741 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.741 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.741 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.741 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.741 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.741 INFO:teuthology.orchestra.run.smithi031.stdout: "ssl_server_port": { 2024-04-15T00:31:35.742 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssl_server_port", 2024-04-15T00:31:35.742 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.742 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.742 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.742 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8443", 2024-04-15T00:31:35.742 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.742 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.742 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.743 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.743 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.743 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.743 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.743 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.743 INFO:teuthology.orchestra.run.smithi031.stdout: "standby_behaviour": { 2024-04-15T00:31:35.743 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "standby_behaviour", 2024-04-15T00:31:35.743 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.743 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.744 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.744 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "redirect", 2024-04-15T00:31:35.744 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.744 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.744 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.744 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.744 INFO:teuthology.orchestra.run.smithi031.stdout: "redirect" 2024-04-15T00:31:35.744 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.745 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.745 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.745 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.745 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.745 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.745 INFO:teuthology.orchestra.run.smithi031.stdout: "standby_error_status_code": { 2024-04-15T00:31:35.745 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "standby_error_status_code", 2024-04-15T00:31:35.745 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.746 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.746 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.746 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "500", 2024-04-15T00:31:35.746 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "400", 2024-04-15T00:31:35.746 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "599", 2024-04-15T00:31:35.746 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.746 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.746 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.746 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.747 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.747 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.747 INFO:teuthology.orchestra.run.smithi031.stdout: "url_prefix": { 2024-04-15T00:31:35.747 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "url_prefix", 2024-04-15T00:31:35.747 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.747 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.747 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.747 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.748 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.748 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.748 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.748 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.748 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.748 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.748 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.748 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.748 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.749 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.749 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.749 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "devicehealth", 2024-04-15T00:31:35.749 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.749 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.749 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.749 INFO:teuthology.orchestra.run.smithi031.stdout: "enable_monitoring": { 2024-04-15T00:31:35.749 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "enable_monitoring", 2024-04-15T00:31:35.749 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.750 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.750 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.750 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.750 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.750 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.750 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.750 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "monitor device health metrics", 2024-04-15T00:31:35.750 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.751 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.751 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.751 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.751 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.751 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.751 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.751 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.751 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.751 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.752 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.752 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.752 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.752 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.752 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.752 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.752 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.752 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.753 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.753 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.753 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.753 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.753 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.753 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.753 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.753 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.753 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.754 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.754 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.754 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.754 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.754 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.754 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.754 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.754 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.755 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.755 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.755 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.755 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.755 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.755 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.755 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.755 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.755 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.756 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.756 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.756 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.756 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.756 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.756 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.756 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.756 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.756 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.757 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.757 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.757 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.757 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.757 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.757 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.757 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.757 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.758 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.758 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.758 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.758 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.758 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.758 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.758 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.758 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.758 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.759 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.759 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.759 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.759 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.759 INFO:teuthology.orchestra.run.smithi031.stdout: "mark_out_threshold": { 2024-04-15T00:31:35.759 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mark_out_threshold", 2024-04-15T00:31:35.759 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:35.759 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.759 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.760 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "2419200", 2024-04-15T00:31:35.760 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.760 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.760 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.760 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-15T00:31:35.760 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.760 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.760 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.761 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.761 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": { 2024-04-15T00:31:35.761 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "pool_name", 2024-04-15T00:31:35.761 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.761 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.761 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.761 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "device_health_metrics", 2024-04-15T00:31:35.761 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.761 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.762 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.762 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-15T00:31:35.762 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.762 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.762 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.762 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.762 INFO:teuthology.orchestra.run.smithi031.stdout: "retention_period": { 2024-04-15T00:31:35.762 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "retention_period", 2024-04-15T00:31:35.763 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:35.763 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.763 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.763 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "15552000", 2024-04-15T00:31:35.763 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.763 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.763 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.763 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how long to retain device health metrics", 2024-04-15T00:31:35.763 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.764 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.764 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.764 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.764 INFO:teuthology.orchestra.run.smithi031.stdout: "scrape_frequency": { 2024-04-15T00:31:35.764 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "scrape_frequency", 2024-04-15T00:31:35.764 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:35.764 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.764 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.764 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "86400", 2024-04-15T00:31:35.765 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.765 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.765 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.765 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-15T00:31:35.765 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.765 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.765 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.765 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.765 INFO:teuthology.orchestra.run.smithi031.stdout: "self_heal": { 2024-04-15T00:31:35.766 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "self_heal", 2024-04-15T00:31:35.766 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.766 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.766 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.766 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.766 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.766 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.766 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.767 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-15T00:31:35.767 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.767 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.767 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.767 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.767 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-04-15T00:31:35.767 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-04-15T00:31:35.767 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:35.767 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.768 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.768 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-04-15T00:31:35.768 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.768 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.768 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.768 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to wake up and check device health", 2024-04-15T00:31:35.768 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.768 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.768 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.769 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.769 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_threshold": { 2024-04-15T00:31:35.769 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_threshold", 2024-04-15T00:31:35.769 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:35.769 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.769 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.769 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "7257600", 2024-04-15T00:31:35.769 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.770 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.770 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.770 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-15T00:31:35.770 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.770 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.770 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.770 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.770 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.771 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.771 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.771 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "diskprediction_local", 2024-04-15T00:31:35.771 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.771 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.771 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.771 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.771 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.771 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.772 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.772 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.772 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.772 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.772 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.772 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.772 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.772 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.772 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.773 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.773 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.773 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.773 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.773 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.773 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.773 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.773 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.773 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.774 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.774 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.774 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.774 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.774 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.774 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.774 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.774 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.775 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.775 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.775 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.775 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.775 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.775 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.775 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.775 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.775 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.776 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.776 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.776 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.776 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.776 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.776 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.776 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.776 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.776 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.777 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.777 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.777 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.777 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.777 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.777 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.777 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.777 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.778 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.778 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.778 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.778 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.778 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.778 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.778 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.778 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.779 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.779 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.779 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.779 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.779 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.779 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.779 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.779 INFO:teuthology.orchestra.run.smithi031.stdout: "predict_interval": { 2024-04-15T00:31:35.779 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "predict_interval", 2024-04-15T00:31:35.780 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.780 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.780 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.780 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "86400", 2024-04-15T00:31:35.780 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.780 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.780 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.780 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.780 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.781 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.781 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.781 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.781 INFO:teuthology.orchestra.run.smithi031.stdout: "predictor_model": { 2024-04-15T00:31:35.781 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "predictor_model", 2024-04-15T00:31:35.781 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.781 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.781 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.781 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "prophetstor", 2024-04-15T00:31:35.782 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.782 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.782 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.782 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.782 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.782 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.782 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.783 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.783 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-04-15T00:31:35.783 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-04-15T00:31:35.783 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.783 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.783 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.783 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-04-15T00:31:35.783 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.783 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.784 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.784 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.784 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.784 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.784 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.784 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.784 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.784 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.785 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.785 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "influx", 2024-04-15T00:31:35.785 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": false, 2024-04-15T00:31:35.785 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "influxdb python module not found", 2024-04-15T00:31:35.785 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.785 INFO:teuthology.orchestra.run.smithi031.stdout: "batch_size": { 2024-04-15T00:31:35.785 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "batch_size", 2024-04-15T00:31:35.785 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.785 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.786 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.786 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5000", 2024-04-15T00:31:35.786 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.786 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.786 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.786 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-15T00:31:35.786 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.786 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.787 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.787 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.787 INFO:teuthology.orchestra.run.smithi031.stdout: "database": { 2024-04-15T00:31:35.787 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "database", 2024-04-15T00:31:35.787 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.787 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.787 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.787 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "ceph", 2024-04-15T00:31:35.788 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.788 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.788 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.788 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-15T00:31:35.788 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.788 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.788 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.788 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.788 INFO:teuthology.orchestra.run.smithi031.stdout: "hostname": { 2024-04-15T00:31:35.789 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "hostname", 2024-04-15T00:31:35.789 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.789 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.789 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.789 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.789 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.789 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.789 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.789 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "InfluxDB server hostname", 2024-04-15T00:31:35.790 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.790 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.790 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.790 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.790 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-04-15T00:31:35.790 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-04-15T00:31:35.790 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:35.790 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.791 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.791 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "30", 2024-04-15T00:31:35.791 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "5", 2024-04-15T00:31:35.791 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.791 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.791 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-15T00:31:35.791 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.791 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.791 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.792 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.792 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.792 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.792 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.792 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.792 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.792 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.792 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.793 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.793 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.793 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.793 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.793 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.793 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.793 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.793 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.793 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.794 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.794 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.794 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.794 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.794 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.794 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.794 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.794 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.795 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.795 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.795 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.795 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.795 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.795 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.795 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.795 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.795 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.796 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.796 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.796 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.796 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.796 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.796 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.796 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.796 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.796 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.797 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.797 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.797 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.797 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.797 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.797 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.797 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.797 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.798 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.798 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.798 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.798 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.798 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.798 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.798 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.798 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.799 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.799 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.799 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.799 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.799 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.799 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.799 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.799 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.799 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.800 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.800 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.800 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.800 INFO:teuthology.orchestra.run.smithi031.stdout: "password": { 2024-04-15T00:31:35.800 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "password", 2024-04-15T00:31:35.800 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.800 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.800 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.800 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.801 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.801 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.801 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.801 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "password of InfluxDB server user", 2024-04-15T00:31:35.801 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.801 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.801 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.801 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.802 INFO:teuthology.orchestra.run.smithi031.stdout: "port": { 2024-04-15T00:31:35.802 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "port", 2024-04-15T00:31:35.802 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.802 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.802 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.802 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8086", 2024-04-15T00:31:35.802 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.802 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.802 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.803 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "InfluxDB server port", 2024-04-15T00:31:35.803 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.803 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.803 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.803 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.803 INFO:teuthology.orchestra.run.smithi031.stdout: "ssl": { 2024-04-15T00:31:35.803 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssl", 2024-04-15T00:31:35.803 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.804 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.804 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.804 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "false", 2024-04-15T00:31:35.804 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.804 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.804 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.804 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-15T00:31:35.804 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.804 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.805 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.805 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.805 INFO:teuthology.orchestra.run.smithi031.stdout: "threads": { 2024-04-15T00:31:35.805 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "threads", 2024-04-15T00:31:35.805 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.805 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.805 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.805 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5", 2024-04-15T00:31:35.806 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1", 2024-04-15T00:31:35.806 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "32", 2024-04-15T00:31:35.806 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.806 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-15T00:31:35.806 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.806 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.806 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.806 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.807 INFO:teuthology.orchestra.run.smithi031.stdout: "username": { 2024-04-15T00:31:35.807 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "username", 2024-04-15T00:31:35.807 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.807 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.807 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.807 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.807 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.807 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.807 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.808 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "username of InfluxDB server user", 2024-04-15T00:31:35.808 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.808 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.808 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.808 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.808 INFO:teuthology.orchestra.run.smithi031.stdout: "verify_ssl": { 2024-04-15T00:31:35.808 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "verify_ssl", 2024-04-15T00:31:35.808 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.808 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.809 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.809 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "true", 2024-04-15T00:31:35.809 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.809 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.809 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.809 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-15T00:31:35.809 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.809 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.809 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.810 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.810 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.810 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.810 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.810 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "insights", 2024-04-15T00:31:35.810 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.810 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.810 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.811 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.811 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.811 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.811 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.811 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.811 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.811 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.811 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.811 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.812 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.812 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.812 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.812 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.812 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.812 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.812 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.812 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.813 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.813 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.813 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.813 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.813 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.813 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.813 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.813 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.813 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.814 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.814 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.814 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.814 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.814 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.814 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.814 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.814 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.815 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.815 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.815 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.815 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.815 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.815 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.815 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.815 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.815 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.816 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.816 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.816 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.816 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.816 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.816 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.816 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.816 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.816 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.817 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.817 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.817 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.817 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.817 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.817 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.817 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.817 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.818 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.818 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.818 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.818 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.818 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.818 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.818 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.818 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.818 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.819 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.819 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.819 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.819 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.819 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "iostat", 2024-04-15T00:31:35.819 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.819 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.819 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.819 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.820 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.820 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.820 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.820 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.820 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.820 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.820 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.820 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.821 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.821 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.821 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.821 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.821 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.821 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.821 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.821 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.821 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.822 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.822 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.822 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.822 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.822 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.822 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.822 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.822 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.823 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.823 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.823 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.823 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.823 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.823 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.823 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.823 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.823 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.824 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.824 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.824 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.824 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.824 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.824 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.824 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.824 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.825 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.825 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.825 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.825 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.825 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.825 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.825 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.825 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.826 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.826 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.826 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.826 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.826 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.826 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.826 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.826 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.827 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.827 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.827 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.827 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.827 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.827 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.827 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.827 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.827 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.828 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.828 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.828 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.828 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.828 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.828 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "localpool", 2024-04-15T00:31:35.828 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.828 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.828 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.829 INFO:teuthology.orchestra.run.smithi031.stdout: "failure_domain": { 2024-04-15T00:31:35.829 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "failure_domain", 2024-04-15T00:31:35.829 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.829 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.829 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.829 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "host", 2024-04-15T00:31:35.829 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.829 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.830 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.830 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "failure domain for any created local pool", 2024-04-15T00:31:35.830 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-15T00:31:35.830 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.830 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.830 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.830 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.830 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.830 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.831 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.831 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.831 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.831 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.831 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.831 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.831 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.831 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.832 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.832 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.832 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.832 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.832 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.832 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.832 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.832 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.832 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.833 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.833 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.833 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.833 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.833 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.833 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.833 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.833 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.833 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.834 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.834 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.834 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.834 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.834 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.834 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.834 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.837 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.838 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.838 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.838 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.838 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.838 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.838 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.838 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.838 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.838 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.839 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.839 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.839 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.839 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.839 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.839 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.839 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.839 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.840 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.840 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.840 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.840 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.840 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.840 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.840 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.840 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.840 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.841 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.841 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.841 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.841 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.841 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.841 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.841 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.841 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": { 2024-04-15T00:31:35.842 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "min_size", 2024-04-15T00:31:35.842 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.842 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.842 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.842 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.842 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.842 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.842 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.842 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "default min_size for any created local pool", 2024-04-15T00:31:35.843 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-15T00:31:35.843 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.843 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.843 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.843 INFO:teuthology.orchestra.run.smithi031.stdout: "num_rep": { 2024-04-15T00:31:35.843 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "num_rep", 2024-04-15T00:31:35.843 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.843 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.844 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.844 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "3", 2024-04-15T00:31:35.844 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.844 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.844 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.844 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "default replica count for any created local pool", 2024-04-15T00:31:35.844 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.844 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.845 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.845 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.845 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": { 2024-04-15T00:31:35.845 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "pg_num", 2024-04-15T00:31:35.845 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.845 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.845 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.845 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "128", 2024-04-15T00:31:35.845 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.846 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.846 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.846 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "default pg_num for any created local pool", 2024-04-15T00:31:35.846 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.846 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.846 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.846 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.846 INFO:teuthology.orchestra.run.smithi031.stdout: "prefix": { 2024-04-15T00:31:35.847 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "prefix", 2024-04-15T00:31:35.847 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.847 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.847 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.847 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.847 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.847 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.847 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.848 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "name prefix for any created local pool", 2024-04-15T00:31:35.848 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.848 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.848 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.848 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.848 INFO:teuthology.orchestra.run.smithi031.stdout: "subtree": { 2024-04-15T00:31:35.848 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "subtree", 2024-04-15T00:31:35.848 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.848 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.849 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.849 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "rack", 2024-04-15T00:31:35.849 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.849 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.849 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.849 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-15T00:31:35.849 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-15T00:31:35.849 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.850 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.850 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.850 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.850 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.850 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.850 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mds_autoscaler", 2024-04-15T00:31:35.850 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.850 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.851 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.851 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.851 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.851 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.851 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.851 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.851 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.851 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.852 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.852 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.852 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.852 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.852 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.852 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.852 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.852 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.853 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.853 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.853 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.853 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.853 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.853 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.853 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.853 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.854 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.854 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.854 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.854 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.854 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.854 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.854 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.854 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.855 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.855 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.855 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.855 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.855 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.855 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.855 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.855 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.856 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.856 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.856 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.856 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.856 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.856 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.856 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.856 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.856 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.857 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.857 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.857 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.857 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.857 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.857 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.857 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.857 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.858 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.858 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.858 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.858 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.858 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.858 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.858 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.858 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.859 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.859 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.859 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.859 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.859 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.859 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.859 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.859 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.860 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mirroring", 2024-04-15T00:31:35.860 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.860 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.860 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.860 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.860 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.860 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.860 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.861 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.861 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.861 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.861 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.861 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.861 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.861 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.861 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.862 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.862 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.862 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.862 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.862 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.862 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.862 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.862 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.863 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.863 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.863 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.863 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.863 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.863 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.863 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.864 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.864 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.864 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.864 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.864 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.864 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.864 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.865 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.865 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.865 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.865 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.865 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.865 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.865 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.865 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.866 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.866 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.866 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.866 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.866 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.866 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.866 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.866 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.867 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.867 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.867 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.867 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.867 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.867 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.867 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.867 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.867 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.868 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.868 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.868 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.868 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.868 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.868 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.868 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.868 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.869 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.869 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.869 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.869 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.869 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "nfs", 2024-04-15T00:31:35.869 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.869 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.869 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.869 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.870 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.870 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.870 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.870 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.870 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.870 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.870 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.870 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.871 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.871 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.871 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.871 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.871 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.871 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.871 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.871 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.871 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.872 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.872 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.872 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.872 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.872 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.872 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.872 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.873 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.873 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.873 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.873 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.873 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.873 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.873 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.873 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.873 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.874 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.874 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.874 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.874 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.874 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.874 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.874 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.874 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.875 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.875 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.875 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.875 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.875 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.875 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.875 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.875 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.876 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.876 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.876 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.876 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.876 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.876 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.876 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.876 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.876 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.877 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.877 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.877 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.877 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.877 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.877 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.877 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.877 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.877 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.878 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.878 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.878 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.878 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.878 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.878 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "orchestrator", 2024-04-15T00:31:35.878 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.878 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.879 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.879 INFO:teuthology.orchestra.run.smithi031.stdout: "fail_fs": { 2024-04-15T00:31:35.879 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "fail_fs", 2024-04-15T00:31:35.879 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.879 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.879 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.879 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.879 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.879 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.880 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.880 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-15T00:31:35.880 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.880 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.880 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.880 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.880 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.880 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.881 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.881 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.881 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.881 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.881 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.881 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.881 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.881 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.881 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.882 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.882 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.882 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.882 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.882 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.882 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.882 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.882 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.883 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.883 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.883 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.883 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.883 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.883 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.883 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.883 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.883 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.884 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.884 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.884 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.884 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.884 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.884 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.884 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.884 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.885 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.885 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.885 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.885 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.885 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.885 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.885 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.885 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.886 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.886 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.886 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.886 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.886 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.886 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.886 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.886 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.886 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.887 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.887 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.887 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.887 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.887 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.887 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.887 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.887 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.888 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.888 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.888 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.888 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.888 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.888 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.888 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.888 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.888 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.889 INFO:teuthology.orchestra.run.smithi031.stdout: "orchestrator": { 2024-04-15T00:31:35.889 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "orchestrator", 2024-04-15T00:31:35.889 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.889 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.889 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.889 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.889 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.889 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.890 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.890 INFO:teuthology.orchestra.run.smithi031.stdout: "cephadm", 2024-04-15T00:31:35.890 INFO:teuthology.orchestra.run.smithi031.stdout: "rook", 2024-04-15T00:31:35.890 INFO:teuthology.orchestra.run.smithi031.stdout: "test_orchestrator" 2024-04-15T00:31:35.890 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.890 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Orchestrator backend", 2024-04-15T00:31:35.890 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.890 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.890 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.891 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.891 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.891 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.891 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.891 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "osd_perf_query", 2024-04-15T00:31:35.891 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.891 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.891 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.892 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.892 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.892 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.892 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.892 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.892 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.892 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.892 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.892 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.893 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.893 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.893 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.893 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.893 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.893 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.893 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.893 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.894 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.894 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.894 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.894 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.894 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.894 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.894 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.894 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.895 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.895 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.895 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.895 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.895 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.895 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.895 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.895 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.895 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.896 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.896 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.896 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.896 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.896 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.896 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.896 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.896 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.897 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.897 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.897 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.897 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.897 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.897 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.897 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.897 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.897 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.898 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.898 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.898 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.898 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.898 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.898 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.898 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.898 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.899 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.899 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.899 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.899 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.899 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.899 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.899 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.899 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.899 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.900 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.900 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.900 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.900 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.900 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.900 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "osd_support", 2024-04-15T00:31:35.900 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.900 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.900 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.901 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.901 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.901 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.901 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.901 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.901 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.901 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.901 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.902 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.902 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.902 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.902 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.902 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.902 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.902 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.902 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.902 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.903 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.903 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.903 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.903 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.903 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.903 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.903 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.903 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.904 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.904 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.904 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.904 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.904 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.904 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.904 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.904 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.904 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.905 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.905 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.905 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.905 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.905 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.905 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.905 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.905 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.906 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.906 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.906 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.906 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.906 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.906 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.906 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.906 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.906 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.907 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.907 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.907 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.907 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.907 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.907 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.907 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.907 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.908 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.908 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.908 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.908 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.908 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.908 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.908 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.908 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.909 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.909 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.909 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.909 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.909 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.909 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.909 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "pg_autoscaler", 2024-04-15T00:31:35.909 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.909 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.910 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.910 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.910 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.910 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.910 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.910 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.910 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.910 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.911 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.911 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.911 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.911 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.911 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.911 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.911 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.912 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.912 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.912 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.912 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.912 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.912 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.912 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.912 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.912 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.913 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.913 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.913 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.913 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.913 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.913 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.913 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.914 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.914 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.914 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.914 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.914 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.914 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.914 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.914 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.915 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.915 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.915 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.915 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.915 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.915 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.915 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.915 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.916 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.916 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.916 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.916 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.916 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.916 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.916 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.916 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.917 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.917 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.917 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.917 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.917 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.917 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.917 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.917 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.917 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.918 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.918 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.918 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.918 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.918 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.918 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.918 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.918 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-04-15T00:31:35.919 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-04-15T00:31:35.919 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:35.919 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.919 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.919 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-04-15T00:31:35.919 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.919 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.919 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.919 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.920 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.920 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.920 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.920 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.920 INFO:teuthology.orchestra.run.smithi031.stdout: "threshold": { 2024-04-15T00:31:35.920 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "threshold", 2024-04-15T00:31:35.920 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-04-15T00:31:35.920 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.921 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.921 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "3.0", 2024-04-15T00:31:35.921 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1.0", 2024-04-15T00:31:35.921 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.921 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.921 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "scaling threshold", 2024-04-15T00:31:35.921 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-15T00:31:35.921 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.921 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.922 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.922 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.922 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.922 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.922 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "progress", 2024-04-15T00:31:35.922 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.922 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.922 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.923 INFO:teuthology.orchestra.run.smithi031.stdout: "allow_pg_recovery_event": { 2024-04-15T00:31:35.923 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "allow_pg_recovery_event", 2024-04-15T00:31:35.923 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.923 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.923 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.923 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.923 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.923 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.923 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.924 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-15T00:31:35.924 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.924 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.924 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.924 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.924 INFO:teuthology.orchestra.run.smithi031.stdout: "enabled": { 2024-04-15T00:31:35.924 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "enabled", 2024-04-15T00:31:35.924 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.925 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.925 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.925 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.925 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.925 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.925 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.925 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.925 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.925 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.926 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.926 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.926 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.926 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.926 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.926 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.926 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.926 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.927 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.927 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.927 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.927 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.927 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.927 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.927 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.927 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.927 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.928 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.928 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.928 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.928 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.928 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.928 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.928 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.928 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.928 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.929 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.929 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.929 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.929 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.929 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.929 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.929 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.929 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.930 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.930 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.930 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.930 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.930 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.930 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.930 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.930 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.931 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.931 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.931 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.931 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.931 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.931 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.931 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.931 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.932 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.932 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.932 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.932 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.932 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.932 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.932 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.932 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.933 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.933 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.933 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.933 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.933 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.933 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.933 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.933 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.933 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.934 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.934 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.934 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.934 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.934 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.934 INFO:teuthology.orchestra.run.smithi031.stdout: "max_completed_events": { 2024-04-15T00:31:35.934 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_completed_events", 2024-04-15T00:31:35.934 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.935 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.935 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.935 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "50", 2024-04-15T00:31:35.935 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.935 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.935 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.935 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "number of past completed events to remember", 2024-04-15T00:31:35.935 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.935 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.936 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.936 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.936 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-04-15T00:31:35.936 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-04-15T00:31:35.936 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:35.936 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.936 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.936 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5", 2024-04-15T00:31:35.937 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.937 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.937 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.937 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how long the module is going to sleep", 2024-04-15T00:31:35.937 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.937 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.937 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.937 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.937 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.938 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.938 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.938 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "prometheus", 2024-04-15T00:31:35.938 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.938 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.938 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.938 INFO:teuthology.orchestra.run.smithi031.stdout: "cache": { 2024-04-15T00:31:35.938 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cache", 2024-04-15T00:31:35.939 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.939 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.939 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.939 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.939 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.939 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.939 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.939 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.939 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.940 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.940 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.940 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.940 INFO:teuthology.orchestra.run.smithi031.stdout: "exclude_perf_counters": { 2024-04-15T00:31:35.940 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "exclude_perf_counters", 2024-04-15T00:31:35.940 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.940 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.940 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.941 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.941 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.941 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.941 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.941 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-15T00:31:35.941 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-15T00:31:35.941 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.941 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.941 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.942 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.942 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.942 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.942 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.942 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.942 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.942 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.942 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.943 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.943 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.943 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.943 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.943 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.943 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.943 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.943 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.944 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.944 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.944 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.944 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.944 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.944 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.944 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.944 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.944 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.945 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.945 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.945 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.945 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.945 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.945 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.945 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.945 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.945 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.946 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.946 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.946 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.946 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.946 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.946 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.946 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.946 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.947 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.947 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.947 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.947 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.947 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.947 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.947 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.947 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.947 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.948 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.948 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.948 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.948 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.948 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.948 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.948 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.948 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.949 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.949 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.949 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.949 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.949 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.949 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.949 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.949 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.949 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.950 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.950 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.950 INFO:teuthology.orchestra.run.smithi031.stdout: "rbd_stats_pools": { 2024-04-15T00:31:35.950 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rbd_stats_pools", 2024-04-15T00:31:35.950 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.950 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.950 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.950 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.951 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.951 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.951 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.951 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.951 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.951 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.951 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.951 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.951 INFO:teuthology.orchestra.run.smithi031.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-15T00:31:35.952 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-15T00:31:35.952 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.952 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.952 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.952 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "300", 2024-04-15T00:31:35.952 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.952 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.952 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.953 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.953 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.953 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.953 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.953 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.953 INFO:teuthology.orchestra.run.smithi031.stdout: "scrape_interval": { 2024-04-15T00:31:35.953 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "scrape_interval", 2024-04-15T00:31:35.953 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-04-15T00:31:35.954 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.954 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.954 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "15.0", 2024-04-15T00:31:35.954 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.954 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.954 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.954 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.954 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.955 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.955 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.955 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.955 INFO:teuthology.orchestra.run.smithi031.stdout: "server_addr": { 2024-04-15T00:31:35.955 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_addr", 2024-04-15T00:31:35.955 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.955 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.955 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.956 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "::", 2024-04-15T00:31:35.956 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.956 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.956 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.956 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-15T00:31:35.956 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.956 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.956 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.956 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.957 INFO:teuthology.orchestra.run.smithi031.stdout: "server_port": { 2024-04-15T00:31:35.957 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_port", 2024-04-15T00:31:35.957 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.957 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.957 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.957 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "9283", 2024-04-15T00:31:35.957 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.957 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.958 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.958 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-15T00:31:35.958 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.958 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.958 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.958 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.958 INFO:teuthology.orchestra.run.smithi031.stdout: "stale_cache_strategy": { 2024-04-15T00:31:35.958 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "stale_cache_strategy", 2024-04-15T00:31:35.959 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.959 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.959 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.959 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "log", 2024-04-15T00:31:35.959 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.959 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.959 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.959 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.959 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.960 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.960 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.960 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.960 INFO:teuthology.orchestra.run.smithi031.stdout: "standby_behaviour": { 2024-04-15T00:31:35.960 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "standby_behaviour", 2024-04-15T00:31:35.960 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.960 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.960 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.961 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "default", 2024-04-15T00:31:35.961 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.961 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.961 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.961 INFO:teuthology.orchestra.run.smithi031.stdout: "default", 2024-04-15T00:31:35.961 INFO:teuthology.orchestra.run.smithi031.stdout: "error" 2024-04-15T00:31:35.961 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.961 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.961 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.962 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.962 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.962 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.962 INFO:teuthology.orchestra.run.smithi031.stdout: "standby_error_status_code": { 2024-04-15T00:31:35.962 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "standby_error_status_code", 2024-04-15T00:31:35.962 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.962 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.962 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.963 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "500", 2024-04-15T00:31:35.963 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "400", 2024-04-15T00:31:35.963 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "599", 2024-04-15T00:31:35.963 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.963 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.963 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.963 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.963 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.963 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.964 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.964 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.964 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.964 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rbd_support", 2024-04-15T00:31:35.964 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.964 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.964 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.964 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.964 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.965 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.965 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.965 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.965 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.965 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.965 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.965 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.965 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.966 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.966 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.966 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.966 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.966 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.966 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.966 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.966 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.967 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.967 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.967 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.967 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.967 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.967 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.967 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.967 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.967 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.968 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.968 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.968 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.968 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.968 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.968 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.969 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.969 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.969 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.969 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.969 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.969 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.969 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.969 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.970 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.970 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.970 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.970 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.970 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.970 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.970 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.970 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.970 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.971 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.971 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.971 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.971 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.971 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.971 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.971 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.971 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.972 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.972 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.972 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.972 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.972 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.972 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.972 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.972 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.972 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.973 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.973 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.973 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.973 INFO:teuthology.orchestra.run.smithi031.stdout: "max_concurrent_snap_create": { 2024-04-15T00:31:35.973 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_concurrent_snap_create", 2024-04-15T00:31:35.973 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:35.973 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.973 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.974 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-04-15T00:31:35.974 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.974 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.974 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.974 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.974 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.974 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.974 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.975 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.975 INFO:teuthology.orchestra.run.smithi031.stdout: "mirror_snapshot_schedule": { 2024-04-15T00:31:35.975 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mirror_snapshot_schedule", 2024-04-15T00:31:35.975 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.975 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.975 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.975 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.975 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.975 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.976 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.976 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.976 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.976 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.976 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.976 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.976 INFO:teuthology.orchestra.run.smithi031.stdout: "trash_purge_schedule": { 2024-04-15T00:31:35.976 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "trash_purge_schedule", 2024-04-15T00:31:35.976 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.977 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.977 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.977 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.977 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.977 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.977 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.977 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.977 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.978 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.978 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.978 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.978 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.978 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.978 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.978 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "restful", 2024-04-15T00:31:35.978 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.978 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.979 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.979 INFO:teuthology.orchestra.run.smithi031.stdout: "enable_auth": { 2024-04-15T00:31:35.979 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "enable_auth", 2024-04-15T00:31:35.979 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.979 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.979 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.979 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:35.979 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.980 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.980 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.980 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.980 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.980 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.980 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.980 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.980 INFO:teuthology.orchestra.run.smithi031.stdout: "key_file": { 2024-04-15T00:31:35.980 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "key_file", 2024-04-15T00:31:35.981 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.981 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.981 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.981 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.981 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.981 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.981 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.981 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.981 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.982 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.982 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.982 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.982 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.982 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.982 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.982 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.982 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.983 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.983 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.983 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.983 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.983 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.983 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.983 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.983 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.983 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.984 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.984 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.984 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.984 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.984 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.984 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.984 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.984 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.985 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.985 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.985 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.985 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.985 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.985 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.985 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.985 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.985 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.986 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.986 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.986 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.986 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.986 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.986 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.986 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.986 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.987 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.987 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.987 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.987 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.987 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.987 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.987 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.987 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.987 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.988 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.988 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.988 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.988 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.988 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.988 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.988 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.988 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.989 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:35.989 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:35.989 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.989 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.989 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.989 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.989 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.989 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.989 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.990 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.990 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.990 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.990 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.990 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.990 INFO:teuthology.orchestra.run.smithi031.stdout: "server_addr": { 2024-04-15T00:31:35.990 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_addr", 2024-04-15T00:31:35.990 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.990 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.991 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.991 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.991 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.991 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.991 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.991 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.991 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.991 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.992 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.992 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.992 INFO:teuthology.orchestra.run.smithi031.stdout: "server_port": { 2024-04-15T00:31:35.992 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_port", 2024-04-15T00:31:35.992 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.992 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.992 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:35.992 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.992 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.993 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.993 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.993 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.993 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.993 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.993 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.993 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.993 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:35.993 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.994 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:35.994 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rgw", 2024-04-15T00:31:35.994 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:35.994 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:35.994 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:35.994 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:35.994 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:35.994 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.995 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.995 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.995 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:35.995 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.995 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.995 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.995 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:35.995 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:35.995 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:35.996 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:35.996 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:35.996 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:35.996 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:35.996 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.996 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.996 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.996 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.997 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.997 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:35.997 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:35.997 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:35.997 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.997 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.997 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:35.997 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.998 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.998 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:35.998 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:35.998 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:35.998 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:35.998 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:35.998 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:35.998 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:35.998 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:35.999 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:35.999 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:35.999 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:35.999 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:35.999 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:35.999 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:35.999 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:35.999 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:36.000 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:36.000 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:36.000 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:36.000 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:36.000 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:36.000 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:36.000 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.000 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.000 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.001 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.001 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.001 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:36.001 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:36.001 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.001 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.001 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.001 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:36.001 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.002 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.002 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.002 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.002 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.002 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.002 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.002 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.002 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.003 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.003 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:36.003 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rook", 2024-04-15T00:31:36.003 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:36.003 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:36.003 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:36.003 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:36.003 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:36.003 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.004 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.004 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.004 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:36.004 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.004 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.004 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:36.004 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:36.004 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:36.005 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:36.005 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:36.005 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:36.005 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:36.005 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:36.005 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.005 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.005 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.005 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.006 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.006 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:36.006 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:36.006 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.006 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.006 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.006 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:36.006 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.007 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.007 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.007 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.007 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.007 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.007 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.007 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.007 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:36.007 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:36.008 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.008 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.008 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.008 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:36.008 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.008 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.008 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:36.008 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:36.009 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:36.009 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:36.009 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:36.009 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:36.009 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:36.009 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:36.009 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.009 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.009 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.010 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.010 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.010 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:36.010 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:36.010 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.010 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.010 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.010 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:36.011 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.011 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.011 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.011 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.011 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.011 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.011 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.011 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.011 INFO:teuthology.orchestra.run.smithi031.stdout: "storage_class": { 2024-04-15T00:31:36.012 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "storage_class", 2024-04-15T00:31:36.012 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.012 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.012 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.012 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "local", 2024-04-15T00:31:36.012 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.012 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.012 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.012 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-15T00:31:36.013 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.013 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.013 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.013 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.013 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.013 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.013 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:36.013 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "selftest", 2024-04-15T00:31:36.014 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:36.014 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:36.014 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:36.014 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:36.014 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:36.014 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.014 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.014 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.014 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:36.015 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.015 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.015 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:36.015 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:36.015 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:36.015 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:36.015 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:36.015 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:36.016 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:36.016 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:36.016 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.016 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.016 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.016 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.016 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.016 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:36.016 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:36.017 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.017 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.017 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.017 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:36.017 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.017 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.017 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.017 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.018 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.018 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.018 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.018 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.018 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:36.018 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:36.018 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.018 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.018 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.019 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:36.019 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.019 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.019 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:36.019 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:36.019 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:36.019 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:36.019 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:36.019 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:36.020 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:36.020 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:36.020 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.020 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.020 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.020 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.020 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.020 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:36.021 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:36.021 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.021 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.021 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.021 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:36.021 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.021 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.021 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.021 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.022 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.022 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.022 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.022 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.022 INFO:teuthology.orchestra.run.smithi031.stdout: "roption1": { 2024-04-15T00:31:36.022 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "roption1", 2024-04-15T00:31:36.022 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.022 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.023 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.023 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:36.023 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.023 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.023 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.023 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.023 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.023 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.023 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.024 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.024 INFO:teuthology.orchestra.run.smithi031.stdout: "roption2": { 2024-04-15T00:31:36.024 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "roption2", 2024-04-15T00:31:36.024 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.024 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.024 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.024 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "xyz", 2024-04-15T00:31:36.024 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.024 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.025 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.025 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.025 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.025 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.025 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.025 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.025 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption1": { 2024-04-15T00:31:36.025 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption1", 2024-04-15T00:31:36.026 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.026 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.026 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.026 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:36.026 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.026 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.026 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.026 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.027 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.027 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.027 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.027 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.027 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption2": { 2024-04-15T00:31:36.027 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption2", 2024-04-15T00:31:36.027 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:36.027 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.027 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.028 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:36.028 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.028 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.028 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.028 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.028 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.028 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.028 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.028 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.029 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption3": { 2024-04-15T00:31:36.029 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption3", 2024-04-15T00:31:36.029 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-04-15T00:31:36.029 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.029 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.029 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:36.029 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.029 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.029 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.030 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.030 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.030 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.030 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.030 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.030 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption4": { 2024-04-15T00:31:36.030 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption4", 2024-04-15T00:31:36.030 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.031 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.031 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.031 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:36.031 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.031 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.031 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.031 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.031 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.031 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.032 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.032 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.032 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption5": { 2024-04-15T00:31:36.032 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption5", 2024-04-15T00:31:36.032 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.032 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.032 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.032 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:36.033 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.033 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.033 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.033 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.033 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.033 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.033 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.033 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.033 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption6": { 2024-04-15T00:31:36.034 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption6", 2024-04-15T00:31:36.034 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.034 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.034 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.034 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:36.034 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.034 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.034 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.035 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.035 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.035 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.035 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.035 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.035 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption7": { 2024-04-15T00:31:36.035 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption7", 2024-04-15T00:31:36.035 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:36.036 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.036 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.036 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:36.036 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1", 2024-04-15T00:31:36.036 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "42", 2024-04-15T00:31:36.036 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.036 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.036 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.036 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.037 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.037 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.037 INFO:teuthology.orchestra.run.smithi031.stdout: "testkey": { 2024-04-15T00:31:36.037 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "testkey", 2024-04-15T00:31:36.037 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.037 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.037 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.037 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:36.037 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.038 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.038 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.038 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.038 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.038 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.038 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.038 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.041 INFO:teuthology.orchestra.run.smithi031.stdout: "testlkey": { 2024-04-15T00:31:36.042 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "testlkey", 2024-04-15T00:31:36.042 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.042 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.042 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.042 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:36.042 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.042 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.042 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.042 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.043 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.043 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.043 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.043 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.043 INFO:teuthology.orchestra.run.smithi031.stdout: "testnewline": { 2024-04-15T00:31:36.043 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "testnewline", 2024-04-15T00:31:36.043 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.043 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.044 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.044 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:36.044 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.044 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.044 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.044 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.044 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.044 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.044 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.045 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.045 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.045 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.045 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:36.045 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "snap_schedule", 2024-04-15T00:31:36.045 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:36.045 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:36.045 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:36.045 INFO:teuthology.orchestra.run.smithi031.stdout: "allow_m_granularity": { 2024-04-15T00:31:36.046 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "allow_m_granularity", 2024-04-15T00:31:36.046 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.046 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.046 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.046 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:36.046 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.046 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.046 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.047 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "allow minute scheduled snapshots", 2024-04-15T00:31:36.047 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.047 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.047 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.047 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.047 INFO:teuthology.orchestra.run.smithi031.stdout: "dump_on_update": { 2024-04-15T00:31:36.047 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "dump_on_update", 2024-04-15T00:31:36.047 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.047 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.048 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.048 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:36.048 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.048 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.048 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.048 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "dump database to debug log on update", 2024-04-15T00:31:36.048 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.048 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.049 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.049 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.049 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:36.049 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:36.049 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.049 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.049 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.049 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:36.049 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.050 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.050 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:36.050 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:36.050 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:36.050 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:36.050 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:36.050 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:36.050 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:36.051 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:36.051 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.051 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.051 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.051 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.051 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.051 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:36.051 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:36.051 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.052 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.052 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.052 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:36.052 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.052 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.052 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.052 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.052 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.052 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.053 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.053 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.053 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:36.053 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:36.053 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.053 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.053 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.053 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:36.054 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.054 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.054 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:36.054 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:36.054 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:36.054 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:36.054 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:36.054 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:36.054 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:36.055 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:36.055 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.055 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.055 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.055 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.055 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.055 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:36.055 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:36.056 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.056 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.056 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.056 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:36.056 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.056 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.056 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.056 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.057 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.057 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.057 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.057 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.057 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.057 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.057 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:36.057 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "stats", 2024-04-15T00:31:36.057 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:36.058 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:36.058 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:36.058 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:36.058 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:36.058 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.058 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.058 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.058 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:36.059 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.059 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.059 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:36.059 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:36.059 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:36.059 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:36.059 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:36.059 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:36.059 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:36.060 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:36.060 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.060 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.060 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.060 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.060 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.060 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:36.060 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:36.060 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.061 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.061 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.061 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:36.061 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.061 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.061 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.061 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.061 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.062 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.062 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.062 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:36.062 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:36.062 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.062 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.062 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.063 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:36.063 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.063 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.063 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:36.063 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:36.063 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:36.063 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:36.063 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:36.063 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:36.064 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:36.064 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:36.064 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.064 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.064 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.064 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.064 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.064 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:36.065 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:36.065 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.065 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.065 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.065 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:36.065 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.065 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.065 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.065 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.066 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.066 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.066 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.066 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.066 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.066 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.066 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:36.066 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "status", 2024-04-15T00:31:36.067 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:36.067 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:36.067 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:36.067 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:36.067 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:36.067 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.067 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.067 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.067 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:36.068 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.068 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.068 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:36.068 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:36.068 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:36.068 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:36.068 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:36.068 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:36.069 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:36.069 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:36.069 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.069 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.069 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.069 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.069 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.069 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:36.069 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:36.070 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.070 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.070 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.070 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:36.070 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.070 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.070 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.070 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.071 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.071 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.071 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.071 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.071 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:36.071 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:36.071 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.071 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.072 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.072 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:36.072 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.072 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.072 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:36.072 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:36.072 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:36.072 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:36.072 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:36.073 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:36.073 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:36.073 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:36.073 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.073 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.073 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.073 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.073 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.074 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:36.074 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:36.074 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.074 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.074 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.074 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:36.074 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.074 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.074 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.075 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.075 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.075 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.075 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.075 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.075 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.075 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.075 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:36.076 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "telegraf", 2024-04-15T00:31:36.076 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:36.076 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:36.076 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:36.076 INFO:teuthology.orchestra.run.smithi031.stdout: "address": { 2024-04-15T00:31:36.076 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "address", 2024-04-15T00:31:36.076 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.076 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.076 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.077 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-15T00:31:36.077 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.077 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.077 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.077 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.077 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.077 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.077 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.077 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.078 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-04-15T00:31:36.078 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-04-15T00:31:36.078 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:36.078 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.078 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.078 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "15", 2024-04-15T00:31:36.078 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.078 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.079 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.079 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.079 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.079 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.079 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.079 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.079 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:36.079 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:36.079 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.080 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.080 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.080 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:36.080 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.080 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.080 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:36.080 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:36.080 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:36.081 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:36.081 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:36.081 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:36.081 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:36.081 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:36.081 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.081 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.081 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.081 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.082 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.082 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:36.082 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:36.082 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.082 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.082 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.082 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:36.082 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.083 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.083 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.083 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.083 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.083 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.083 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.083 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.083 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:36.083 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:36.084 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.084 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.084 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.084 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:36.084 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.084 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.084 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:36.084 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:36.085 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:36.085 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:36.085 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:36.085 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:36.085 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:36.085 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:36.085 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.085 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.085 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.086 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.086 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.086 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:36.086 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:36.086 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.086 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.086 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.086 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:36.087 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.087 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.087 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.087 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.087 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.087 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.087 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.087 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.087 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.088 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.088 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:36.088 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "telemetry", 2024-04-15T00:31:36.088 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:36.088 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:36.088 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:36.088 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_basic": { 2024-04-15T00:31:36.088 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_basic", 2024-04-15T00:31:36.089 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.089 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.089 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.089 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:36.089 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.089 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.089 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.089 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-15T00:31:36.089 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.090 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.090 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.090 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.090 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_crash": { 2024-04-15T00:31:36.090 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_crash", 2024-04-15T00:31:36.090 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.090 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.090 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.091 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:36.091 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.091 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.091 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.091 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-15T00:31:36.091 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.091 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.091 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.091 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.092 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_device": { 2024-04-15T00:31:36.092 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_device", 2024-04-15T00:31:36.092 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.092 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.092 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.092 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:36.092 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.092 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.093 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.093 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-15T00:31:36.093 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.093 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.093 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.093 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.093 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_ident": { 2024-04-15T00:31:36.093 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_ident", 2024-04-15T00:31:36.093 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.094 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.094 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.094 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:36.094 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.094 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.094 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.094 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-15T00:31:36.094 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.095 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.095 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.095 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.095 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_perf": { 2024-04-15T00:31:36.095 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_perf", 2024-04-15T00:31:36.095 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.095 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.095 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.095 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:36.096 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.096 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.096 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.096 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-15T00:31:36.096 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.096 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.096 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.096 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.097 INFO:teuthology.orchestra.run.smithi031.stdout: "contact": { 2024-04-15T00:31:36.097 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "contact", 2024-04-15T00:31:36.097 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.097 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.097 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.097 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:36.097 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.097 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.097 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.098 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.098 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.098 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.098 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.098 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.098 INFO:teuthology.orchestra.run.smithi031.stdout: "description": { 2024-04-15T00:31:36.098 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "description", 2024-04-15T00:31:36.098 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.098 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.099 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.099 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:36.099 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.099 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.099 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.099 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.099 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.099 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.100 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.100 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.100 INFO:teuthology.orchestra.run.smithi031.stdout: "device_url": { 2024-04-15T00:31:36.100 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "device_url", 2024-04-15T00:31:36.100 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.100 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.100 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.100 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-15T00:31:36.100 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.101 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.101 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.101 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.101 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.101 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.101 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.101 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.101 INFO:teuthology.orchestra.run.smithi031.stdout: "enabled": { 2024-04-15T00:31:36.101 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "enabled", 2024-04-15T00:31:36.102 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.102 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.102 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.102 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:36.102 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.102 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.102 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.102 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.103 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.103 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.103 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.103 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.103 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-04-15T00:31:36.103 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-04-15T00:31:36.103 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:36.103 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.103 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.104 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "24", 2024-04-15T00:31:36.104 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "8", 2024-04-15T00:31:36.104 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.104 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.104 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.104 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.104 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.104 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.105 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.105 INFO:teuthology.orchestra.run.smithi031.stdout: "last_opt_revision": { 2024-04-15T00:31:36.105 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "last_opt_revision", 2024-04-15T00:31:36.105 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:36.105 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.105 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.105 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "1", 2024-04-15T00:31:36.105 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.105 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.106 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.106 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.106 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.106 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.106 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.106 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.106 INFO:teuthology.orchestra.run.smithi031.stdout: "leaderboard": { 2024-04-15T00:31:36.106 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "leaderboard", 2024-04-15T00:31:36.107 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.107 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.107 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.107 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:36.107 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.107 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.107 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.107 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.107 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.108 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.108 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.108 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.108 INFO:teuthology.orchestra.run.smithi031.stdout: "leaderboard_description": { 2024-04-15T00:31:36.108 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "leaderboard_description", 2024-04-15T00:31:36.108 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.108 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.108 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.108 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:36.109 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.109 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.109 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.109 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.109 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.109 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.109 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.109 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.110 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:36.110 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:36.110 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.110 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.110 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.110 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:36.110 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.110 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.110 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:36.111 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:36.111 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:36.111 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:36.111 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:36.111 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:36.111 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:36.111 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:36.111 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.112 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.112 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.112 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.112 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.112 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:36.112 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:36.112 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.112 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.112 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.113 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:36.113 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.113 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.113 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.113 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.113 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.113 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.113 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.114 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.114 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:36.114 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:36.114 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.114 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.114 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.114 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:36.114 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.115 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.115 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:36.115 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:36.115 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:36.115 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:36.115 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:36.115 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:36.115 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:36.115 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:36.116 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.116 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.116 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.116 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.116 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.116 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:36.116 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:36.116 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.117 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.117 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.117 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:36.117 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.117 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.117 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.117 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.117 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.117 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.118 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.118 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.118 INFO:teuthology.orchestra.run.smithi031.stdout: "organization": { 2024-04-15T00:31:36.118 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "organization", 2024-04-15T00:31:36.118 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.118 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.118 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.118 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:36.119 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.119 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.119 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.119 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.119 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.119 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.119 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.119 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.119 INFO:teuthology.orchestra.run.smithi031.stdout: "proxy": { 2024-04-15T00:31:36.120 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "proxy", 2024-04-15T00:31:36.120 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.120 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.120 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.120 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:36.120 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.120 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.120 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.120 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.121 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.121 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.121 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.121 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.121 INFO:teuthology.orchestra.run.smithi031.stdout: "url": { 2024-04-15T00:31:36.121 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "url", 2024-04-15T00:31:36.121 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.121 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.122 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.122 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-15T00:31:36.122 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.122 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.122 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.122 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.122 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.122 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.122 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.123 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.123 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.123 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.123 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:36.123 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "test_orchestrator", 2024-04-15T00:31:36.123 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:36.123 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:36.123 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:36.124 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:36.124 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:36.124 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.124 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.124 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.124 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:36.124 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.124 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.124 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:36.125 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:36.125 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:36.125 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:36.125 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:36.125 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:36.125 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:36.125 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:36.125 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.125 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.126 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.126 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.126 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.126 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:36.126 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:36.126 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.126 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.126 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.127 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:36.127 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.127 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.127 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.127 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.127 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.127 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.127 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.127 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.128 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:36.128 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:36.128 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.128 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.128 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.128 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:36.128 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.128 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.129 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:36.129 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:36.129 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:36.129 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:36.129 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:36.129 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:36.129 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:36.129 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:36.129 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.130 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.130 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.130 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.130 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.130 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:36.130 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:36.130 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.130 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.131 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.131 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:36.131 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.131 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.131 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.131 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.131 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.131 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.131 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.132 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.132 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.132 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.132 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:36.132 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "volumes", 2024-04-15T00:31:36.132 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:36.132 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:36.132 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:36.132 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:36.133 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:36.133 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.133 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.133 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.133 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:36.133 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.133 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.133 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:36.134 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:36.134 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:36.134 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:36.134 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:36.134 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:36.134 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:36.134 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:36.134 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.134 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.135 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.135 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.135 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.135 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:36.135 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:36.135 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.135 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.135 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.135 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:36.136 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.136 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.136 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.136 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.136 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.136 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.136 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.136 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.137 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:36.137 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:36.137 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.137 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.137 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.137 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:36.137 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.137 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.138 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:36.138 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:36.138 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:36.138 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:36.138 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:36.138 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:36.138 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:36.138 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:36.138 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.139 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.139 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.139 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.139 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.139 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:36.139 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:36.139 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.139 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.140 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.140 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:36.140 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.140 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.140 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.140 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.140 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.140 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.140 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.141 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.141 INFO:teuthology.orchestra.run.smithi031.stdout: "max_concurrent_clones": { 2024-04-15T00:31:36.141 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_concurrent_clones", 2024-04-15T00:31:36.141 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:36.141 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.141 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.141 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "4", 2024-04-15T00:31:36.141 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.141 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.142 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.142 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-15T00:31:36.142 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.142 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.142 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.142 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.142 INFO:teuthology.orchestra.run.smithi031.stdout: "periodic_async_work": { 2024-04-15T00:31:36.142 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "periodic_async_work", 2024-04-15T00:31:36.143 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.143 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.143 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.143 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:36.143 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.143 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.143 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.143 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Periodically check for async work", 2024-04-15T00:31:36.144 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.144 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.144 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.144 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.144 INFO:teuthology.orchestra.run.smithi031.stdout: "snapshot_clone_delay": { 2024-04-15T00:31:36.144 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "snapshot_clone_delay", 2024-04-15T00:31:36.144 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:36.144 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.144 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.145 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-04-15T00:31:36.145 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.145 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.145 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.145 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-15T00:31:36.145 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.145 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.145 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.145 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.146 INFO:teuthology.orchestra.run.smithi031.stdout: "snapshot_clone_no_wait": { 2024-04-15T00:31:36.146 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "snapshot_clone_no_wait", 2024-04-15T00:31:36.146 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.146 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.146 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.146 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-04-15T00:31:36.146 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.146 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.147 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.147 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-15T00:31:36.147 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.147 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.147 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.147 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.147 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.147 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.147 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:36.148 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "zabbix", 2024-04-15T00:31:36.148 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-04-15T00:31:36.148 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-04-15T00:31:36.148 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-04-15T00:31:36.148 INFO:teuthology.orchestra.run.smithi031.stdout: "discovery_interval": { 2024-04-15T00:31:36.148 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "discovery_interval", 2024-04-15T00:31:36.148 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-04-15T00:31:36.148 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.149 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.149 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "100", 2024-04-15T00:31:36.149 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.149 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.149 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.149 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.149 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.149 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.149 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.150 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.150 INFO:teuthology.orchestra.run.smithi031.stdout: "identifier": { 2024-04-15T00:31:36.150 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "identifier", 2024-04-15T00:31:36.150 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.150 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.150 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.150 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:36.150 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.151 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.151 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.151 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.151 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.151 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.151 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.151 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.151 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-04-15T00:31:36.151 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-04-15T00:31:36.152 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-04-15T00:31:36.152 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.152 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.152 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-04-15T00:31:36.152 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.152 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.152 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.152 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.153 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.153 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.153 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.153 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.153 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-04-15T00:31:36.153 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-04-15T00:31:36.153 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.153 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.153 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.154 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:36.154 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.154 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.154 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:36.154 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:36.154 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:36.154 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:36.154 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:36.154 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:36.155 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:36.155 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:36.155 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.155 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.155 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.155 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.155 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.155 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-04-15T00:31:36.156 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-04-15T00:31:36.156 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.156 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.156 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.156 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:36.156 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.156 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.156 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.156 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.157 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.157 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.157 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.157 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.157 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-04-15T00:31:36.157 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-04-15T00:31:36.157 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.157 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.158 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.158 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-04-15T00:31:36.158 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.158 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.158 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-04-15T00:31:36.158 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-04-15T00:31:36.158 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-04-15T00:31:36.158 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-04-15T00:31:36.158 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-04-15T00:31:36.159 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-04-15T00:31:36.159 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-04-15T00:31:36.159 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:36.159 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.159 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.159 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.159 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.159 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.160 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-04-15T00:31:36.160 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-04-15T00:31:36.160 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-04-15T00:31:36.160 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.160 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-15T00:31:36.160 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-04-15T00:31:36.160 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.160 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.160 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.161 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.161 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.161 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.161 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.161 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.161 INFO:teuthology.orchestra.run.smithi031.stdout: "zabbix_host": { 2024-04-15T00:31:36.161 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "zabbix_host", 2024-04-15T00:31:36.161 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.161 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.162 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.162 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-04-15T00:31:36.162 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.162 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.162 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.162 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.162 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.162 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.163 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.163 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.163 INFO:teuthology.orchestra.run.smithi031.stdout: "zabbix_port": { 2024-04-15T00:31:36.163 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "zabbix_port", 2024-04-15T00:31:36.163 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-04-15T00:31:36.163 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.163 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.163 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10051", 2024-04-15T00:31:36.163 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.164 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.164 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.164 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.164 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.164 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.164 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.164 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.164 INFO:teuthology.orchestra.run.smithi031.stdout: "zabbix_sender": { 2024-04-15T00:31:36.165 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "zabbix_sender", 2024-04-15T00:31:36.165 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-04-15T00:31:36.165 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-04-15T00:31:36.165 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-15T00:31:36.165 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-15T00:31:36.165 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-04-15T00:31:36.165 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-04-15T00:31:36.165 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-04-15T00:31:36.165 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-04-15T00:31:36.166 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-04-15T00:31:36.166 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-04-15T00:31:36.166 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-04-15T00:31:36.166 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.166 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.166 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.166 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:36.166 INFO:teuthology.orchestra.run.smithi031.stdout: "services": {}, 2024-04-15T00:31:36.167 INFO:teuthology.orchestra.run.smithi031.stdout: "always_on_modules": { 2024-04-15T00:31:36.167 INFO:teuthology.orchestra.run.smithi031.stdout: "octopus": [ 2024-04-15T00:31:36.167 INFO:teuthology.orchestra.run.smithi031.stdout: "balancer", 2024-04-15T00:31:36.167 INFO:teuthology.orchestra.run.smithi031.stdout: "crash", 2024-04-15T00:31:36.167 INFO:teuthology.orchestra.run.smithi031.stdout: "devicehealth", 2024-04-15T00:31:36.167 INFO:teuthology.orchestra.run.smithi031.stdout: "orchestrator", 2024-04-15T00:31:36.167 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscaler", 2024-04-15T00:31:36.167 INFO:teuthology.orchestra.run.smithi031.stdout: "progress", 2024-04-15T00:31:36.167 INFO:teuthology.orchestra.run.smithi031.stdout: "rbd_support", 2024-04-15T00:31:36.168 INFO:teuthology.orchestra.run.smithi031.stdout: "status", 2024-04-15T00:31:36.168 INFO:teuthology.orchestra.run.smithi031.stdout: "telemetry", 2024-04-15T00:31:36.168 INFO:teuthology.orchestra.run.smithi031.stdout: "volumes" 2024-04-15T00:31:36.168 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:36.168 INFO:teuthology.orchestra.run.smithi031.stdout: "pacific": [ 2024-04-15T00:31:36.168 INFO:teuthology.orchestra.run.smithi031.stdout: "balancer", 2024-04-15T00:31:36.168 INFO:teuthology.orchestra.run.smithi031.stdout: "crash", 2024-04-15T00:31:36.168 INFO:teuthology.orchestra.run.smithi031.stdout: "devicehealth", 2024-04-15T00:31:36.169 INFO:teuthology.orchestra.run.smithi031.stdout: "orchestrator", 2024-04-15T00:31:36.169 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscaler", 2024-04-15T00:31:36.169 INFO:teuthology.orchestra.run.smithi031.stdout: "progress", 2024-04-15T00:31:36.169 INFO:teuthology.orchestra.run.smithi031.stdout: "rbd_support", 2024-04-15T00:31:36.169 INFO:teuthology.orchestra.run.smithi031.stdout: "status", 2024-04-15T00:31:36.169 INFO:teuthology.orchestra.run.smithi031.stdout: "telemetry", 2024-04-15T00:31:36.169 INFO:teuthology.orchestra.run.smithi031.stdout: "volumes" 2024-04-15T00:31:36.169 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:36.169 INFO:teuthology.orchestra.run.smithi031.stdout: "quincy": [ 2024-04-15T00:31:36.170 INFO:teuthology.orchestra.run.smithi031.stdout: "balancer", 2024-04-15T00:31:36.170 INFO:teuthology.orchestra.run.smithi031.stdout: "crash", 2024-04-15T00:31:36.170 INFO:teuthology.orchestra.run.smithi031.stdout: "devicehealth", 2024-04-15T00:31:36.170 INFO:teuthology.orchestra.run.smithi031.stdout: "orchestrator", 2024-04-15T00:31:36.170 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscaler", 2024-04-15T00:31:36.170 INFO:teuthology.orchestra.run.smithi031.stdout: "progress", 2024-04-15T00:31:36.170 INFO:teuthology.orchestra.run.smithi031.stdout: "rbd_support", 2024-04-15T00:31:36.170 INFO:teuthology.orchestra.run.smithi031.stdout: "status", 2024-04-15T00:31:36.171 INFO:teuthology.orchestra.run.smithi031.stdout: "telemetry", 2024-04-15T00:31:36.171 INFO:teuthology.orchestra.run.smithi031.stdout: "volumes" 2024-04-15T00:31:36.171 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:36.171 INFO:teuthology.orchestra.run.smithi031.stdout: "reef": [ 2024-04-15T00:31:36.171 INFO:teuthology.orchestra.run.smithi031.stdout: "balancer", 2024-04-15T00:31:36.171 INFO:teuthology.orchestra.run.smithi031.stdout: "crash", 2024-04-15T00:31:36.171 INFO:teuthology.orchestra.run.smithi031.stdout: "devicehealth", 2024-04-15T00:31:36.171 INFO:teuthology.orchestra.run.smithi031.stdout: "orchestrator", 2024-04-15T00:31:36.171 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscaler", 2024-04-15T00:31:36.172 INFO:teuthology.orchestra.run.smithi031.stdout: "progress", 2024-04-15T00:31:36.172 INFO:teuthology.orchestra.run.smithi031.stdout: "rbd_support", 2024-04-15T00:31:36.172 INFO:teuthology.orchestra.run.smithi031.stdout: "status", 2024-04-15T00:31:36.172 INFO:teuthology.orchestra.run.smithi031.stdout: "telemetry", 2024-04-15T00:31:36.172 INFO:teuthology.orchestra.run.smithi031.stdout: "volumes" 2024-04-15T00:31:36.172 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-15T00:31:36.172 INFO:teuthology.orchestra.run.smithi031.stdout: "squid": [ 2024-04-15T00:31:36.172 INFO:teuthology.orchestra.run.smithi031.stdout: "balancer", 2024-04-15T00:31:36.172 INFO:teuthology.orchestra.run.smithi031.stdout: "crash", 2024-04-15T00:31:36.173 INFO:teuthology.orchestra.run.smithi031.stdout: "devicehealth", 2024-04-15T00:31:36.173 INFO:teuthology.orchestra.run.smithi031.stdout: "orchestrator", 2024-04-15T00:31:36.173 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscaler", 2024-04-15T00:31:36.173 INFO:teuthology.orchestra.run.smithi031.stdout: "progress", 2024-04-15T00:31:36.173 INFO:teuthology.orchestra.run.smithi031.stdout: "rbd_support", 2024-04-15T00:31:36.173 INFO:teuthology.orchestra.run.smithi031.stdout: "status", 2024-04-15T00:31:36.173 INFO:teuthology.orchestra.run.smithi031.stdout: "telemetry", 2024-04-15T00:31:36.173 INFO:teuthology.orchestra.run.smithi031.stdout: "volumes" 2024-04-15T00:31:36.174 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-15T00:31:36.174 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.174 INFO:teuthology.orchestra.run.smithi031.stdout: "last_failure_osd_epoch": 0, 2024-04-15T00:31:36.174 INFO:teuthology.orchestra.run.smithi031.stdout: "active_clients": [ 2024-04-15T00:31:36.174 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:36.174 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "devicehealth", 2024-04-15T00:31:36.174 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-04-15T00:31:36.174 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:36.174 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2024-04-15T00:31:36.175 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:0", 2024-04-15T00:31:36.175 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 3447079077 2024-04-15T00:31:36.175 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.175 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-15T00:31:36.175 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.175 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:36.175 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "libcephsqlite", 2024-04-15T00:31:36.175 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-04-15T00:31:36.176 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:36.176 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2024-04-15T00:31:36.176 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:0", 2024-04-15T00:31:36.176 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 3330576278 2024-04-15T00:31:36.176 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.176 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-15T00:31:36.176 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.176 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:36.176 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rbd_support", 2024-04-15T00:31:36.177 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-04-15T00:31:36.177 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:36.177 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2024-04-15T00:31:36.177 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:0", 2024-04-15T00:31:36.177 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 648122023 2024-04-15T00:31:36.177 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.177 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-15T00:31:36.177 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.177 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:36.178 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "volumes", 2024-04-15T00:31:36.178 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-04-15T00:31:36.178 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-15T00:31:36.178 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2024-04-15T00:31:36.178 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:0", 2024-04-15T00:31:36.178 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 1242183301 2024-04-15T00:31:36.178 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.178 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-15T00:31:36.179 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.179 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-15T00:31:36.179 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-15T00:31:36.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.710+0000 7f600fb64640 1 -- 172.21.15.31:0/4260818054 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f5fec06b9c0 msgr2=0x7f5fec06de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:36.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.710+0000 7f600fb64640 1 --2- 172.21.15.31:0/4260818054 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f5fec06b9c0 0x7f5fec06de80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6004036000 tx=0x7f600403d040 comp rx=0 tx=0).stop 2024-04-15T00:31:36.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.710+0000 7f600fb64640 1 -- 172.21.15.31:0/4260818054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f600813f300 msgr2=0x7f60080707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:36.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.710+0000 7f600fb64640 1 --2- 172.21.15.31:0/4260818054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f600813f300 0x7f60080707c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f600000c700 tx=0x7f600000cbc0 comp rx=0 tx=0).stop 2024-04-15T00:31:36.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.710+0000 7f600fb64640 1 -- 172.21.15.31:0/4260818054 shutdown_connections 2024-04-15T00:31:36.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.710+0000 7f600fb64640 1 --2- 172.21.15.31:0/4260818054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f600813f300 0x7f60080707c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:36.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.710+0000 7f600fb64640 1 --2- 172.21.15.31:0/4260818054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60080b52a0 0x7f6008141260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:36.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.710+0000 7f600fb64640 1 --2- 172.21.15.31:0/4260818054 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f5fec06b9c0 0x7f5fec06de80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:36.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.710+0000 7f600fb64640 1 --2- 172.21.15.31:0/4260818054 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f60080727b0 0x7f600809f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:36.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.710+0000 7f600fb64640 1 -- 172.21.15.31:0/4260818054 >> 172.21.15.31:0/4260818054 conn(0x7f60080b6640 msgr2=0x7f60080b6a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:36.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.710+0000 7f600fb64640 1 -- 172.21.15.31:0/4260818054 shutdown_connections 2024-04-15T00:31:36.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:34.710+0000 7f600fb64640 1 -- 172.21.15.31:0/4260818054 wait complete. 2024-04-15T00:31:36.186 DEBUG:tasks.check_counter:Getting stats from a 2024-04-15T00:31:36.186 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump 2024-04-15T00:31:36.309 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-15T00:31:36.309 INFO:teuthology.orchestra.run.smithi031.stdout: "AsyncMessenger::Worker-0": { 2024-04-15T00:31:36.309 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_messages": 1154, 2024-04-15T00:31:36.310 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_messages": 1147, 2024-04-15T00:31:36.310 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_bytes": 448853, 2024-04-15T00:31:36.310 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_bytes": 4666422, 2024-04-15T00:31:36.310 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_created_connections": 6, 2024-04-15T00:31:36.310 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_active_connections": 2, 2024-04-15T00:31:36.310 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_total_time": 0.108991522, 2024-04-15T00:31:36.310 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_send_time": 0.046092577, 2024-04-15T00:31:36.311 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_recv_time": 0.041061411, 2024-04-15T00:31:36.311 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_fast_dispatch_time": 0.028263951, 2024-04-15T00:31:36.311 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_messages_queue_lat": { 2024-04-15T00:31:36.311 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 1147, 2024-04-15T00:31:36.311 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.143011050, 2024-04-15T00:31:36.311 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000124682 2024-04-15T00:31:36.311 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.311 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_handle_ack_lat": { 2024-04-15T00:31:36.312 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-04-15T00:31:36.312 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-04-15T00:31:36.312 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-04-15T00:31:36.312 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.312 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_encrypted_bytes": 164240, 2024-04-15T00:31:36.313 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_encrypted_bytes": 110688 2024-04-15T00:31:36.313 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.313 INFO:teuthology.orchestra.run.smithi031.stdout: "AsyncMessenger::Worker-1": { 2024-04-15T00:31:36.313 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_messages": 12479, 2024-04-15T00:31:36.313 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_messages": 15083, 2024-04-15T00:31:36.313 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_bytes": 4068166, 2024-04-15T00:31:36.313 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_bytes": 7048656, 2024-04-15T00:31:36.313 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_created_connections": 11, 2024-04-15T00:31:36.314 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_active_connections": 6, 2024-04-15T00:31:36.314 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_total_time": 0.930313947, 2024-04-15T00:31:36.314 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_send_time": 0.434467032, 2024-04-15T00:31:36.314 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_recv_time": 0.577827265, 2024-04-15T00:31:36.314 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_fast_dispatch_time": 0.044555565, 2024-04-15T00:31:36.314 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_messages_queue_lat": { 2024-04-15T00:31:36.314 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 15082, 2024-04-15T00:31:36.315 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.457433015, 2024-04-15T00:31:36.315 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000030329 2024-04-15T00:31:36.315 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.315 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_handle_ack_lat": { 2024-04-15T00:31:36.315 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 25578, 2024-04-15T00:31:36.315 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.003919733, 2024-04-15T00:31:36.315 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000153 2024-04-15T00:31:36.316 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.316 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_encrypted_bytes": 160, 2024-04-15T00:31:36.316 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_encrypted_bytes": 313744 2024-04-15T00:31:36.316 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.316 INFO:teuthology.orchestra.run.smithi031.stdout: "AsyncMessenger::Worker-2": { 2024-04-15T00:31:36.316 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_messages": 1570, 2024-04-15T00:31:36.317 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_messages": 1570, 2024-04-15T00:31:36.317 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_bytes": 390524, 2024-04-15T00:31:36.317 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_bytes": 7410039, 2024-04-15T00:31:36.317 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_created_connections": 6, 2024-04-15T00:31:36.317 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_active_connections": 4, 2024-04-15T00:31:36.317 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_total_time": 0.122008341, 2024-04-15T00:31:36.317 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_send_time": 0.045576828, 2024-04-15T00:31:36.317 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_recv_time": 0.026630480, 2024-04-15T00:31:36.318 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_fast_dispatch_time": 0.041973033, 2024-04-15T00:31:36.318 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_messages_queue_lat": { 2024-04-15T00:31:36.318 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 1569, 2024-04-15T00:31:36.318 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.316888968, 2024-04-15T00:31:36.318 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000201968 2024-04-15T00:31:36.318 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.318 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_handle_ack_lat": { 2024-04-15T00:31:36.319 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-04-15T00:31:36.319 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-04-15T00:31:36.319 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-04-15T00:31:36.319 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.319 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-15T00:31:36.319 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_encrypted_bytes": 0 2024-04-15T00:31:36.319 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.320 INFO:teuthology.orchestra.run.smithi031.stdout: "cct": { 2024-04-15T00:31:36.320 INFO:teuthology.orchestra.run.smithi031.stdout: "total_workers": 1, 2024-04-15T00:31:36.320 INFO:teuthology.orchestra.run.smithi031.stdout: "unhealthy_workers": 0 2024-04-15T00:31:36.320 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.320 INFO:teuthology.orchestra.run.smithi031.stdout: "finisher-MDSRank": { 2024-04-15T00:31:36.320 INFO:teuthology.orchestra.run.smithi031.stdout: "queue_len": 0, 2024-04-15T00:31:36.320 INFO:teuthology.orchestra.run.smithi031.stdout: "complete_latency": { 2024-04-15T00:31:36.321 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 3612, 2024-04-15T00:31:36.321 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 1.847230575, 2024-04-15T00:31:36.321 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000511414 2024-04-15T00:31:36.321 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.321 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.321 INFO:teuthology.orchestra.run.smithi031.stdout: "finisher-PurgeQueue": { 2024-04-15T00:31:36.321 INFO:teuthology.orchestra.run.smithi031.stdout: "queue_len": 0, 2024-04-15T00:31:36.322 INFO:teuthology.orchestra.run.smithi031.stdout: "complete_latency": { 2024-04-15T00:31:36.322 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 615, 2024-04-15T00:31:36.322 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.063110420, 2024-04-15T00:31:36.322 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000102618 2024-04-15T00:31:36.322 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.322 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.322 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": { 2024-04-15T00:31:36.322 INFO:teuthology.orchestra.run.smithi031.stdout: "request": 7399, 2024-04-15T00:31:36.323 INFO:teuthology.orchestra.run.smithi031.stdout: "reply": 7399, 2024-04-15T00:31:36.323 INFO:teuthology.orchestra.run.smithi031.stdout: "reply_latency": { 2024-04-15T00:31:36.323 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 7399, 2024-04-15T00:31:36.323 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 7.990242928, 2024-04-15T00:31:36.324 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.001079908 2024-04-15T00:31:36.324 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.324 INFO:teuthology.orchestra.run.smithi031.stdout: "slow_reply": 0, 2024-04-15T00:31:36.324 INFO:teuthology.orchestra.run.smithi031.stdout: "forward": 0, 2024-04-15T00:31:36.324 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_fetch_complete": 0, 2024-04-15T00:31:36.324 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_fetch_keys": 0, 2024-04-15T00:31:36.324 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_commit": 21, 2024-04-15T00:31:36.325 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_split": 1, 2024-04-15T00:31:36.325 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_merge": 0, 2024-04-15T00:31:36.325 INFO:teuthology.orchestra.run.smithi031.stdout: "inodes": 664, 2024-04-15T00:31:36.325 INFO:teuthology.orchestra.run.smithi031.stdout: "inodes_top": 39, 2024-04-15T00:31:36.325 INFO:teuthology.orchestra.run.smithi031.stdout: "inodes_bottom": 625, 2024-04-15T00:31:36.325 INFO:teuthology.orchestra.run.smithi031.stdout: "inodes_pin_tail": 0, 2024-04-15T00:31:36.325 INFO:teuthology.orchestra.run.smithi031.stdout: "inodes_pinned": 609, 2024-04-15T00:31:36.325 INFO:teuthology.orchestra.run.smithi031.stdout: "inodes_expired": 0, 2024-04-15T00:31:36.325 INFO:teuthology.orchestra.run.smithi031.stdout: "inodes_with_caps": 404, 2024-04-15T00:31:36.326 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": 404, 2024-04-15T00:31:36.326 INFO:teuthology.orchestra.run.smithi031.stdout: "subtrees": 2, 2024-04-15T00:31:36.326 INFO:teuthology.orchestra.run.smithi031.stdout: "traverse": 13322, 2024-04-15T00:31:36.326 INFO:teuthology.orchestra.run.smithi031.stdout: "traverse_hit": 5117, 2024-04-15T00:31:36.326 INFO:teuthology.orchestra.run.smithi031.stdout: "traverse_forward": 0, 2024-04-15T00:31:36.326 INFO:teuthology.orchestra.run.smithi031.stdout: "traverse_discover": 0, 2024-04-15T00:31:36.326 INFO:teuthology.orchestra.run.smithi031.stdout: "traverse_dir_fetch": 0, 2024-04-15T00:31:36.327 INFO:teuthology.orchestra.run.smithi031.stdout: "traverse_remote_ino": 0, 2024-04-15T00:31:36.327 INFO:teuthology.orchestra.run.smithi031.stdout: "traverse_lock": 57, 2024-04-15T00:31:36.327 INFO:teuthology.orchestra.run.smithi031.stdout: "load_cent": 0, 2024-04-15T00:31:36.327 INFO:teuthology.orchestra.run.smithi031.stdout: "q": 0, 2024-04-15T00:31:36.327 INFO:teuthology.orchestra.run.smithi031.stdout: "exported": 0, 2024-04-15T00:31:36.327 INFO:teuthology.orchestra.run.smithi031.stdout: "exported_inodes": 0, 2024-04-15T00:31:36.327 INFO:teuthology.orchestra.run.smithi031.stdout: "imported": 0, 2024-04-15T00:31:36.328 INFO:teuthology.orchestra.run.smithi031.stdout: "imported_inodes": 0, 2024-04-15T00:31:36.328 INFO:teuthology.orchestra.run.smithi031.stdout: "openino_dir_fetch": 0, 2024-04-15T00:31:36.328 INFO:teuthology.orchestra.run.smithi031.stdout: "openino_backtrace_fetch": 0, 2024-04-15T00:31:36.328 INFO:teuthology.orchestra.run.smithi031.stdout: "openino_peer_discover": 0, 2024-04-15T00:31:36.328 INFO:teuthology.orchestra.run.smithi031.stdout: "root_rfiles": 320, 2024-04-15T00:31:36.328 INFO:teuthology.orchestra.run.smithi031.stdout: "root_rbytes": 13424233995, 2024-04-15T00:31:36.328 INFO:teuthology.orchestra.run.smithi031.stdout: "root_rsnaps": 0, 2024-04-15T00:31:36.328 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_backtrace_fetch": 0, 2024-04-15T00:31:36.329 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_set_tag": 0, 2024-04-15T00:31:36.329 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_backtrace_repaired": 0, 2024-04-15T00:31:36.329 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_inotable_repaired": 0, 2024-04-15T00:31:36.329 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_dir_inodes": 0, 2024-04-15T00:31:36.329 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_dir_base_inodes": 0, 2024-04-15T00:31:36.329 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_dirfrag_rstats": 0, 2024-04-15T00:31:36.329 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_file_inodes": 0, 2024-04-15T00:31:36.329 INFO:teuthology.orchestra.run.smithi031.stdout: "handle_inode_file_caps": 0, 2024-04-15T00:31:36.329 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_cap_op_revoke": 991, 2024-04-15T00:31:36.330 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_cap_op_grant": 2393, 2024-04-15T00:31:36.330 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_cap_op_trunc": 6, 2024-04-15T00:31:36.330 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-15T00:31:36.330 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-15T00:31:36.330 INFO:teuthology.orchestra.run.smithi031.stdout: "handle_client_caps": 3854, 2024-04-15T00:31:36.330 INFO:teuthology.orchestra.run.smithi031.stdout: "handle_client_caps_dirty": 2041, 2024-04-15T00:31:36.330 INFO:teuthology.orchestra.run.smithi031.stdout: "handle_client_cap_release": 18, 2024-04-15T00:31:36.330 INFO:teuthology.orchestra.run.smithi031.stdout: "process_request_cap_release": 2055 2024-04-15T00:31:36.331 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.331 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_cache": { 2024-04-15T00:31:36.331 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_update": 0, 2024-04-15T00:31:36.331 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_update_receipt": 0, 2024-04-15T00:31:36.331 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_try_discover": 0, 2024-04-15T00:31:36.331 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_send_discover": 0, 2024-04-15T00:31:36.331 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_handle_discover": 0, 2024-04-15T00:31:36.331 INFO:teuthology.orchestra.run.smithi031.stdout: "num_strays": 0, 2024-04-15T00:31:36.331 INFO:teuthology.orchestra.run.smithi031.stdout: "num_strays_delayed": 0, 2024-04-15T00:31:36.332 INFO:teuthology.orchestra.run.smithi031.stdout: "num_strays_enqueuing": 0, 2024-04-15T00:31:36.332 INFO:teuthology.orchestra.run.smithi031.stdout: "strays_created": 530, 2024-04-15T00:31:36.332 INFO:teuthology.orchestra.run.smithi031.stdout: "strays_enqueued": 469, 2024-04-15T00:31:36.332 INFO:teuthology.orchestra.run.smithi031.stdout: "strays_reintegrated": 61, 2024-04-15T00:31:36.332 INFO:teuthology.orchestra.run.smithi031.stdout: "strays_migrated": 0, 2024-04-15T00:31:36.332 INFO:teuthology.orchestra.run.smithi031.stdout: "num_recovering_processing": 0, 2024-04-15T00:31:36.332 INFO:teuthology.orchestra.run.smithi031.stdout: "num_recovering_enqueued": 0, 2024-04-15T00:31:36.332 INFO:teuthology.orchestra.run.smithi031.stdout: "num_recovering_prioritized": 0, 2024-04-15T00:31:36.332 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_started": 0, 2024-04-15T00:31:36.333 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_completed": 0, 2024-04-15T00:31:36.333 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_quiesce_path": 0, 2024-04-15T00:31:36.333 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_quiesce_inode": 0, 2024-04-15T00:31:36.333 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_enqueue_scrub": 0, 2024-04-15T00:31:36.333 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_exportdir": 0, 2024-04-15T00:31:36.334 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_flush": 0, 2024-04-15T00:31:36.334 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_fragmentdir": 1, 2024-04-15T00:31:36.334 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_fragstats": 0, 2024-04-15T00:31:36.334 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_inodestats": 0 2024-04-15T00:31:36.334 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.334 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_log": { 2024-04-15T00:31:36.334 INFO:teuthology.orchestra.run.smithi031.stdout: "evlrg": 0, 2024-04-15T00:31:36.335 INFO:teuthology.orchestra.run.smithi031.stdout: "evadd": 5045, 2024-04-15T00:31:36.335 INFO:teuthology.orchestra.run.smithi031.stdout: "evex": 0, 2024-04-15T00:31:36.335 INFO:teuthology.orchestra.run.smithi031.stdout: "evtrm": 0, 2024-04-15T00:31:36.335 INFO:teuthology.orchestra.run.smithi031.stdout: "ev": 5045, 2024-04-15T00:31:36.335 INFO:teuthology.orchestra.run.smithi031.stdout: "evexg": 0, 2024-04-15T00:31:36.335 INFO:teuthology.orchestra.run.smithi031.stdout: "evexd": 0, 2024-04-15T00:31:36.335 INFO:teuthology.orchestra.run.smithi031.stdout: "segadd": 7, 2024-04-15T00:31:36.335 INFO:teuthology.orchestra.run.smithi031.stdout: "segex": 0, 2024-04-15T00:31:36.335 INFO:teuthology.orchestra.run.smithi031.stdout: "segtrm": 0, 2024-04-15T00:31:36.336 INFO:teuthology.orchestra.run.smithi031.stdout: "seg": 7, 2024-04-15T00:31:36.336 INFO:teuthology.orchestra.run.smithi031.stdout: "segmjr": 2, 2024-04-15T00:31:36.336 INFO:teuthology.orchestra.run.smithi031.stdout: "segexg": 0, 2024-04-15T00:31:36.336 INFO:teuthology.orchestra.run.smithi031.stdout: "segexd": 0, 2024-04-15T00:31:36.336 INFO:teuthology.orchestra.run.smithi031.stdout: "expos": 4194304, 2024-04-15T00:31:36.336 INFO:teuthology.orchestra.run.smithi031.stdout: "wrpos": 15531222, 2024-04-15T00:31:36.336 INFO:teuthology.orchestra.run.smithi031.stdout: "rdpos": 0, 2024-04-15T00:31:36.336 INFO:teuthology.orchestra.run.smithi031.stdout: "jlat": { 2024-04-15T00:31:36.337 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 1720, 2024-04-15T00:31:36.337 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 7.727822818, 2024-04-15T00:31:36.337 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.004492920 2024-04-15T00:31:36.337 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.337 INFO:teuthology.orchestra.run.smithi031.stdout: "replayed": 0 2024-04-15T00:31:36.337 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.337 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_mem": { 2024-04-15T00:31:36.337 INFO:teuthology.orchestra.run.smithi031.stdout: "ino": 416, 2024-04-15T00:31:36.337 INFO:teuthology.orchestra.run.smithi031.stdout: "ino+": 885, 2024-04-15T00:31:36.338 INFO:teuthology.orchestra.run.smithi031.stdout: "ino-": 469, 2024-04-15T00:31:36.338 INFO:teuthology.orchestra.run.smithi031.stdout: "dir": 102, 2024-04-15T00:31:36.338 INFO:teuthology.orchestra.run.smithi031.stdout: "dir+": 119, 2024-04-15T00:31:36.338 INFO:teuthology.orchestra.run.smithi031.stdout: "dir-": 17, 2024-04-15T00:31:36.338 INFO:teuthology.orchestra.run.smithi031.stdout: "dn": 664, 2024-04-15T00:31:36.338 INFO:teuthology.orchestra.run.smithi031.stdout: "dn+": 1374, 2024-04-15T00:31:36.338 INFO:teuthology.orchestra.run.smithi031.stdout: "dn-": 710, 2024-04-15T00:31:36.338 INFO:teuthology.orchestra.run.smithi031.stdout: "cap": 404, 2024-04-15T00:31:36.338 INFO:teuthology.orchestra.run.smithi031.stdout: "cap+": 874, 2024-04-15T00:31:36.339 INFO:teuthology.orchestra.run.smithi031.stdout: "cap-": 470, 2024-04-15T00:31:36.339 INFO:teuthology.orchestra.run.smithi031.stdout: "rss": 61808, 2024-04-15T00:31:36.339 INFO:teuthology.orchestra.run.smithi031.stdout: "heap": 231784 2024-04-15T00:31:36.339 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.339 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_server": { 2024-04-15T00:31:36.339 INFO:teuthology.orchestra.run.smithi031.stdout: "dispatch_client_request": 7892, 2024-04-15T00:31:36.339 INFO:teuthology.orchestra.run.smithi031.stdout: "dispatch_server_request": 0, 2024-04-15T00:31:36.339 INFO:teuthology.orchestra.run.smithi031.stdout: "handle_client_request": 7399, 2024-04-15T00:31:36.340 INFO:teuthology.orchestra.run.smithi031.stdout: "handle_client_session": 36, 2024-04-15T00:31:36.340 INFO:teuthology.orchestra.run.smithi031.stdout: "handle_peer_request": 0, 2024-04-15T00:31:36.340 INFO:teuthology.orchestra.run.smithi031.stdout: "req_create_latency": { 2024-04-15T00:31:36.340 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 760, 2024-04-15T00:31:36.340 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.605197770, 2024-04-15T00:31:36.340 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000796312 2024-04-15T00:31:36.340 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.340 INFO:teuthology.orchestra.run.smithi031.stdout: "req_getattr_latency": { 2024-04-15T00:31:36.340 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 736, 2024-04-15T00:31:36.341 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.133617342, 2024-04-15T00:31:36.341 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000181545 2024-04-15T00:31:36.341 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.341 INFO:teuthology.orchestra.run.smithi031.stdout: "req_getfilelock_latency": { 2024-04-15T00:31:36.341 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-04-15T00:31:36.341 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-04-15T00:31:36.341 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-04-15T00:31:36.341 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.342 INFO:teuthology.orchestra.run.smithi031.stdout: "req_link_latency": { 2024-04-15T00:31:36.342 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 61, 2024-04-15T00:31:36.342 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.110505265, 2024-04-15T00:31:36.342 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.001811561 2024-04-15T00:31:36.342 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.342 INFO:teuthology.orchestra.run.smithi031.stdout: "req_lookup_latency": { 2024-04-15T00:31:36.342 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 4766, 2024-04-15T00:31:36.342 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.944159995, 2024-04-15T00:31:36.342 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000198103 2024-04-15T00:31:36.343 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.343 INFO:teuthology.orchestra.run.smithi031.stdout: "req_lookuphash_latency": { 2024-04-15T00:31:36.343 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-04-15T00:31:36.343 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-04-15T00:31:36.343 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-04-15T00:31:36.343 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.343 INFO:teuthology.orchestra.run.smithi031.stdout: "req_lookupino_latency": { 2024-04-15T00:31:36.344 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-04-15T00:31:36.344 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-04-15T00:31:36.344 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-04-15T00:31:36.344 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.344 INFO:teuthology.orchestra.run.smithi031.stdout: "req_lookupname_latency": { 2024-04-15T00:31:36.344 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-04-15T00:31:36.345 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-04-15T00:31:36.345 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-04-15T00:31:36.345 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.345 INFO:teuthology.orchestra.run.smithi031.stdout: "req_lookupparent_latency": { 2024-04-15T00:31:36.345 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-04-15T00:31:36.345 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-04-15T00:31:36.345 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-04-15T00:31:36.345 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.345 INFO:teuthology.orchestra.run.smithi031.stdout: "req_lookupsnap_latency": { 2024-04-15T00:31:36.346 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-04-15T00:31:36.346 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-04-15T00:31:36.346 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-04-15T00:31:36.346 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.346 INFO:teuthology.orchestra.run.smithi031.stdout: "req_lssnap_latency": { 2024-04-15T00:31:36.346 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-04-15T00:31:36.346 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-04-15T00:31:36.346 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-04-15T00:31:36.347 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.347 INFO:teuthology.orchestra.run.smithi031.stdout: "req_mkdir_latency": { 2024-04-15T00:31:36.347 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 99, 2024-04-15T00:31:36.347 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.077281413, 2024-04-15T00:31:36.347 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000780620 2024-04-15T00:31:36.347 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.347 INFO:teuthology.orchestra.run.smithi031.stdout: "req_mknod_latency": { 2024-04-15T00:31:36.347 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-04-15T00:31:36.347 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-04-15T00:31:36.348 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-04-15T00:31:36.348 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.348 INFO:teuthology.orchestra.run.smithi031.stdout: "req_mksnap_latency": { 2024-04-15T00:31:36.348 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-04-15T00:31:36.348 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-04-15T00:31:36.348 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-04-15T00:31:36.348 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.348 INFO:teuthology.orchestra.run.smithi031.stdout: "req_open_latency": { 2024-04-15T00:31:36.349 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 189, 2024-04-15T00:31:36.349 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.369935921, 2024-04-15T00:31:36.349 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.001957332 2024-04-15T00:31:36.349 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.349 INFO:teuthology.orchestra.run.smithi031.stdout: "req_readdir_latency": { 2024-04-15T00:31:36.349 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 158, 2024-04-15T00:31:36.349 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.496022302, 2024-04-15T00:31:36.349 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.003139381 2024-04-15T00:31:36.349 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.350 INFO:teuthology.orchestra.run.smithi031.stdout: "req_rename_latency": { 2024-04-15T00:31:36.350 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 111, 2024-04-15T00:31:36.350 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 4.611580385, 2024-04-15T00:31:36.350 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.041545769 2024-04-15T00:31:36.350 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.350 INFO:teuthology.orchestra.run.smithi031.stdout: "req_renamesnap_latency": { 2024-04-15T00:31:36.350 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-04-15T00:31:36.350 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-04-15T00:31:36.351 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-04-15T00:31:36.351 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.351 INFO:teuthology.orchestra.run.smithi031.stdout: "req_snapdiff_latency": { 2024-04-15T00:31:36.351 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-04-15T00:31:36.351 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-04-15T00:31:36.351 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-04-15T00:31:36.351 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.351 INFO:teuthology.orchestra.run.smithi031.stdout: "req_rmdir_latency": { 2024-04-15T00:31:36.351 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 16, 2024-04-15T00:31:36.352 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.092160041, 2024-04-15T00:31:36.352 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.005760002 2024-04-15T00:31:36.352 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.352 INFO:teuthology.orchestra.run.smithi031.stdout: "req_rmsnap_latency": { 2024-04-15T00:31:36.352 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-04-15T00:31:36.352 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-04-15T00:31:36.352 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-04-15T00:31:36.352 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.352 INFO:teuthology.orchestra.run.smithi031.stdout: "req_rmxattr_latency": { 2024-04-15T00:31:36.353 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-04-15T00:31:36.353 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-04-15T00:31:36.353 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-04-15T00:31:36.353 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.353 INFO:teuthology.orchestra.run.smithi031.stdout: "req_setattr_latency": { 2024-04-15T00:31:36.353 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 4, 2024-04-15T00:31:36.353 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.002071428, 2024-04-15T00:31:36.353 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000517857 2024-04-15T00:31:36.353 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.354 INFO:teuthology.orchestra.run.smithi031.stdout: "req_setdirlayout_latency": { 2024-04-15T00:31:36.354 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-04-15T00:31:36.354 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-04-15T00:31:36.354 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-04-15T00:31:36.354 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.354 INFO:teuthology.orchestra.run.smithi031.stdout: "req_setfilelock_latency": { 2024-04-15T00:31:36.354 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 4, 2024-04-15T00:31:36.354 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000899846, 2024-04-15T00:31:36.355 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000224961 2024-04-15T00:31:36.355 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.355 INFO:teuthology.orchestra.run.smithi031.stdout: "req_setlayout_latency": { 2024-04-15T00:31:36.355 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-04-15T00:31:36.355 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-04-15T00:31:36.355 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-04-15T00:31:36.355 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.355 INFO:teuthology.orchestra.run.smithi031.stdout: "req_setxattr_latency": { 2024-04-15T00:31:36.355 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 1, 2024-04-15T00:31:36.356 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.002187019, 2024-04-15T00:31:36.356 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.002187019 2024-04-15T00:31:36.356 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.356 INFO:teuthology.orchestra.run.smithi031.stdout: "req_symlink_latency": { 2024-04-15T00:31:36.356 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 13, 2024-04-15T00:31:36.356 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.012265759, 2024-04-15T00:31:36.356 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000943519 2024-04-15T00:31:36.356 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.357 INFO:teuthology.orchestra.run.smithi031.stdout: "req_unlink_latency": { 2024-04-15T00:31:36.357 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 481, 2024-04-15T00:31:36.357 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.532358442, 2024-04-15T00:31:36.357 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.001106774 2024-04-15T00:31:36.357 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.357 INFO:teuthology.orchestra.run.smithi031.stdout: "cap_revoke_eviction": 0, 2024-04-15T00:31:36.357 INFO:teuthology.orchestra.run.smithi031.stdout: "cap_acquisition_throttle": 0, 2024-04-15T00:31:36.357 INFO:teuthology.orchestra.run.smithi031.stdout: "req_getvxattr_latency": { 2024-04-15T00:31:36.357 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-04-15T00:31:36.358 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-04-15T00:31:36.358 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-04-15T00:31:36.358 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.358 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.358 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_sessions": { 2024-04-15T00:31:36.358 INFO:teuthology.orchestra.run.smithi031.stdout: "session_count": 1, 2024-04-15T00:31:36.358 INFO:teuthology.orchestra.run.smithi031.stdout: "session_add": 2, 2024-04-15T00:31:36.358 INFO:teuthology.orchestra.run.smithi031.stdout: "session_remove": 1, 2024-04-15T00:31:36.359 INFO:teuthology.orchestra.run.smithi031.stdout: "sessions_open": 1, 2024-04-15T00:31:36.359 INFO:teuthology.orchestra.run.smithi031.stdout: "sessions_stale": 0, 2024-04-15T00:31:36.359 INFO:teuthology.orchestra.run.smithi031.stdout: "total_load": 145, 2024-04-15T00:31:36.359 INFO:teuthology.orchestra.run.smithi031.stdout: "average_load": 145, 2024-04-15T00:31:36.359 INFO:teuthology.orchestra.run.smithi031.stdout: "avg_session_uptime": 594, 2024-04-15T00:31:36.359 INFO:teuthology.orchestra.run.smithi031.stdout: "mdthresh_evicted": 0 2024-04-15T00:31:36.359 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.359 INFO:teuthology.orchestra.run.smithi031.stdout: "mempool": { 2024-04-15T00:31:36.359 INFO:teuthology.orchestra.run.smithi031.stdout: "bloom_filter_bytes": 0, 2024-04-15T00:31:36.360 INFO:teuthology.orchestra.run.smithi031.stdout: "bloom_filter_items": 0, 2024-04-15T00:31:36.360 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_alloc_bytes": 0, 2024-04-15T00:31:36.360 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_alloc_items": 0, 2024-04-15T00:31:36.360 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_data_bytes": 0, 2024-04-15T00:31:36.360 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_data_items": 0, 2024-04-15T00:31:36.360 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-15T00:31:36.360 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_onode_items": 0, 2024-04-15T00:31:36.360 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-15T00:31:36.360 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_meta_items": 0, 2024-04-15T00:31:36.361 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_other_bytes": 0, 2024-04-15T00:31:36.361 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_other_items": 0, 2024-04-15T00:31:36.361 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-15T00:31:36.361 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_buffer_items": 0, 2024-04-15T00:31:36.361 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_extent_bytes": 0, 2024-04-15T00:31:36.361 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_extent_items": 0, 2024-04-15T00:31:36.361 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_blob_bytes": 0, 2024-04-15T00:31:36.361 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_blob_items": 0, 2024-04-15T00:31:36.362 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-15T00:31:36.362 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_shared_blob_items": 0, 2024-04-15T00:31:36.362 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-15T00:31:36.362 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_inline_bl_items": 0, 2024-04-15T00:31:36.362 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_fsck_bytes": 0, 2024-04-15T00:31:36.362 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_fsck_items": 0, 2024-04-15T00:31:36.362 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_txc_bytes": 0, 2024-04-15T00:31:36.362 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_txc_items": 0, 2024-04-15T00:31:36.362 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-15T00:31:36.363 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_writing_deferred_items": 0, 2024-04-15T00:31:36.363 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_writing_bytes": 0, 2024-04-15T00:31:36.363 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_writing_items": 0, 2024-04-15T00:31:36.363 INFO:teuthology.orchestra.run.smithi031.stdout: "bluefs_bytes": 0, 2024-04-15T00:31:36.363 INFO:teuthology.orchestra.run.smithi031.stdout: "bluefs_items": 0, 2024-04-15T00:31:36.364 INFO:teuthology.orchestra.run.smithi031.stdout: "bluefs_file_reader_bytes": 0, 2024-04-15T00:31:36.364 INFO:teuthology.orchestra.run.smithi031.stdout: "bluefs_file_reader_items": 0, 2024-04-15T00:31:36.364 INFO:teuthology.orchestra.run.smithi031.stdout: "bluefs_file_writer_bytes": 0, 2024-04-15T00:31:36.364 INFO:teuthology.orchestra.run.smithi031.stdout: "bluefs_file_writer_items": 0, 2024-04-15T00:31:36.364 INFO:teuthology.orchestra.run.smithi031.stdout: "buffer_anon_bytes": 764253, 2024-04-15T00:31:36.364 INFO:teuthology.orchestra.run.smithi031.stdout: "buffer_anon_items": 222, 2024-04-15T00:31:36.364 INFO:teuthology.orchestra.run.smithi031.stdout: "buffer_meta_bytes": 0, 2024-04-15T00:31:36.365 INFO:teuthology.orchestra.run.smithi031.stdout: "buffer_meta_items": 0, 2024-04-15T00:31:36.365 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_bytes": 0, 2024-04-15T00:31:36.365 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_items": 0, 2024-04-15T00:31:36.365 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_mapbl_bytes": 0, 2024-04-15T00:31:36.365 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_mapbl_items": 0, 2024-04-15T00:31:36.365 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_pglog_bytes": 0, 2024-04-15T00:31:36.365 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_pglog_items": 0, 2024-04-15T00:31:36.366 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_bytes": 6960, 2024-04-15T00:31:36.366 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_items": 93, 2024-04-15T00:31:36.366 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_mapping_bytes": 0, 2024-04-15T00:31:36.366 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_mapping_items": 0, 2024-04-15T00:31:36.366 INFO:teuthology.orchestra.run.smithi031.stdout: "pgmap_bytes": 0, 2024-04-15T00:31:36.366 INFO:teuthology.orchestra.run.smithi031.stdout: "pgmap_items": 0, 2024-04-15T00:31:36.366 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_co_bytes": 1686118, 2024-04-15T00:31:36.367 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_co_items": 17043, 2024-04-15T00:31:36.367 INFO:teuthology.orchestra.run.smithi031.stdout: "unittest_1_bytes": 0, 2024-04-15T00:31:36.367 INFO:teuthology.orchestra.run.smithi031.stdout: "unittest_1_items": 0, 2024-04-15T00:31:36.367 INFO:teuthology.orchestra.run.smithi031.stdout: "unittest_2_bytes": 0, 2024-04-15T00:31:36.367 INFO:teuthology.orchestra.run.smithi031.stdout: "unittest_2_items": 0 2024-04-15T00:31:36.367 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.367 INFO:teuthology.orchestra.run.smithi031.stdout: "objecter": { 2024-04-15T00:31:36.367 INFO:teuthology.orchestra.run.smithi031.stdout: "op_active": 0, 2024-04-15T00:31:36.367 INFO:teuthology.orchestra.run.smithi031.stdout: "op_laggy": 0, 2024-04-15T00:31:36.368 INFO:teuthology.orchestra.run.smithi031.stdout: "op_send": 3134, 2024-04-15T00:31:36.368 INFO:teuthology.orchestra.run.smithi031.stdout: "op_send_bytes": 11497428, 2024-04-15T00:31:36.368 INFO:teuthology.orchestra.run.smithi031.stdout: "op_resend": 25, 2024-04-15T00:31:36.368 INFO:teuthology.orchestra.run.smithi031.stdout: "op_reply": 3134, 2024-04-15T00:31:36.368 INFO:teuthology.orchestra.run.smithi031.stdout: "op_latency": { 2024-04-15T00:31:36.368 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 3134, 2024-04-15T00:31:36.368 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 14.082772107, 2024-04-15T00:31:36.368 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.004493545 2024-04-15T00:31:36.368 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.369 INFO:teuthology.orchestra.run.smithi031.stdout: "op_inflight": 0, 2024-04-15T00:31:36.369 INFO:teuthology.orchestra.run.smithi031.stdout: "oplen_avg": { 2024-04-15T00:31:36.369 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 3134, 2024-04-15T00:31:36.369 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 3512 2024-04-15T00:31:36.369 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.369 INFO:teuthology.orchestra.run.smithi031.stdout: "op": 3134, 2024-04-15T00:31:36.369 INFO:teuthology.orchestra.run.smithi031.stdout: "op_r": 36, 2024-04-15T00:31:36.369 INFO:teuthology.orchestra.run.smithi031.stdout: "op_w": 3098, 2024-04-15T00:31:36.370 INFO:teuthology.orchestra.run.smithi031.stdout: "op_rmw": 0, 2024-04-15T00:31:36.370 INFO:teuthology.orchestra.run.smithi031.stdout: "op_pg": 0, 2024-04-15T00:31:36.370 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_stat": 0, 2024-04-15T00:31:36.370 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_create": 11, 2024-04-15T00:31:36.370 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_read": 36, 2024-04-15T00:31:36.370 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_write": 1756, 2024-04-15T00:31:36.370 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_writefull": 60, 2024-04-15T00:31:36.370 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_writesame": 0, 2024-04-15T00:31:36.371 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_append": 0, 2024-04-15T00:31:36.371 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_zero": 0, 2024-04-15T00:31:36.371 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_truncate": 1, 2024-04-15T00:31:36.371 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_delete": 923, 2024-04-15T00:31:36.371 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_mapext": 0, 2024-04-15T00:31:36.371 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_sparse_read": 0, 2024-04-15T00:31:36.371 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_clonerange": 0, 2024-04-15T00:31:36.371 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_getxattr": 0, 2024-04-15T00:31:36.371 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_setxattr": 22, 2024-04-15T00:31:36.372 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_cmpxattr": 0, 2024-04-15T00:31:36.372 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_rmxattr": 0, 2024-04-15T00:31:36.372 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_resetxattrs": 0, 2024-04-15T00:31:36.372 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_call": 0, 2024-04-15T00:31:36.372 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_watch": 0, 2024-04-15T00:31:36.372 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_notify": 0, 2024-04-15T00:31:36.373 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_src_cmpxattr": 0, 2024-04-15T00:31:36.373 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_pgls": 0, 2024-04-15T00:31:36.373 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_pgls_filter": 0, 2024-04-15T00:31:36.373 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_other": 6, 2024-04-15T00:31:36.373 INFO:teuthology.orchestra.run.smithi031.stdout: "linger_active": 0, 2024-04-15T00:31:36.373 INFO:teuthology.orchestra.run.smithi031.stdout: "linger_send": 0, 2024-04-15T00:31:36.373 INFO:teuthology.orchestra.run.smithi031.stdout: "linger_resend": 0, 2024-04-15T00:31:36.374 INFO:teuthology.orchestra.run.smithi031.stdout: "linger_ping": 0, 2024-04-15T00:31:36.374 INFO:teuthology.orchestra.run.smithi031.stdout: "poolop_active": 0, 2024-04-15T00:31:36.374 INFO:teuthology.orchestra.run.smithi031.stdout: "poolop_send": 0, 2024-04-15T00:31:36.374 INFO:teuthology.orchestra.run.smithi031.stdout: "poolop_resend": 0, 2024-04-15T00:31:36.374 INFO:teuthology.orchestra.run.smithi031.stdout: "poolstat_active": 0, 2024-04-15T00:31:36.374 INFO:teuthology.orchestra.run.smithi031.stdout: "poolstat_send": 0, 2024-04-15T00:31:36.374 INFO:teuthology.orchestra.run.smithi031.stdout: "poolstat_resend": 0, 2024-04-15T00:31:36.374 INFO:teuthology.orchestra.run.smithi031.stdout: "statfs_active": 0, 2024-04-15T00:31:36.374 INFO:teuthology.orchestra.run.smithi031.stdout: "statfs_send": 0, 2024-04-15T00:31:36.375 INFO:teuthology.orchestra.run.smithi031.stdout: "statfs_resend": 0, 2024-04-15T00:31:36.375 INFO:teuthology.orchestra.run.smithi031.stdout: "command_active": 0, 2024-04-15T00:31:36.375 INFO:teuthology.orchestra.run.smithi031.stdout: "command_send": 0, 2024-04-15T00:31:36.375 INFO:teuthology.orchestra.run.smithi031.stdout: "command_resend": 0, 2024-04-15T00:31:36.375 INFO:teuthology.orchestra.run.smithi031.stdout: "map_epoch": 27, 2024-04-15T00:31:36.375 INFO:teuthology.orchestra.run.smithi031.stdout: "map_full": 0, 2024-04-15T00:31:36.375 INFO:teuthology.orchestra.run.smithi031.stdout: "map_inc": 7, 2024-04-15T00:31:36.375 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_sessions": 8, 2024-04-15T00:31:36.375 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_session_open": 8, 2024-04-15T00:31:36.376 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_session_close": 0, 2024-04-15T00:31:36.376 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_laggy": 0, 2024-04-15T00:31:36.376 INFO:teuthology.orchestra.run.smithi031.stdout: "omap_wr": 529, 2024-04-15T00:31:36.376 INFO:teuthology.orchestra.run.smithi031.stdout: "omap_rd": 0, 2024-04-15T00:31:36.376 INFO:teuthology.orchestra.run.smithi031.stdout: "omap_del": 168 2024-04-15T00:31:36.376 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.376 INFO:teuthology.orchestra.run.smithi031.stdout: "oft": { 2024-04-15T00:31:36.376 INFO:teuthology.orchestra.run.smithi031.stdout: "omap_total_objs": 1, 2024-04-15T00:31:36.376 INFO:teuthology.orchestra.run.smithi031.stdout: "omap_total_kv_pairs": 0, 2024-04-15T00:31:36.377 INFO:teuthology.orchestra.run.smithi031.stdout: "omap_total_updates": 0, 2024-04-15T00:31:36.377 INFO:teuthology.orchestra.run.smithi031.stdout: "omap_total_removes": 0 2024-04-15T00:31:36.377 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.377 INFO:teuthology.orchestra.run.smithi031.stdout: "osd-slow-ops": { 2024-04-15T00:31:36.377 INFO:teuthology.orchestra.run.smithi031.stdout: "slow_ops_count": 0 2024-04-15T00:31:36.377 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.377 INFO:teuthology.orchestra.run.smithi031.stdout: "purge_queue": { 2024-04-15T00:31:36.377 INFO:teuthology.orchestra.run.smithi031.stdout: "pq_executing_ops": 0, 2024-04-15T00:31:36.377 INFO:teuthology.orchestra.run.smithi031.stdout: "pq_executing_ops_high_water": 49, 2024-04-15T00:31:36.378 INFO:teuthology.orchestra.run.smithi031.stdout: "pq_executing": 0, 2024-04-15T00:31:36.378 INFO:teuthology.orchestra.run.smithi031.stdout: "pq_executing_high_water": 28, 2024-04-15T00:31:36.378 INFO:teuthology.orchestra.run.smithi031.stdout: "pq_executed_ops": 909, 2024-04-15T00:31:36.378 INFO:teuthology.orchestra.run.smithi031.stdout: "pq_executed": 469, 2024-04-15T00:31:36.378 INFO:teuthology.orchestra.run.smithi031.stdout: "pq_item_in_journal": 0 2024-04-15T00:31:36.378 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.378 INFO:teuthology.orchestra.run.smithi031.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-15T00:31:36.378 INFO:teuthology.orchestra.run.smithi031.stdout: "val": 0, 2024-04-15T00:31:36.379 INFO:teuthology.orchestra.run.smithi031.stdout: "max": 104857600, 2024-04-15T00:31:36.379 INFO:teuthology.orchestra.run.smithi031.stdout: "get_started": 0, 2024-04-15T00:31:36.379 INFO:teuthology.orchestra.run.smithi031.stdout: "get": 15196, 2024-04-15T00:31:36.379 INFO:teuthology.orchestra.run.smithi031.stdout: "get_sum": 3526921, 2024-04-15T00:31:36.379 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_fail": 0, 2024-04-15T00:31:36.379 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_success": 15196, 2024-04-15T00:31:36.379 INFO:teuthology.orchestra.run.smithi031.stdout: "take": 0, 2024-04-15T00:31:36.379 INFO:teuthology.orchestra.run.smithi031.stdout: "take_sum": 0, 2024-04-15T00:31:36.379 INFO:teuthology.orchestra.run.smithi031.stdout: "put": 15196, 2024-04-15T00:31:36.380 INFO:teuthology.orchestra.run.smithi031.stdout: "put_sum": 3526921, 2024-04-15T00:31:36.380 INFO:teuthology.orchestra.run.smithi031.stdout: "wait": { 2024-04-15T00:31:36.380 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-04-15T00:31:36.380 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-04-15T00:31:36.380 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-04-15T00:31:36.380 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.380 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.380 INFO:teuthology.orchestra.run.smithi031.stdout: "throttle-objecter_bytes": { 2024-04-15T00:31:36.380 INFO:teuthology.orchestra.run.smithi031.stdout: "val": 0, 2024-04-15T00:31:36.381 INFO:teuthology.orchestra.run.smithi031.stdout: "max": 104857600, 2024-04-15T00:31:36.381 INFO:teuthology.orchestra.run.smithi031.stdout: "get_started": 0, 2024-04-15T00:31:36.381 INFO:teuthology.orchestra.run.smithi031.stdout: "get": 0, 2024-04-15T00:31:36.381 INFO:teuthology.orchestra.run.smithi031.stdout: "get_sum": 0, 2024-04-15T00:31:36.381 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_fail": 0, 2024-04-15T00:31:36.381 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_success": 0, 2024-04-15T00:31:36.381 INFO:teuthology.orchestra.run.smithi031.stdout: "take": 3134, 2024-04-15T00:31:36.381 INFO:teuthology.orchestra.run.smithi031.stdout: "take_sum": 11548317, 2024-04-15T00:31:36.382 INFO:teuthology.orchestra.run.smithi031.stdout: "put": 3134, 2024-04-15T00:31:36.382 INFO:teuthology.orchestra.run.smithi031.stdout: "put_sum": 11548317, 2024-04-15T00:31:36.382 INFO:teuthology.orchestra.run.smithi031.stdout: "wait": { 2024-04-15T00:31:36.382 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-04-15T00:31:36.382 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-04-15T00:31:36.382 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-04-15T00:31:36.382 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.382 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.382 INFO:teuthology.orchestra.run.smithi031.stdout: "throttle-objecter_ops": { 2024-04-15T00:31:36.383 INFO:teuthology.orchestra.run.smithi031.stdout: "val": 0, 2024-04-15T00:31:36.383 INFO:teuthology.orchestra.run.smithi031.stdout: "max": 1024, 2024-04-15T00:31:36.383 INFO:teuthology.orchestra.run.smithi031.stdout: "get_started": 0, 2024-04-15T00:31:36.383 INFO:teuthology.orchestra.run.smithi031.stdout: "get": 0, 2024-04-15T00:31:36.383 INFO:teuthology.orchestra.run.smithi031.stdout: "get_sum": 0, 2024-04-15T00:31:36.383 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_fail": 0, 2024-04-15T00:31:36.383 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_success": 0, 2024-04-15T00:31:36.383 INFO:teuthology.orchestra.run.smithi031.stdout: "take": 3134, 2024-04-15T00:31:36.384 INFO:teuthology.orchestra.run.smithi031.stdout: "take_sum": 3134, 2024-04-15T00:31:36.384 INFO:teuthology.orchestra.run.smithi031.stdout: "put": 3134, 2024-04-15T00:31:36.384 INFO:teuthology.orchestra.run.smithi031.stdout: "put_sum": 3134, 2024-04-15T00:31:36.384 INFO:teuthology.orchestra.run.smithi031.stdout: "wait": { 2024-04-15T00:31:36.384 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-04-15T00:31:36.384 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-04-15T00:31:36.384 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-04-15T00:31:36.384 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.384 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.385 INFO:teuthology.orchestra.run.smithi031.stdout: "throttle-write_buf_throttle": { 2024-04-15T00:31:36.385 INFO:teuthology.orchestra.run.smithi031.stdout: "val": 0, 2024-04-15T00:31:36.385 INFO:teuthology.orchestra.run.smithi031.stdout: "max": 3758096384, 2024-04-15T00:31:36.385 INFO:teuthology.orchestra.run.smithi031.stdout: "get_started": 0, 2024-04-15T00:31:36.385 INFO:teuthology.orchestra.run.smithi031.stdout: "get": 469, 2024-04-15T00:31:36.385 INFO:teuthology.orchestra.run.smithi031.stdout: "get_sum": 50889, 2024-04-15T00:31:36.385 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_fail": 0, 2024-04-15T00:31:36.385 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_success": 469, 2024-04-15T00:31:36.385 INFO:teuthology.orchestra.run.smithi031.stdout: "take": 0, 2024-04-15T00:31:36.386 INFO:teuthology.orchestra.run.smithi031.stdout: "take_sum": 0, 2024-04-15T00:31:36.386 INFO:teuthology.orchestra.run.smithi031.stdout: "put": 36, 2024-04-15T00:31:36.386 INFO:teuthology.orchestra.run.smithi031.stdout: "put_sum": 50889, 2024-04-15T00:31:36.386 INFO:teuthology.orchestra.run.smithi031.stdout: "wait": { 2024-04-15T00:31:36.386 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-04-15T00:31:36.386 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-04-15T00:31:36.386 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-04-15T00:31:36.386 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.387 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-15T00:31:36.387 INFO:teuthology.orchestra.run.smithi031.stdout: "throttle-write_buf_throttle-0x5608db5aa500": { 2024-04-15T00:31:36.387 INFO:teuthology.orchestra.run.smithi031.stdout: "val": 70190, 2024-04-15T00:31:36.387 INFO:teuthology.orchestra.run.smithi031.stdout: "max": 3758096384, 2024-04-15T00:31:36.387 INFO:teuthology.orchestra.run.smithi031.stdout: "get_started": 0, 2024-04-15T00:31:36.387 INFO:teuthology.orchestra.run.smithi031.stdout: "get": 5045, 2024-04-15T00:31:36.387 INFO:teuthology.orchestra.run.smithi031.stdout: "get_sum": 11336918, 2024-04-15T00:31:36.387 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_fail": 0, 2024-04-15T00:31:36.387 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_success": 5045, 2024-04-15T00:31:36.388 INFO:teuthology.orchestra.run.smithi031.stdout: "take": 0, 2024-04-15T00:31:36.388 INFO:teuthology.orchestra.run.smithi031.stdout: "take_sum": 0, 2024-04-15T00:31:36.388 INFO:teuthology.orchestra.run.smithi031.stdout: "put": 1720, 2024-04-15T00:31:36.388 INFO:teuthology.orchestra.run.smithi031.stdout: "put_sum": 11266728, 2024-04-15T00:31:36.388 INFO:teuthology.orchestra.run.smithi031.stdout: "wait": { 2024-04-15T00:31:36.388 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-04-15T00:31:36.388 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-04-15T00:31:36.388 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-04-15T00:31:36.388 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.389 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-15T00:31:36.389 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-15T00:31:36.390 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=1 2024-04-15T00:31:36.390 DEBUG:tasks.check_counter:Getting stats from b 2024-04-15T00:31:36.391 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump 2024-04-15T00:31:36.513 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-04-15T00:31:36.513 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-0": { 2024-04-15T00:31:36.513 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 171, 2024-04-15T00:31:36.513 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 170, 2024-04-15T00:31:36.514 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 139824, 2024-04-15T00:31:36.514 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 104787, 2024-04-15T00:31:36.514 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 4, 2024-04-15T00:31:36.514 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 0, 2024-04-15T00:31:36.514 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.025735759, 2024-04-15T00:31:36.514 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.010900186, 2024-04-15T00:31:36.514 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.007333543, 2024-04-15T00:31:36.514 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.003792825, 2024-04-15T00:31:36.515 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-04-15T00:31:36.515 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 170, 2024-04-15T00:31:36.515 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.008374171, 2024-04-15T00:31:36.515 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000049259 2024-04-15T00:31:36.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-04-15T00:31:36.515 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-04-15T00:31:36.515 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-04-15T00:31:36.515 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-04-15T00:31:36.515 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-04-15T00:31:36.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-04-15T00:31:36.516 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 139824, 2024-04-15T00:31:36.516 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 104656 2024-04-15T00:31:36.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-04-15T00:31:36.516 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-1": { 2024-04-15T00:31:36.516 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 5, 2024-04-15T00:31:36.516 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 132, 2024-04-15T00:31:36.516 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 1728, 2024-04-15T00:31:36.517 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 100896, 2024-04-15T00:31:36.517 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 3, 2024-04-15T00:31:36.517 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 2, 2024-04-15T00:31:36.517 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.010876923, 2024-04-15T00:31:36.517 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.006292826, 2024-04-15T00:31:36.517 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.003047222, 2024-04-15T00:31:36.517 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-15T00:31:36.517 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-04-15T00:31:36.517 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 131, 2024-04-15T00:31:36.518 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.011185391, 2024-04-15T00:31:36.518 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000085384 2024-04-15T00:31:36.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-04-15T00:31:36.518 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-04-15T00:31:36.518 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-04-15T00:31:36.518 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-04-15T00:31:36.518 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-04-15T00:31:36.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-04-15T00:31:36.518 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 1728, 2024-04-15T00:31:36.519 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 100896 2024-04-15T00:31:36.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-04-15T00:31:36.519 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-2": { 2024-04-15T00:31:36.519 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 0, 2024-04-15T00:31:36.519 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 2, 2024-04-15T00:31:36.519 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 0, 2024-04-15T00:31:36.519 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 0, 2024-04-15T00:31:36.519 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 2, 2024-04-15T00:31:36.520 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 1, 2024-04-15T00:31:36.520 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.000507533, 2024-04-15T00:31:36.520 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.000000000, 2024-04-15T00:31:36.520 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.000429870, 2024-04-15T00:31:36.520 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-15T00:31:36.520 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-04-15T00:31:36.520 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-04-15T00:31:36.521 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-04-15T00:31:36.521 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-04-15T00:31:36.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-04-15T00:31:36.521 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-04-15T00:31:36.521 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-04-15T00:31:36.522 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-04-15T00:31:36.522 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-04-15T00:31:36.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-04-15T00:31:36.522 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-15T00:31:36.522 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 0 2024-04-15T00:31:36.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-04-15T00:31:36.522 INFO:teuthology.orchestra.run.smithi050.stdout: "cct": { 2024-04-15T00:31:36.522 INFO:teuthology.orchestra.run.smithi050.stdout: "total_workers": 0, 2024-04-15T00:31:36.523 INFO:teuthology.orchestra.run.smithi050.stdout: "unhealthy_workers": 0 2024-04-15T00:31:36.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-04-15T00:31:36.523 INFO:teuthology.orchestra.run.smithi050.stdout: "mempool": { 2024-04-15T00:31:36.523 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_bytes": 0, 2024-04-15T00:31:36.523 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_items": 0, 2024-04-15T00:31:36.523 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_bytes": 0, 2024-04-15T00:31:36.523 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_items": 0, 2024-04-15T00:31:36.523 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_bytes": 0, 2024-04-15T00:31:36.523 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_items": 0, 2024-04-15T00:31:36.524 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-15T00:31:36.524 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_items": 0, 2024-04-15T00:31:36.524 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-15T00:31:36.524 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_items": 0, 2024-04-15T00:31:36.524 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_bytes": 0, 2024-04-15T00:31:36.524 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_items": 0, 2024-04-15T00:31:36.524 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-15T00:31:36.524 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_items": 0, 2024-04-15T00:31:36.525 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_bytes": 0, 2024-04-15T00:31:36.525 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_items": 0, 2024-04-15T00:31:36.525 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_bytes": 0, 2024-04-15T00:31:36.525 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_items": 0, 2024-04-15T00:31:36.525 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-15T00:31:36.525 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_items": 0, 2024-04-15T00:31:36.525 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-15T00:31:36.525 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_items": 0, 2024-04-15T00:31:36.525 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_bytes": 0, 2024-04-15T00:31:36.526 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_items": 0, 2024-04-15T00:31:36.526 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_bytes": 0, 2024-04-15T00:31:36.526 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_items": 0, 2024-04-15T00:31:36.526 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-15T00:31:36.526 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_items": 0, 2024-04-15T00:31:36.526 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_bytes": 0, 2024-04-15T00:31:36.526 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_items": 0, 2024-04-15T00:31:36.526 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_bytes": 0, 2024-04-15T00:31:36.526 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_items": 0, 2024-04-15T00:31:36.527 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_bytes": 0, 2024-04-15T00:31:36.527 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_items": 0, 2024-04-15T00:31:36.527 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_bytes": 0, 2024-04-15T00:31:36.527 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_items": 0, 2024-04-15T00:31:36.527 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_bytes": 151029, 2024-04-15T00:31:36.528 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_items": 31, 2024-04-15T00:31:36.528 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_bytes": 0, 2024-04-15T00:31:36.528 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_items": 0, 2024-04-15T00:31:36.528 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bytes": 0, 2024-04-15T00:31:36.528 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_items": 0, 2024-04-15T00:31:36.528 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_bytes": 0, 2024-04-15T00:31:36.529 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_items": 0, 2024-04-15T00:31:36.529 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_bytes": 0, 2024-04-15T00:31:36.529 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_items": 0, 2024-04-15T00:31:36.529 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_bytes": 0, 2024-04-15T00:31:36.529 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_items": 0, 2024-04-15T00:31:36.530 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_bytes": 0, 2024-04-15T00:31:36.530 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_items": 0, 2024-04-15T00:31:36.530 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_bytes": 0, 2024-04-15T00:31:36.530 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_items": 0, 2024-04-15T00:31:36.530 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_bytes": 928, 2024-04-15T00:31:36.530 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_items": 2, 2024-04-15T00:31:36.530 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_bytes": 0, 2024-04-15T00:31:36.530 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_items": 0, 2024-04-15T00:31:36.530 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_bytes": 0, 2024-04-15T00:31:36.531 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_items": 0 2024-04-15T00:31:36.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-04-15T00:31:36.531 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-15T00:31:36.531 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-04-15T00:31:36.532 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-04-15T00:31:36.532 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-04-15T00:31:36.532 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 172, 2024-04-15T00:31:36.532 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 115662, 2024-04-15T00:31:36.532 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-04-15T00:31:36.532 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 172, 2024-04-15T00:31:36.532 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-04-15T00:31:36.532 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-04-15T00:31:36.533 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 172, 2024-04-15T00:31:36.533 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 115662, 2024-04-15T00:31:36.533 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-04-15T00:31:36.533 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-04-15T00:31:36.533 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-04-15T00:31:36.533 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-04-15T00:31:36.533 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-04-15T00:31:36.533 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-04-15T00:31:36.533 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-04-15T00:31:36.535 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.b 2024-04-15T00:31:36.535 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-15T00:31:36.683 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-15T00:31:36.684 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-15T00:31:36.684 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T00:31:36.898 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-15T00:31:36.899 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T00:31:36.957 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:31:37.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.099+0000 7f9327c88640 1 Processor -- start 2024-04-15T00:31:37.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.100+0000 7f9327c88640 1 -- start start 2024-04-15T00:31:37.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.100+0000 7f9327c88640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9320072690 0x7f932009fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:37.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.100+0000 7f9327c88640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93200b6800 0x7f932014fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:37.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.100+0000 7f9327c88640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9320072a70 con 0x7f932006e1d0 2024-04-15T00:31:37.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.100+0000 7f9327c88640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f93200b6c90 con 0x7f9320072690 2024-04-15T00:31:37.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.100+0000 7f9327c88640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f932006ebe0 con 0x7f93200b6800 2024-04-15T00:31:37.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.100+0000 7f9325223640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f932006e1d0 0x7f93200b1770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50194/0 (socket says 172.21.15.31:50194) 2024-04-15T00:31:37.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.100+0000 7f9325223640 1 -- 172.21.15.31:0/2001254320 learned_addr learned my addr 172.21.15.31:0/2001254320 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:31:37.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.101+0000 7f9325a24640 1 --2- 172.21.15.31:0/2001254320 >> v2:172.21.15.50:3300/0 conn(0x7f9320072690 0x7f932009fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:37.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.101+0000 7f9326225640 1 --2- 172.21.15.31:0/2001254320 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93200b6800 0x7f932014fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:37.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.101+0000 7f9324a22640 1 -- 172.21.15.31:0/2001254320 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 731301140 0 0) 0x7f9320072a70 con 0x7f932006e1d0 2024-04-15T00:31:37.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.101+0000 7f9324a22640 1 -- 172.21.15.31:0/2001254320 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9308003520 con 0x7f932006e1d0 2024-04-15T00:31:37.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.101+0000 7f9324a22640 1 -- 172.21.15.31:0/2001254320 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 931228657 0 0) 0x7f9308003520 con 0x7f932006e1d0 2024-04-15T00:31:37.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.101+0000 7f9324a22640 1 -- 172.21.15.31:0/2001254320 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93200b6800 msgr2=0x7f932014fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:37.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.101+0000 7f9324a22640 1 --2- 172.21.15.31:0/2001254320 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93200b6800 0x7f932014fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:37.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.101+0000 7f9324a22640 1 -- 172.21.15.31:0/2001254320 >> v2:172.21.15.50:3300/0 conn(0x7f9320072690 msgr2=0x7f932009fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:37.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.101+0000 7f9324a22640 1 --2- 172.21.15.31:0/2001254320 >> v2:172.21.15.50:3300/0 conn(0x7f9320072690 0x7f932009fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:37.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.101+0000 7f9324a22640 1 -- 172.21.15.31:0/2001254320 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f932006eec0 con 0x7f932006e1d0 2024-04-15T00:31:37.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.101+0000 7f9324a22640 1 -- 172.21.15.31:0/2001254320 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 697057150 0 0) 0x7f9314001670 con 0x7f932006e1d0 2024-04-15T00:31:37.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.101+0000 7f9324a22640 1 -- 172.21.15.31:0/2001254320 >> v1:172.21.15.31:6789/0 conn(0x7f932006e1d0 legacy=0x7f93200b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:37.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.101+0000 7f9324a22640 1 --2- 172.21.15.31:0/2001254320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93080039b0 0x7f9308003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:37.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.101+0000 7f9324a22640 1 --2- 172.21.15.31:0/2001254320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9308004800 0x7f9308004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:37.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.101+0000 7f9324a22640 1 --2- 172.21.15.31:0/2001254320 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93080051c0 0x7f930800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:37.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.101+0000 7f9324a22640 1 -- 172.21.15.31:0/2001254320 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f93200b6c90 con 0x7f93080039b0 2024-04-15T00:31:37.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.101+0000 7f9324a22640 1 -- 172.21.15.31:0/2001254320 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f932006ebe0 con 0x7f9308004800 2024-04-15T00:31:37.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.101+0000 7f9324a22640 1 -- 172.21.15.31:0/2001254320 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f930800bf00 con 0x7f93080051c0 2024-04-15T00:31:37.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.101+0000 7f9325a24640 1 --2- 172.21.15.31:0/2001254320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93080039b0 0x7f9308003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:37.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.101+0000 7f9325223640 1 --2- 172.21.15.31:0/2001254320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9308004800 0x7f9308004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:37.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.101+0000 7f9326225640 1 --2- 172.21.15.31:0/2001254320 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93080051c0 0x7f930800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:37.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.101+0000 7f9325a24640 1 -- 172.21.15.31:0/2001254320 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93080051c0 msgr2=0x7f930800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:37.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.101+0000 7f9325a24640 1 --2- 172.21.15.31:0/2001254320 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93080051c0 0x7f930800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:37.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.101+0000 7f9325a24640 1 -- 172.21.15.31:0/2001254320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9308004800 msgr2=0x7f9308004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:37.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.101+0000 7f9325a24640 1 --2- 172.21.15.31:0/2001254320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9308004800 0x7f9308004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:37.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.101+0000 7f9325a24640 1 -- 172.21.15.31:0/2001254320 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9308003520 con 0x7f93080039b0 2024-04-15T00:31:37.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.102+0000 7f9325a24640 1 --2- 172.21.15.31:0/2001254320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93080039b0 0x7f9308003dd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9318009ab0 tx=0x7f9308005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0bdc97014f4430a server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:37.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.102+0000 7f9324a22640 1 -- 172.21.15.31:0/2001254320 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9318009680 con 0x7f93080039b0 2024-04-15T00:31:37.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.102+0000 7f9324a22640 1 -- 172.21.15.31:0/2001254320 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9318005990 con 0x7f93080039b0 2024-04-15T00:31:37.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.102+0000 7f9324a22640 1 -- 172.21.15.31:0/2001254320 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9318005d80 con 0x7f93080039b0 2024-04-15T00:31:37.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.103+0000 7f9327c88640 1 -- 172.21.15.31:0/2001254320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93080039b0 msgr2=0x7f9308003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:37.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.103+0000 7f9327c88640 1 --2- 172.21.15.31:0/2001254320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93080039b0 0x7f9308003dd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9318009ab0 tx=0x7f9308005830 comp rx=0 tx=0).stop 2024-04-15T00:31:37.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.103+0000 7f9326225640 1 -- 172.21.15.31:0/2001254320 reap_dead start 2024-04-15T00:31:37.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.103+0000 7f9327c88640 1 -- 172.21.15.31:0/2001254320 shutdown_connections 2024-04-15T00:31:37.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.103+0000 7f9327c88640 1 -- 172.21.15.31:0/2001254320 >> 172.21.15.31:0/2001254320 conn(0x7f93200b7840 msgr2=0x7f93200b7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:37.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.103+0000 7f9327c88640 1 -- 172.21.15.31:0/2001254320 shutdown_connections 2024-04-15T00:31:37.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.103+0000 7f9327c88640 1 -- 172.21.15.31:0/2001254320 wait complete. 2024-04-15T00:31:37.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.104+0000 7f9327c88640 1 Processor -- start 2024-04-15T00:31:37.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.104+0000 7f9327c88640 1 -- start start 2024-04-15T00:31:37.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.105+0000 7f9327c88640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93080039b0 0x7f932009f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:37.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.105+0000 7f9327c88640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93201e0040 0x7f93201e04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:37.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.105+0000 7f9327c88640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93200b53a0 0x7f93200b5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:37.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.105+0000 7f9327c88640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9320148c40 con 0x7f93200b53a0 2024-04-15T00:31:37.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.105+0000 7f9327c88640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9320148ac0 con 0x7f93080039b0 2024-04-15T00:31:37.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.105+0000 7f9327c88640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f93200a0210 con 0x7f93201e0040 2024-04-15T00:31:37.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.105+0000 7f9326225640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93200b53a0 0x7f93200b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:37.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.105+0000 7f9326225640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93200b53a0 0x7f93200b5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59016/0 (socket says 172.21.15.31:59016) 2024-04-15T00:31:37.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.105+0000 7f9326225640 1 -- 172.21.15.31:0/4223730864 learned_addr learned my addr 172.21.15.31:0/4223730864 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:37.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.105+0000 7f9325223640 1 --2- 172.21.15.31:0/4223730864 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93201e0040 0x7f93201e04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:37.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.105+0000 7f9325a24640 1 --2- 172.21.15.31:0/4223730864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93080039b0 0x7f932009f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:37.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.105+0000 7f9326225640 1 -- 172.21.15.31:0/4223730864 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93201e0040 msgr2=0x7f93201e04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:37.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.105+0000 7f9326225640 1 --2- 172.21.15.31:0/4223730864 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93201e0040 0x7f93201e04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:37.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.105+0000 7f9326225640 1 -- 172.21.15.31:0/4223730864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93080039b0 msgr2=0x7f932009f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:37.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.105+0000 7f9326225640 1 --2- 172.21.15.31:0/4223730864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93080039b0 0x7f932009f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:37.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.105+0000 7f9326225640 1 -- 172.21.15.31:0/4223730864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f932006d120 con 0x7f93200b53a0 2024-04-15T00:31:37.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.105+0000 7f9326225640 1 --2- 172.21.15.31:0/4223730864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93200b53a0 0x7f93200b5820 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9320146660 tx=0x7f93100115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:37.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.106+0000 7f931e7fc640 1 -- 172.21.15.31:0/4223730864 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9310011e10 con 0x7f93200b53a0 2024-04-15T00:31:37.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.106+0000 7f931e7fc640 1 -- 172.21.15.31:0/4223730864 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f931001b070 con 0x7f93200b53a0 2024-04-15T00:31:37.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.106+0000 7f9327c88640 1 -- 172.21.15.31:0/4223730864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9320147fd0 con 0x7f93200b53a0 2024-04-15T00:31:37.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.106+0000 7f931e7fc640 1 -- 172.21.15.31:0/4223730864 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9310003990 con 0x7f93200b53a0 2024-04-15T00:31:37.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.106+0000 7f9327c88640 1 -- 172.21.15.31:0/4223730864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f932006b320 con 0x7f93200b53a0 2024-04-15T00:31:37.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.107+0000 7f9327c88640 1 -- 172.21.15.31:0/4223730864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93200b61c0 con 0x7f93200b53a0 2024-04-15T00:31:37.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.107+0000 7f931e7fc640 1 -- 172.21.15.31:0/4223730864 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f9310005d10 con 0x7f93200b53a0 2024-04-15T00:31:37.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.107+0000 7f931e7fc640 1 --2- 172.21.15.31:0/4223730864 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f930c06b990 0x7f930c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:37.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.107+0000 7f931e7fc640 1 -- 172.21.15.31:0/4223730864 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f931008b0a0 con 0x7f93200b53a0 2024-04-15T00:31:37.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.107+0000 7f9325a24640 1 --2- 172.21.15.31:0/4223730864 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f930c06b990 0x7f930c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:37.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.108+0000 7f9325a24640 1 --2- 172.21.15.31:0/4223730864 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f930c06b990 0x7f930c06de50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9318035000 tx=0x7f9318030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:37.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.112+0000 7f931e7fc640 1 -- 172.21.15.31:0/4223730864 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9310025020 con 0x7f93200b53a0 2024-04-15T00:31:37.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.294+0000 7f9327c88640 1 -- 172.21.15.31:0/4223730864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f932004f620 con 0x7f93200b53a0 2024-04-15T00:31:37.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.295+0000 7f931e7fc640 1 -- 172.21.15.31:0/4223730864 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18841 (secure 0 0 0) 0x7f93100592f0 con 0x7f93200b53a0 2024-04-15T00:31:37.303 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:31:37.304 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":27,"fsid":"b57c03ab-2810-4ea5-b233-6164468328c0","created":"2024-04-15T00:20:44.073217+0000","modified":"2024-04-15T00:21:49.696289+0000","last_up_change":"2024-04-15T00:20:55.515596+0000","last_in_change":"2024-04-15T00:20:46.364541+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:20:56.423161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:21:06.436169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:21:06.888505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:21:10.610300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b085a2f4-5565-4ccc-a98e-e56180791550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6817","nonce":2355720818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6819","nonce":2355720818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6823","nonce":2355720818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6821","nonce":2355720818}]},"public_addr":"172.21.15.31:6817/2355720818","cluster_addr":"172.21.15.31:6819/2355720818","heartbeat_back_addr":"172.21.15.31:6823/2355720818","heartbeat_front_addr":"172.21.15.31:6821/2355720818","state":["exists","up"]},{"osd":1,"uuid":"0f751557-3f18-464f-8b78-614d19549f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6809","nonce":2705297130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6811","nonce":2705297130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6815","nonce":2705297130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6813","nonce":2705297130}]},"public_addr":"172.21.15.31:6809/2705297130","cluster_addr":"172.21.15.31:6811/2705297130","heartbeat_back_addr":"172.21.15.31:6815/2705297130","heartbeat_front_addr":"172.21.15.31:6813/2705297130","state":["exists","up"]},{"osd":2,"uuid":"17371b09-2bd7-4ef7-926f-e7706319f064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6801","nonce":225061474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6803","nonce":225061474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6807","nonce":225061474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6805","nonce":225061474}]},"public_addr":"172.21.15.31:6801/225061474","cluster_addr":"172.21.15.31:6803/225061474","heartbeat_back_addr":"172.21.15.31:6807/225061474","heartbeat_front_addr":"172.21.15.31:6805/225061474","state":["exists","up"]},{"osd":3,"uuid":"315b6949-f009-4291-9581-aa4912642dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6825","nonce":3722449780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6827","nonce":3722449780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6831","nonce":3722449780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6829","nonce":3722449780}]},"public_addr":"172.21.15.31:6825/3722449780","cluster_addr":"172.21.15.31:6827/3722449780","heartbeat_back_addr":"172.21.15.31:6831/3722449780","heartbeat_front_addr":"172.21.15.31:6829/3722449780","state":["exists","up"]},{"osd":4,"uuid":"e3659369-cc78-4aa8-bd10-a199d4a1569d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6801","nonce":1279970071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6803","nonce":1279970071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6807","nonce":1279970071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6805","nonce":1279970071}]},"public_addr":"172.21.15.50:6801/1279970071","cluster_addr":"172.21.15.50:6803/1279970071","heartbeat_back_addr":"172.21.15.50:6807/1279970071","heartbeat_front_addr":"172.21.15.50:6805/1279970071","state":["exists","up"]},{"osd":5,"uuid":"35c3a4c0-0b45-45d2-85b9-301c347602f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6809","nonce":1589417182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6811","nonce":1589417182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6815","nonce":1589417182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6813","nonce":1589417182}]},"public_addr":"172.21.15.50:6809/1589417182","cluster_addr":"172.21.15.50:6811/1589417182","heartbeat_back_addr":"172.21.15.50:6815/1589417182","heartbeat_front_addr":"172.21.15.50:6813/1589417182","state":["exists","up"]},{"osd":6,"uuid":"20df7a76-245f-4946-9624-6ca9e949227b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6817","nonce":682288274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6819","nonce":682288274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6823","nonce":682288274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6821","nonce":682288274}]},"public_addr":"172.21.15.50:6817/682288274","cluster_addr":"172.21.15.50:6819/682288274","heartbeat_back_addr":"172.21.15.50:6823/682288274","heartbeat_front_addr":"172.21.15.50:6821/682288274","state":["exists","up"]},{"osd":7,"uuid":"95a504b7-e13a-49e6-8484-9dff4d5fc048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6825","nonce":4129060906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6827","nonce":4129060906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6831","nonce":4129060906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6829","nonce":4129060906}]},"public_addr":"172.21.15.50:6825/4129060906","cluster_addr":"172.21.15.50:6827/4129060906","heartbeat_back_addr":"172.21.15.50:6831/4129060906","heartbeat_front_addr":"172.21.15.50:6829/4129060906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.501980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.529961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.540913+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.521396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.448364+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.514136+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.527229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.508950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:31:37.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.297+0000 7f9327c88640 1 -- 172.21.15.31:0/4223730864 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f930c06b990 msgr2=0x7f930c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:37.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.297+0000 7f9327c88640 1 --2- 172.21.15.31:0/4223730864 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f930c06b990 0x7f930c06de50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9318035000 tx=0x7f9318030000 comp rx=0 tx=0).stop 2024-04-15T00:31:37.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.297+0000 7f9327c88640 1 -- 172.21.15.31:0/4223730864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93200b53a0 msgr2=0x7f93200b5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:37.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.297+0000 7f9327c88640 1 --2- 172.21.15.31:0/4223730864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93200b53a0 0x7f93200b5820 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9320146660 tx=0x7f93100115a0 comp rx=0 tx=0).stop 2024-04-15T00:31:37.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.297+0000 7f9327c88640 1 -- 172.21.15.31:0/4223730864 shutdown_connections 2024-04-15T00:31:37.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.297+0000 7f9327c88640 1 --2- 172.21.15.31:0/4223730864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93200b53a0 0x7f93200b5820 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:37.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.297+0000 7f9327c88640 1 --2- 172.21.15.31:0/4223730864 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f930c06b990 0x7f930c06de50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:37.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.297+0000 7f9327c88640 1 --2- 172.21.15.31:0/4223730864 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f93201e0040 0x7f93201e04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:37.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.297+0000 7f9327c88640 1 --2- 172.21.15.31:0/4223730864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93080039b0 0x7f932009f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:37.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.297+0000 7f9327c88640 1 -- 172.21.15.31:0/4223730864 >> 172.21.15.31:0/4223730864 conn(0x7f93200b7840 msgr2=0x7f93200b7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:37.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.297+0000 7f9327c88640 1 -- 172.21.15.31:0/4223730864 shutdown_connections 2024-04-15T00:31:37.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.297+0000 7f9327c88640 1 -- 172.21.15.31:0/4223730864 wait complete. 2024-04-15T00:31:37.316 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T00:20:56.423161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T00:21:06.436169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T00:21:06.888505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-15T00:21:10.610300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-15T00:31:37.316 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T00:31:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.414+0000 7f026a5c8640 1 Processor -- start 2024-04-15T00:31:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.414+0000 7f026a5c8640 1 -- start start 2024-04-15T00:31:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.414+0000 7f026a5c8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f02640b56b0 0x7f0264148080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.414+0000 7f026a5c8640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f02640b6f30 0x7f02641520f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.414+0000 7f026a5c8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f026406cc20 con 0x7f02640b5a90 2024-04-15T00:31:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.414+0000 7f026a5c8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f0264147bf0 con 0x7f02640b56b0 2024-04-15T00:31:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.414+0000 7f026a5c8640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f026406bcf0 con 0x7f02640b6f30 2024-04-15T00:31:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.415+0000 7f0263fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f02640b56b0 0x7f0264148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.415+0000 7f0263fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f02640b56b0 0x7f0264148080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59026/0 (socket says 172.21.15.31:59026) 2024-04-15T00:31:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.415+0000 7f0263fff640 1 -- 172.21.15.31:0/329095605 learned_addr learned my addr 172.21.15.31:0/329095605 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.415+0000 7f0268b65640 1 --2- 172.21.15.31:0/329095605 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f02640b6f30 0x7f02641520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.415+0000 7f0263fff640 1 -- 172.21.15.31:0/329095605 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f02640b6f30 msgr2=0x7f02641520f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:37.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.415+0000 7f0263fff640 1 --2- 172.21.15.31:0/329095605 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f02640b6f30 0x7f02641520f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:37.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.415+0000 7f0263fff640 1 -- 172.21.15.31:0/329095605 >> v1:172.21.15.50:6789/0 conn(0x7f02640b5a90 legacy=0x7f02640b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:37.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.415+0000 7f0263fff640 1 -- 172.21.15.31:0/329095605 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0264147880 con 0x7f02640b56b0 2024-04-15T00:31:37.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.416+0000 7f0263fff640 1 --2- 172.21.15.31:0/329095605 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02640b56b0 0x7f0264148080 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0264147d70 tx=0x7f025402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f2d2de781b383f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:37.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.416+0000 7f0262ffd640 1 -- 172.21.15.31:0/329095605 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02540317c0 con 0x7f02640b56b0 2024-04-15T00:31:37.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.416+0000 7f0262ffd640 1 -- 172.21.15.31:0/329095605 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0254037070 con 0x7f02640b56b0 2024-04-15T00:31:37.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.416+0000 7f0262ffd640 1 -- 172.21.15.31:0/329095605 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0254031b80 con 0x7f02640b56b0 2024-04-15T00:31:37.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.416+0000 7f026a5c8640 1 -- 172.21.15.31:0/329095605 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02640b56b0 msgr2=0x7f0264148080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.416+0000 7f026a5c8640 1 --2- 172.21.15.31:0/329095605 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02640b56b0 0x7f0264148080 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0264147d70 tx=0x7f025402b860 comp rx=0 tx=0).stop 2024-04-15T00:31:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.416+0000 7f026a5c8640 1 -- 172.21.15.31:0/329095605 shutdown_connections 2024-04-15T00:31:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.416+0000 7f026a5c8640 1 --2- 172.21.15.31:0/329095605 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f02640b6f30 0x7f02641520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.416+0000 7f026a5c8640 1 --2- 172.21.15.31:0/329095605 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02640b56b0 0x7f0264148080 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.416+0000 7f026a5c8640 1 -- 172.21.15.31:0/329095605 >> 172.21.15.31:0/329095605 conn(0x7f02640b77b0 msgr2=0x7f02640b7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.416+0000 7f026a5c8640 1 -- 172.21.15.31:0/329095605 shutdown_connections 2024-04-15T00:31:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.416+0000 7f026a5c8640 1 -- 172.21.15.31:0/329095605 wait complete. 2024-04-15T00:31:37.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.417+0000 7f026a5c8640 1 Processor -- start 2024-04-15T00:31:37.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.418+0000 7f026a5c8640 1 -- start start 2024-04-15T00:31:37.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.418+0000 7f026a5c8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02640b56b0 0x7f0264143c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:37.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.418+0000 7f026a5c8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02640b5a90 0x7f0264144870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:37.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.418+0000 7f026a5c8640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f02640b6f30 0x7f02641e0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:37.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.418+0000 7f026a5c8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f02640b6240 con 0x7f02640b56b0 2024-04-15T00:31:37.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.418+0000 7f026a5c8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f02640b60c0 con 0x7f02640b5a90 2024-04-15T00:31:37.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.418+0000 7f026a5c8640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f026406d050 con 0x7f02640b6f30 2024-04-15T00:31:37.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.418+0000 7f0263fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02640b56b0 0x7f0264143c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:37.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.418+0000 7f0263fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02640b56b0 0x7f0264143c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59034/0 (socket says 172.21.15.31:59034) 2024-04-15T00:31:37.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.418+0000 7f0263fff640 1 -- 172.21.15.31:0/1774090358 learned_addr learned my addr 172.21.15.31:0/1774090358 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:37.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.418+0000 7f0268b65640 1 --2- 172.21.15.31:0/1774090358 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f02640b6f30 0x7f02641e0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:37.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.418+0000 7f02637fe640 1 --2- 172.21.15.31:0/1774090358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02640b5a90 0x7f0264144870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:37.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.418+0000 7f0263fff640 1 -- 172.21.15.31:0/1774090358 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f02640b6f30 msgr2=0x7f02641e0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:37.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.418+0000 7f0263fff640 1 --2- 172.21.15.31:0/1774090358 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f02640b6f30 0x7f02641e0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:37.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.418+0000 7f0263fff640 1 -- 172.21.15.31:0/1774090358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02640b5a90 msgr2=0x7f0264144870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:37.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.418+0000 7f0263fff640 1 --2- 172.21.15.31:0/1774090358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02640b5a90 0x7f0264144870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:37.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.418+0000 7f0263fff640 1 -- 172.21.15.31:0/1774090358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02641442e0 con 0x7f02640b56b0 2024-04-15T00:31:37.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.419+0000 7f0263fff640 1 --2- 172.21.15.31:0/1774090358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02640b56b0 0x7f0264143c50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f025402b8a0 tx=0x7f02540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:37.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.419+0000 7f0260ff9640 1 -- 172.21.15.31:0/1774090358 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0254032650 con 0x7f02640b56b0 2024-04-15T00:31:37.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.419+0000 7f0260ff9640 1 -- 172.21.15.31:0/1774090358 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0254032810 con 0x7f02640b56b0 2024-04-15T00:31:37.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.419+0000 7f026a5c8640 1 -- 172.21.15.31:0/1774090358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02641e07d0 con 0x7f02640b56b0 2024-04-15T00:31:37.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.419+0000 7f0260ff9640 1 -- 172.21.15.31:0/1774090358 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0254032c00 con 0x7f02640b56b0 2024-04-15T00:31:37.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.419+0000 7f026a5c8640 1 -- 172.21.15.31:0/1774090358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f026414bb10 con 0x7f02640b56b0 2024-04-15T00:31:37.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.420+0000 7f026a5c8640 1 -- 172.21.15.31:0/1774090358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02641e09a0 con 0x7f02640b56b0 2024-04-15T00:31:37.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.420+0000 7f0260ff9640 1 -- 172.21.15.31:0/1774090358 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f025404c060 con 0x7f02640b56b0 2024-04-15T00:31:37.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.421+0000 7f0260ff9640 1 --2- 172.21.15.31:0/1774090358 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f025006b990 0x7f025006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:37.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.421+0000 7f0260ff9640 1 -- 172.21.15.31:0/1774090358 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f02540ac760 con 0x7f02640b56b0 2024-04-15T00:31:37.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.421+0000 7f02637fe640 1 --2- 172.21.15.31:0/1774090358 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f025006b990 0x7f025006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:37.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.421+0000 7f02637fe640 1 --2- 172.21.15.31:0/1774090358 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f025006b990 0x7f025006de50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0258007fd0 tx=0x7f0258009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:37.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.425+0000 7f0260ff9640 1 -- 172.21.15.31:0/1774090358 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0254040070 con 0x7f02640b56b0 2024-04-15T00:31:37.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.607+0000 7f026a5c8640 1 -- 172.21.15.31:0/1774090358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f026404f620 con 0x7f02640b56b0 2024-04-15T00:31:37.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.608+0000 7f0260ff9640 1 -- 172.21.15.31:0/1774090358 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f025407af60 con 0x7f02640b56b0 2024-04-15T00:31:37.616 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-15T00:31:37.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.610+0000 7f026a5c8640 1 -- 172.21.15.31:0/1774090358 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f025006b990 msgr2=0x7f025006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:37.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.610+0000 7f026a5c8640 1 --2- 172.21.15.31:0/1774090358 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f025006b990 0x7f025006de50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0258007fd0 tx=0x7f0258009040 comp rx=0 tx=0).stop 2024-04-15T00:31:37.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.610+0000 7f026a5c8640 1 -- 172.21.15.31:0/1774090358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02640b56b0 msgr2=0x7f0264143c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:37.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.610+0000 7f026a5c8640 1 --2- 172.21.15.31:0/1774090358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02640b56b0 0x7f0264143c50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f025402b8a0 tx=0x7f02540046c0 comp rx=0 tx=0).stop 2024-04-15T00:31:37.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.610+0000 7f026a5c8640 1 -- 172.21.15.31:0/1774090358 shutdown_connections 2024-04-15T00:31:37.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.610+0000 7f026a5c8640 1 --2- 172.21.15.31:0/1774090358 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f025006b990 0x7f025006de50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:37.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.610+0000 7f026a5c8640 1 --2- 172.21.15.31:0/1774090358 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f02640b6f30 0x7f02641e0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:37.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.610+0000 7f026a5c8640 1 --2- 172.21.15.31:0/1774090358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02640b5a90 0x7f0264144870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:37.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.610+0000 7f026a5c8640 1 --2- 172.21.15.31:0/1774090358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02640b56b0 0x7f0264143c50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:37.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.610+0000 7f026a5c8640 1 -- 172.21.15.31:0/1774090358 >> 172.21.15.31:0/1774090358 conn(0x7f02640b77b0 msgr2=0x7f0264071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:37.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.610+0000 7f026a5c8640 1 -- 172.21.15.31:0/1774090358 shutdown_connections 2024-04-15T00:31:37.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.610+0000 7f026a5c8640 1 -- 172.21.15.31:0/1774090358 wait complete. 2024-04-15T00:31:37.629 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T00:31:37.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.726+0000 7f263722d640 1 Processor -- start 2024-04-15T00:31:37.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.726+0000 7f263722d640 1 -- start start 2024-04-15T00:31:37.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.727+0000 7f263722d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f26300b1a90 0x7f2630147840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:37.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.727+0000 7f263722d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26301481d0 con 0x7f2630147d80 2024-04-15T00:31:37.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.727+0000 7f263722d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26300b0bc0 con 0x7f2630141ab0 2024-04-15T00:31:37.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.727+0000 7f263722d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f26300b7d20 con 0x7f26300b1a90 2024-04-15T00:31:37.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.727+0000 7f262ffff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f26300b1a90 0x7f2630147840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:37.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.727+0000 7f26357ca640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f2630147d80 0x7f2630151ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50210/0 (socket says 172.21.15.31:50210) 2024-04-15T00:31:37.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.727+0000 7f26357ca640 1 -- 172.21.15.31:0/975251220 learned_addr learned my addr 172.21.15.31:0/975251220 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:31:37.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.727+0000 7f262ffff640 1 -- 172.21.15.31:0/975251220 >> v1:172.21.15.50:6789/0 conn(0x7f2630141ab0 legacy=0x7f26300b7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:37.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.727+0000 7f262ffff640 1 -- 172.21.15.31:0/975251220 >> v1:172.21.15.31:6789/0 conn(0x7f2630147d80 legacy=0x7f2630151ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:37.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.727+0000 7f262ffff640 1 -- 172.21.15.31:0/975251220 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26300b0e60 con 0x7f26300b1a90 2024-04-15T00:31:37.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.727+0000 7f262f7fe640 1 -- 172.21.15.31:0/975251220 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 533673073 0 0) 0x7f26301481d0 con 0x7f2630147d80 2024-04-15T00:31:37.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.728+0000 7f262ffff640 1 --2- 172.21.15.31:0/975251220 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26300b1a90 0x7f2630147840 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f26180097a0 tx=0x7f261802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=151478871198434c server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:37.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.728+0000 7f262f7fe640 1 -- 172.21.15.31:0/975251220 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2618038070 con 0x7f26300b1a90 2024-04-15T00:31:37.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.728+0000 7f262f7fe640 1 -- 172.21.15.31:0/975251220 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2618031700 con 0x7f26300b1a90 2024-04-15T00:31:37.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.728+0000 7f262f7fe640 1 -- 172.21.15.31:0/975251220 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2618031ad0 con 0x7f26300b1a90 2024-04-15T00:31:37.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.728+0000 7f263722d640 1 -- 172.21.15.31:0/975251220 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26300b1a90 msgr2=0x7f2630147840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:37.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.728+0000 7f263722d640 1 --2- 172.21.15.31:0/975251220 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26300b1a90 0x7f2630147840 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f26180097a0 tx=0x7f261802b7a0 comp rx=0 tx=0).stop 2024-04-15T00:31:37.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.729+0000 7f263722d640 1 -- 172.21.15.31:0/975251220 shutdown_connections 2024-04-15T00:31:37.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.729+0000 7f263722d640 1 --2- 172.21.15.31:0/975251220 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26300b1a90 0x7f2630147840 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:37.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.729+0000 7f263722d640 1 -- 172.21.15.31:0/975251220 >> 172.21.15.31:0/975251220 conn(0x7f26300bae10 msgr2=0x7f26300bb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:37.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.729+0000 7f263722d640 1 -- 172.21.15.31:0/975251220 shutdown_connections 2024-04-15T00:31:37.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.729+0000 7f263722d640 1 -- 172.21.15.31:0/975251220 wait complete. 2024-04-15T00:31:37.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.730+0000 7f263722d640 1 Processor -- start 2024-04-15T00:31:37.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.730+0000 7f263722d640 1 -- start start 2024-04-15T00:31:37.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.730+0000 7f263722d640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f26300b1a90 0x7f263009f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:37.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.730+0000 7f263722d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2630141ab0 0x7f263013add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:37.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.730+0000 7f263722d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2630147d80 0x7f263013b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:37.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.730+0000 7f263722d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f26300b14b0 con 0x7f2630147d80 2024-04-15T00:31:37.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.730+0000 7f263722d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2630141e90 con 0x7f2630141ab0 2024-04-15T00:31:37.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.730+0000 7f263722d640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f26300b0450 con 0x7f26300b1a90 2024-04-15T00:31:37.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.730+0000 7f26357ca640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2630147d80 0x7f263013b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:37.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.731+0000 7f26357ca640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2630147d80 0x7f263013b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59062/0 (socket says 172.21.15.31:59062) 2024-04-15T00:31:37.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.731+0000 7f26357ca640 1 -- 172.21.15.31:0/1569219393 learned_addr learned my addr 172.21.15.31:0/1569219393 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:37.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.731+0000 7f262ffff640 1 --2- 172.21.15.31:0/1569219393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2630141ab0 0x7f263013add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:37.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.731+0000 7f2634fc9640 1 --2- 172.21.15.31:0/1569219393 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f26300b1a90 0x7f263009f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:37.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.731+0000 7f26357ca640 1 -- 172.21.15.31:0/1569219393 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f26300b1a90 msgr2=0x7f263009f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:37.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.731+0000 7f26357ca640 1 --2- 172.21.15.31:0/1569219393 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f26300b1a90 0x7f263009f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:37.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.731+0000 7f26357ca640 1 -- 172.21.15.31:0/1569219393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2630141ab0 msgr2=0x7f263013add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:37.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.731+0000 7f26357ca640 1 --2- 172.21.15.31:0/1569219393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2630141ab0 0x7f263013add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:37.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.731+0000 7f26357ca640 1 -- 172.21.15.31:0/1569219393 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f263013b850 con 0x7f2630147d80 2024-04-15T00:31:37.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.731+0000 7f26357ca640 1 --2- 172.21.15.31:0/1569219393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2630147d80 0x7f263013b310 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f262000c450 tx=0x7f262000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:37.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.731+0000 7f262d7fa640 1 -- 172.21.15.31:0/1569219393 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26200074e0 con 0x7f2630147d80 2024-04-15T00:31:37.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.731+0000 7f262d7fa640 1 -- 172.21.15.31:0/1569219393 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26200047e0 con 0x7f2630147d80 2024-04-15T00:31:37.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.731+0000 7f263722d640 1 -- 172.21.15.31:0/1569219393 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26300a0620 con 0x7f2630147d80 2024-04-15T00:31:37.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.731+0000 7f262d7fa640 1 -- 172.21.15.31:0/1569219393 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2620004bd0 con 0x7f2630147d80 2024-04-15T00:31:37.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.731+0000 7f263722d640 1 -- 172.21.15.31:0/1569219393 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f263009f060 con 0x7f2630147d80 2024-04-15T00:31:37.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.732+0000 7f263722d640 1 -- 172.21.15.31:0/1569219393 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2630140e20 con 0x7f2630147d80 2024-04-15T00:31:37.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.733+0000 7f262d7fa640 1 -- 172.21.15.31:0/1569219393 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f2620011070 con 0x7f2630147d80 2024-04-15T00:31:37.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.733+0000 7f262d7fa640 1 --2- 172.21.15.31:0/1569219393 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f261006b990 0x7f261006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:37.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.733+0000 7f262d7fa640 1 -- 172.21.15.31:0/1569219393 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f262008a6a0 con 0x7f2630147d80 2024-04-15T00:31:37.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.733+0000 7f2634fc9640 1 --2- 172.21.15.31:0/1569219393 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f261006b990 0x7f261006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:37.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.734+0000 7f2634fc9640 1 --2- 172.21.15.31:0/1569219393 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f261006b990 0x7f261006de50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2628005520 tx=0x7f2628009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:37.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.738+0000 7f262d7fa640 1 -- 172.21.15.31:0/1569219393 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2630140e20 con 0x7f2630147d80 2024-04-15T00:31:37.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.918+0000 7f263722d640 1 -- 172.21.15.31:0/1569219393 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f263004f540 con 0x7f2630147d80 2024-04-15T00:31:37.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.918+0000 7f262d7fa640 1 -- 172.21.15.31:0/1569219393 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f2620058f40 con 0x7f2630147d80 2024-04-15T00:31:37.927 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-15T00:31:37.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.920+0000 7f263722d640 1 -- 172.21.15.31:0/1569219393 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f261006b990 msgr2=0x7f261006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:37.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.920+0000 7f263722d640 1 --2- 172.21.15.31:0/1569219393 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f261006b990 0x7f261006de50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2628005520 tx=0x7f2628009040 comp rx=0 tx=0).stop 2024-04-15T00:31:37.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.920+0000 7f263722d640 1 -- 172.21.15.31:0/1569219393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2630147d80 msgr2=0x7f263013b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:37.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.920+0000 7f263722d640 1 --2- 172.21.15.31:0/1569219393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2630147d80 0x7f263013b310 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f262000c450 tx=0x7f262000c910 comp rx=0 tx=0).stop 2024-04-15T00:31:37.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.920+0000 7f263722d640 1 -- 172.21.15.31:0/1569219393 shutdown_connections 2024-04-15T00:31:37.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.920+0000 7f263722d640 1 --2- 172.21.15.31:0/1569219393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2630147d80 0x7f263013b310 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:37.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.920+0000 7f263722d640 1 --2- 172.21.15.31:0/1569219393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2630141ab0 0x7f263013add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:37.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.920+0000 7f263722d640 1 --2- 172.21.15.31:0/1569219393 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f261006b990 0x7f261006de50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:37.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.920+0000 7f263722d640 1 --2- 172.21.15.31:0/1569219393 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f26300b1a90 0x7f263009f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:37.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.920+0000 7f263722d640 1 -- 172.21.15.31:0/1569219393 >> 172.21.15.31:0/1569219393 conn(0x7f26300bae10 msgr2=0x7f26300b5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:37.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.920+0000 7f263722d640 1 -- 172.21.15.31:0/1569219393 shutdown_connections 2024-04-15T00:31:37.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:37.920+0000 7f263722d640 1 -- 172.21.15.31:0/1569219393 wait complete. 2024-04-15T00:31:37.939 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T00:31:38.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.036+0000 7f5c4331e640 1 Processor -- start 2024-04-15T00:31:38.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.036+0000 7f5c4331e640 1 -- start start 2024-04-15T00:31:38.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.036+0000 7f5c4331e640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c3c0b9bd0 0x7f5c3c0bb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:38.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.036+0000 7f5c4331e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5c3c0b94f0 0x7f5c3c147600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:38.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.036+0000 7f5c4331e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c3c0b9fb0 con 0x7f5c3c14b870 2024-04-15T00:31:38.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.036+0000 7f5c4331e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f5c3c14b3e0 con 0x7f5c3c0b94f0 2024-04-15T00:31:38.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.036+0000 7f5c4331e640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f5c3c147b40 con 0x7f5c3c0b9bd0 2024-04-15T00:31:38.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.037+0000 7f5c408b9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5c3c0b94f0 0x7f5c3c147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:38.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.037+0000 7f5c408b9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5c3c0b94f0 0x7f5c3c147600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59064/0 (socket says 172.21.15.31:59064) 2024-04-15T00:31:38.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.037+0000 7f5c408b9640 1 -- 172.21.15.31:0/3584721241 learned_addr learned my addr 172.21.15.31:0/3584721241 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:38.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.037+0000 7f5c410ba640 1 --2- 172.21.15.31:0/3584721241 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c3c0b9bd0 0x7f5c3c0bb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:38.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.037+0000 7f5c408b9640 1 -- 172.21.15.31:0/3584721241 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c3c0b9bd0 msgr2=0x7f5c3c0bb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:38.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.037+0000 7f5c408b9640 1 --2- 172.21.15.31:0/3584721241 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c3c0b9bd0 0x7f5c3c0bb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:38.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.037+0000 7f5c408b9640 1 -- 172.21.15.31:0/3584721241 >> v1:172.21.15.50:6789/0 conn(0x7f5c3c14b870 legacy=0x7f5c3c0b8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:38.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.037+0000 7f5c408b9640 1 -- 172.21.15.31:0/3584721241 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c3c14ad90 con 0x7f5c3c0b94f0 2024-04-15T00:31:38.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.038+0000 7f5c408b9640 1 --2- 172.21.15.31:0/3584721241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c3c0b94f0 0x7f5c3c147600 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c009870 tx=0x7f5c2c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d13b841deff6555 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:38.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.038+0000 7f5c33fff640 1 -- 172.21.15.31:0/3584721241 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c0317c0 con 0x7f5c3c0b94f0 2024-04-15T00:31:38.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.038+0000 7f5c33fff640 1 -- 172.21.15.31:0/3584721241 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c2c037070 con 0x7f5c3c0b94f0 2024-04-15T00:31:38.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.038+0000 7f5c33fff640 1 -- 172.21.15.31:0/3584721241 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c031b80 con 0x7f5c3c0b94f0 2024-04-15T00:31:38.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.038+0000 7f5c4331e640 1 -- 172.21.15.31:0/3584721241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c3c0b94f0 msgr2=0x7f5c3c147600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:38.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.038+0000 7f5c4331e640 1 --2- 172.21.15.31:0/3584721241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c3c0b94f0 0x7f5c3c147600 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c009870 tx=0x7f5c2c02b860 comp rx=0 tx=0).stop 2024-04-15T00:31:38.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.038+0000 7f5c4331e640 1 -- 172.21.15.31:0/3584721241 shutdown_connections 2024-04-15T00:31:38.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.038+0000 7f5c4331e640 1 --2- 172.21.15.31:0/3584721241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c3c0b94f0 0x7f5c3c147600 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:38.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.038+0000 7f5c4331e640 1 --2- 172.21.15.31:0/3584721241 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c3c0b9bd0 0x7f5c3c0bb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:38.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.038+0000 7f5c4331e640 1 -- 172.21.15.31:0/3584721241 >> 172.21.15.31:0/3584721241 conn(0x7f5c3c09ed70 msgr2=0x7f5c3c09f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:38.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.038+0000 7f5c4331e640 1 -- 172.21.15.31:0/3584721241 shutdown_connections 2024-04-15T00:31:38.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.038+0000 7f5c4331e640 1 -- 172.21.15.31:0/3584721241 wait complete. 2024-04-15T00:31:38.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.039+0000 7f5c4331e640 1 Processor -- start 2024-04-15T00:31:38.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.039+0000 7f5c4331e640 1 -- start start 2024-04-15T00:31:38.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.040+0000 7f5c4331e640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c3c0b94f0 0x7f5c3c1e05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:38.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.040+0000 7f5c4331e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c3c0b9bd0 0x7f5c3c140ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:38.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.040+0000 7f5c4331e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c3c14b870 0x7f5c3c1411e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:38.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.040+0000 7f5c4331e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3c0b9170 con 0x7f5c3c0b9bd0 2024-04-15T00:31:38.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.040+0000 7f5c4331e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3c0bcbe0 con 0x7f5c3c14b870 2024-04-15T00:31:38.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.040+0000 7f5c4331e640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f5c3c0b92f0 con 0x7f5c3c0b94f0 2024-04-15T00:31:38.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.040+0000 7f5c408b9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c3c0b9bd0 0x7f5c3c140ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:38.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.040+0000 7f5c408b9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c3c0b9bd0 0x7f5c3c140ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59072/0 (socket says 172.21.15.31:59072) 2024-04-15T00:31:38.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.040+0000 7f5c408b9640 1 -- 172.21.15.31:0/419831346 learned_addr learned my addr 172.21.15.31:0/419831346 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:38.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.040+0000 7f5c418bb640 1 --2- 172.21.15.31:0/419831346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c3c14b870 0x7f5c3c1411e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:38.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.040+0000 7f5c410ba640 1 --2- 172.21.15.31:0/419831346 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c3c0b94f0 0x7f5c3c1e05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:38.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.040+0000 7f5c408b9640 1 -- 172.21.15.31:0/419831346 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c3c0b94f0 msgr2=0x7f5c3c1e05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:38.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.040+0000 7f5c408b9640 1 --2- 172.21.15.31:0/419831346 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c3c0b94f0 0x7f5c3c1e05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:38.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.040+0000 7f5c408b9640 1 -- 172.21.15.31:0/419831346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c3c14b870 msgr2=0x7f5c3c1411e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:38.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.040+0000 7f5c408b9640 1 --2- 172.21.15.31:0/419831346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c3c14b870 0x7f5c3c1411e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:38.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.040+0000 7f5c408b9640 1 -- 172.21.15.31:0/419831346 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c3c1e0ef0 con 0x7f5c3c0b9bd0 2024-04-15T00:31:38.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.041+0000 7f5c408b9640 1 --2- 172.21.15.31:0/419831346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c3c0b9bd0 0x7f5c3c140ca0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c000c00 tx=0x7f5c2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:38.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.041+0000 7f5c31ffb640 1 -- 172.21.15.31:0/419831346 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c032650 con 0x7f5c3c0b9bd0 2024-04-15T00:31:38.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.041+0000 7f5c31ffb640 1 -- 172.21.15.31:0/419831346 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c2c0327f0 con 0x7f5c3c0b9bd0 2024-04-15T00:31:38.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.041+0000 7f5c31ffb640 1 -- 172.21.15.31:0/419831346 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c032be0 con 0x7f5c3c0b9bd0 2024-04-15T00:31:38.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.041+0000 7f5c4331e640 1 -- 172.21.15.31:0/419831346 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c3c14a620 con 0x7f5c3c0b9bd0 2024-04-15T00:31:38.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.041+0000 7f5c4331e640 1 -- 172.21.15.31:0/419831346 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c3c09fc50 con 0x7f5c3c0b9bd0 2024-04-15T00:31:38.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.042+0000 7f5c4331e640 1 -- 172.21.15.31:0/419831346 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c3c04f620 con 0x7f5c3c0b9bd0 2024-04-15T00:31:38.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.042+0000 7f5c31ffb640 1 -- 172.21.15.31:0/419831346 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f5c2c04d3f0 con 0x7f5c3c0b9bd0 2024-04-15T00:31:38.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.043+0000 7f5c31ffb640 1 --2- 172.21.15.31:0/419831346 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f5c2006b990 0x7f5c2006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:38.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.043+0000 7f5c31ffb640 1 -- 172.21.15.31:0/419831346 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f5c2c0ac6d0 con 0x7f5c3c0b9bd0 2024-04-15T00:31:38.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.043+0000 7f5c410ba640 1 --2- 172.21.15.31:0/419831346 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f5c2006b990 0x7f5c2006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:38.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.043+0000 7f5c410ba640 1 --2- 172.21.15.31:0/419831346 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f5c2006b990 0x7f5c2006de50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0b7450 tx=0x7f5c38008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:38.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.047+0000 7f5c31ffb640 1 -- 172.21.15.31:0/419831346 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f5c2c040070 con 0x7f5c3c0b9bd0 2024-04-15T00:31:38.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.227+0000 7f5c4331e640 1 -- 172.21.15.31:0/419831346 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5c3c09ff30 con 0x7f5c3c0b9bd0 2024-04-15T00:31:38.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.228+0000 7f5c31ffb640 1 -- 172.21.15.31:0/419831346 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f5c2c07af70 con 0x7f5c3c0b9bd0 2024-04-15T00:31:38.236 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-04-15T00:31:38.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.230+0000 7f5c4331e640 1 -- 172.21.15.31:0/419831346 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f5c2006b990 msgr2=0x7f5c2006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:38.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.230+0000 7f5c4331e640 1 --2- 172.21.15.31:0/419831346 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f5c2006b990 0x7f5c2006de50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0b7450 tx=0x7f5c38008040 comp rx=0 tx=0).stop 2024-04-15T00:31:38.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.230+0000 7f5c4331e640 1 -- 172.21.15.31:0/419831346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c3c0b9bd0 msgr2=0x7f5c3c140ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:38.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.230+0000 7f5c4331e640 1 --2- 172.21.15.31:0/419831346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c3c0b9bd0 0x7f5c3c140ca0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c000c00 tx=0x7f5c2c0046c0 comp rx=0 tx=0).stop 2024-04-15T00:31:38.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.230+0000 7f5c4331e640 1 -- 172.21.15.31:0/419831346 shutdown_connections 2024-04-15T00:31:38.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.230+0000 7f5c4331e640 1 --2- 172.21.15.31:0/419831346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c3c14b870 0x7f5c3c1411e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:38.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.230+0000 7f5c4331e640 1 --2- 172.21.15.31:0/419831346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c3c0b9bd0 0x7f5c3c140ca0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:38.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.230+0000 7f5c4331e640 1 --2- 172.21.15.31:0/419831346 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f5c2006b990 0x7f5c2006de50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:38.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.230+0000 7f5c4331e640 1 --2- 172.21.15.31:0/419831346 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f5c3c0b94f0 0x7f5c3c1e05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:38.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.230+0000 7f5c4331e640 1 -- 172.21.15.31:0/419831346 >> 172.21.15.31:0/419831346 conn(0x7f5c3c09ed70 msgr2=0x7f5c3c072d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:38.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.230+0000 7f5c4331e640 1 -- 172.21.15.31:0/419831346 shutdown_connections 2024-04-15T00:31:38.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.230+0000 7f5c4331e640 1 -- 172.21.15.31:0/419831346 wait complete. 2024-04-15T00:31:38.249 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-15T00:31:38.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.345+0000 7f6856599640 1 Processor -- start 2024-04-15T00:31:38.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.345+0000 7f6856599640 1 -- start start 2024-04-15T00:31:38.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.346+0000 7f6856599640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f685006c940 0x7f68500b0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:38.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.346+0000 7f6856599640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6850148830 con 0x7f68500af0c0 2024-04-15T00:31:38.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.346+0000 7f6856599640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68500af4a0 con 0x7f68500b4720 2024-04-15T00:31:38.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.346+0000 7f6856599640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f68500b2da0 con 0x7f685006c940 2024-04-15T00:31:38.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.346+0000 7f684f7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f685006c940 0x7f68500b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:38.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.346+0000 7f684ffff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f68500af0c0 0x7f6850147a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50224/0 (socket says 172.21.15.31:50224) 2024-04-15T00:31:38.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.346+0000 7f684ffff640 1 -- 172.21.15.31:0/4167742968 learned_addr learned my addr 172.21.15.31:0/4167742968 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:31:38.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.346+0000 7f684f7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f685006c940 0x7f68500b0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59074/0 (socket says 172.21.15.31:59074) 2024-04-15T00:31:38.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.346+0000 7f684f7fe640 1 -- 172.21.15.31:0/4167742968 >> v1:172.21.15.50:6789/0 conn(0x7f68500b4720 legacy=0x7f6850148120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:38.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.346+0000 7f684f7fe640 1 -- 172.21.15.31:0/4167742968 >> v1:172.21.15.31:6789/0 conn(0x7f68500af0c0 legacy=0x7f6850147a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:38.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.346+0000 7f684effd640 1 -- 172.21.15.31:0/4167742968 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2014897281 0 0) 0x7f6850148830 con 0x7f68500af0c0 2024-04-15T00:31:38.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.346+0000 7f684f7fe640 1 -- 172.21.15.31:0/4167742968 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68500b11f0 con 0x7f685006c940 2024-04-15T00:31:38.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.347+0000 7f684f7fe640 1 --2- 172.21.15.31:0/4167742968 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f685006c940 0x7f68500b0090 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f684400ba40 tx=0x7f684402e010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=640205be7187d365 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:38.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.347+0000 7f684effd640 1 -- 172.21.15.31:0/4167742968 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f684403b070 con 0x7f685006c940 2024-04-15T00:31:38.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.347+0000 7f684effd640 1 -- 172.21.15.31:0/4167742968 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f684402edc0 con 0x7f685006c940 2024-04-15T00:31:38.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.347+0000 7f684effd640 1 -- 172.21.15.31:0/4167742968 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6844036660 con 0x7f685006c940 2024-04-15T00:31:38.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.348+0000 7f6856599640 1 -- 172.21.15.31:0/4167742968 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f685006c940 msgr2=0x7f68500b0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:38.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.348+0000 7f6856599640 1 --2- 172.21.15.31:0/4167742968 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f685006c940 0x7f68500b0090 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f684400ba40 tx=0x7f684402e010 comp rx=0 tx=0).stop 2024-04-15T00:31:38.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.348+0000 7f6856599640 1 -- 172.21.15.31:0/4167742968 shutdown_connections 2024-04-15T00:31:38.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.348+0000 7f6856599640 1 --2- 172.21.15.31:0/4167742968 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f685006c940 0x7f68500b0090 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:38.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.348+0000 7f6856599640 1 -- 172.21.15.31:0/4167742968 >> 172.21.15.31:0/4167742968 conn(0x7f68500b8e70 msgr2=0x7f68500b9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:38.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.348+0000 7f6856599640 1 -- 172.21.15.31:0/4167742968 shutdown_connections 2024-04-15T00:31:38.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.348+0000 7f6856599640 1 -- 172.21.15.31:0/4167742968 wait complete. 2024-04-15T00:31:38.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.349+0000 7f6856599640 1 Processor -- start 2024-04-15T00:31:38.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.349+0000 7f6856599640 1 -- start start 2024-04-15T00:31:38.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.350+0000 7f6856599640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68500af0c0 0x7f685009d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:38.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.350+0000 7f6856599640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68500b4720 0x7f685009deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:38.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.350+0000 7f6856599640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68501dc2b0 0x7f68501dc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:38.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.350+0000 7f6856599640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f68500b4eb0 con 0x7f68500b4720 2024-04-15T00:31:38.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.350+0000 7f6856599640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f68500b4d30 con 0x7f68501dc2b0 2024-04-15T00:31:38.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.350+0000 7f6856599640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f68500b5030 con 0x7f68500af0c0 2024-04-15T00:31:38.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.350+0000 7f684f7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68500b4720 0x7f685009deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:38.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.350+0000 7f684f7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68500b4720 0x7f685009deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59080/0 (socket says 172.21.15.31:59080) 2024-04-15T00:31:38.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.350+0000 7f684f7fe640 1 -- 172.21.15.31:0/3102931720 learned_addr learned my addr 172.21.15.31:0/3102931720 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:38.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.350+0000 7f6854b36640 1 --2- 172.21.15.31:0/3102931720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68501dc2b0 0x7f68501dc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:38.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.350+0000 7f684f7fe640 1 -- 172.21.15.31:0/3102931720 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68500af0c0 msgr2=0x7f685009d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:38.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.350+0000 7f684f7fe640 1 --2- 172.21.15.31:0/3102931720 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68500af0c0 0x7f685009d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:38.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.350+0000 7f684f7fe640 1 -- 172.21.15.31:0/3102931720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68501dc2b0 msgr2=0x7f68501dc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:38.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.350+0000 7f684f7fe640 1 --2- 172.21.15.31:0/3102931720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68501dc2b0 0x7f68501dc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:38.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.350+0000 7f684f7fe640 1 -- 172.21.15.31:0/3102931720 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f685009c2b0 con 0x7f68500b4720 2024-04-15T00:31:38.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.350+0000 7f684f7fe640 1 --2- 172.21.15.31:0/3102931720 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68500b4720 0x7f685009deb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f684400bb60 tx=0x7f68440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:38.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.350+0000 7f684cff9640 1 -- 172.21.15.31:0/3102931720 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6844046020 con 0x7f68500b4720 2024-04-15T00:31:38.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.351+0000 7f684cff9640 1 -- 172.21.15.31:0/3102931720 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6844041690 con 0x7f68500b4720 2024-04-15T00:31:38.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.351+0000 7f6856599640 1 -- 172.21.15.31:0/3102931720 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f685009e630 con 0x7f68500b4720 2024-04-15T00:31:38.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.351+0000 7f684cff9640 1 -- 172.21.15.31:0/3102931720 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f684403b040 con 0x7f68500b4720 2024-04-15T00:31:38.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.351+0000 7f6856599640 1 -- 172.21.15.31:0/3102931720 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f685009c5c0 con 0x7f68500b4720 2024-04-15T00:31:38.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.352+0000 7f6856599640 1 -- 172.21.15.31:0/3102931720 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f685004f540 con 0x7f68500b4720 2024-04-15T00:31:38.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.352+0000 7f684cff9640 1 -- 172.21.15.31:0/3102931720 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f6844049020 con 0x7f68500b4720 2024-04-15T00:31:38.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.352+0000 7f684cff9640 1 --2- 172.21.15.31:0/3102931720 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f683c06b9c0 0x7f683c06de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:38.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.353+0000 7f684cff9640 1 -- 172.21.15.31:0/3102931720 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f68440af6b0 con 0x7f68500b4720 2024-04-15T00:31:38.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.353+0000 7f684ffff640 1 --2- 172.21.15.31:0/3102931720 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f683c06b9c0 0x7f683c06de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:38.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.353+0000 7f684ffff640 1 --2- 172.21.15.31:0/3102931720 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f683c06b9c0 0x7f683c06de80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6840007fd0 tx=0x7f6840007920 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:38.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.357+0000 7f684cff9640 1 -- 172.21.15.31:0/3102931720 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6844050030 con 0x7f68500b4720 2024-04-15T00:31:38.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.537+0000 7f6856599640 1 -- 172.21.15.31:0/3102931720 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f68500b7c00 con 0x7f68500b4720 2024-04-15T00:31:38.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.538+0000 7f684cff9640 1 -- 172.21.15.31:0/3102931720 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f684407e070 con 0x7f68500b4720 2024-04-15T00:31:38.546 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-15T00:31:38.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.540+0000 7f6856599640 1 -- 172.21.15.31:0/3102931720 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f683c06b9c0 msgr2=0x7f683c06de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:38.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.540+0000 7f6856599640 1 --2- 172.21.15.31:0/3102931720 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f683c06b9c0 0x7f683c06de80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6840007fd0 tx=0x7f6840007920 comp rx=0 tx=0).stop 2024-04-15T00:31:38.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.540+0000 7f6856599640 1 -- 172.21.15.31:0/3102931720 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68500b4720 msgr2=0x7f685009deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:38.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.540+0000 7f6856599640 1 --2- 172.21.15.31:0/3102931720 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68500b4720 0x7f685009deb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f684400bb60 tx=0x7f68440046c0 comp rx=0 tx=0).stop 2024-04-15T00:31:38.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.540+0000 7f6856599640 1 -- 172.21.15.31:0/3102931720 shutdown_connections 2024-04-15T00:31:38.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.540+0000 7f6856599640 1 --2- 172.21.15.31:0/3102931720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68501dc2b0 0x7f68501dc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:38.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.540+0000 7f6856599640 1 --2- 172.21.15.31:0/3102931720 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68500b4720 0x7f685009deb0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:38.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.540+0000 7f6856599640 1 --2- 172.21.15.31:0/3102931720 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f683c06b9c0 0x7f683c06de80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:38.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.540+0000 7f6856599640 1 --2- 172.21.15.31:0/3102931720 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68500af0c0 0x7f685009d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:38.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.540+0000 7f6856599640 1 -- 172.21.15.31:0/3102931720 >> 172.21.15.31:0/3102931720 conn(0x7f68500b8e70 msgr2=0x7f6850148290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:38.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.540+0000 7f6856599640 1 -- 172.21.15.31:0/3102931720 shutdown_connections 2024-04-15T00:31:38.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.540+0000 7f6856599640 1 -- 172.21.15.31:0/3102931720 wait complete. 2024-04-15T00:31:38.561 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-15T00:31:38.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.655+0000 7f6867999640 1 Processor -- start 2024-04-15T00:31:38.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.655+0000 7f6867999640 1 -- start start 2024-04-15T00:31:38.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.656+0000 7f6867999640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f68600b80d0 0x7f6860072570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:38.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.656+0000 7f6867999640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f686014b4c0 0x7f68601449c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:38.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.656+0000 7f6867999640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6860072c90 con 0x7f68600b8be0 2024-04-15T00:31:38.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.656+0000 7f6867999640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f686009c0e0 con 0x7f68600b80d0 2024-04-15T00:31:38.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.656+0000 7f6867999640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f68600b84b0 con 0x7f686014b4c0 2024-04-15T00:31:38.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.656+0000 7f6865735640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f68600b80d0 0x7f6860072570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:38.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.656+0000 7f6865735640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f68600b80d0 0x7f6860072570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59096/0 (socket says 172.21.15.31:59096) 2024-04-15T00:31:38.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.656+0000 7f6865735640 1 -- 172.21.15.31:0/1882545333 learned_addr learned my addr 172.21.15.31:0/1882545333 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:38.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.656+0000 7f6865f36640 1 --2- 172.21.15.31:0/1882545333 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f686014b4c0 0x7f68601449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:38.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.656+0000 7f6865735640 1 -- 172.21.15.31:0/1882545333 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f686014b4c0 msgr2=0x7f68601449c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:38.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.656+0000 7f6865735640 1 --2- 172.21.15.31:0/1882545333 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f686014b4c0 0x7f68601449c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:38.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.656+0000 7f6865735640 1 -- 172.21.15.31:0/1882545333 >> v1:172.21.15.50:6789/0 conn(0x7f68600b8be0 legacy=0x7f686014adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:38.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.657+0000 7f6865735640 1 -- 172.21.15.31:0/1882545333 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f686009c380 con 0x7f68600b80d0 2024-04-15T00:31:38.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.657+0000 7f6865735640 1 --2- 172.21.15.31:0/1882545333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68600b80d0 0x7f6860072570 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6858009870 tx=0x7f685802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c91167ce073cc45 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:38.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.657+0000 7f685ffff640 1 -- 172.21.15.31:0/1882545333 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68580317c0 con 0x7f68600b80d0 2024-04-15T00:31:38.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.657+0000 7f685ffff640 1 -- 172.21.15.31:0/1882545333 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6858037070 con 0x7f68600b80d0 2024-04-15T00:31:38.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.657+0000 7f685ffff640 1 -- 172.21.15.31:0/1882545333 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6858031b80 con 0x7f68600b80d0 2024-04-15T00:31:38.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.658+0000 7f6867999640 1 -- 172.21.15.31:0/1882545333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68600b80d0 msgr2=0x7f6860072570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:38.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.658+0000 7f6867999640 1 --2- 172.21.15.31:0/1882545333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68600b80d0 0x7f6860072570 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6858009870 tx=0x7f685802b860 comp rx=0 tx=0).stop 2024-04-15T00:31:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.658+0000 7f6867999640 1 -- 172.21.15.31:0/1882545333 shutdown_connections 2024-04-15T00:31:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.658+0000 7f6867999640 1 --2- 172.21.15.31:0/1882545333 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f686014b4c0 0x7f68601449c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.658+0000 7f6867999640 1 --2- 172.21.15.31:0/1882545333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68600b80d0 0x7f6860072570 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.658+0000 7f6867999640 1 -- 172.21.15.31:0/1882545333 >> 172.21.15.31:0/1882545333 conn(0x7f68600bd020 msgr2=0x7f68600bd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:38.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.658+0000 7f6867999640 1 -- 172.21.15.31:0/1882545333 shutdown_connections 2024-04-15T00:31:38.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.658+0000 7f6867999640 1 -- 172.21.15.31:0/1882545333 wait complete. 2024-04-15T00:31:38.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.659+0000 7f6867999640 1 Processor -- start 2024-04-15T00:31:38.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.659+0000 7f6867999640 1 -- start start 2024-04-15T00:31:38.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.660+0000 7f6867999640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68600b80d0 0x7f68601466c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:38.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.660+0000 7f6867999640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68600b8be0 0x7f68601e0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:38.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.660+0000 7f6867999640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f686014b4c0 0x7f68601e1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:38.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.660+0000 7f6867999640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6860145080 con 0x7f68600b80d0 2024-04-15T00:31:38.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.660+0000 7f6867999640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6860144f00 con 0x7f686014b4c0 2024-04-15T00:31:38.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.660+0000 7f6867999640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f6860145200 con 0x7f68600b8be0 2024-04-15T00:31:38.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.660+0000 7f6865735640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68600b80d0 0x7f68601466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:38.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.660+0000 7f6865735640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68600b80d0 0x7f68601466c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59110/0 (socket says 172.21.15.31:59110) 2024-04-15T00:31:38.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.660+0000 7f6865735640 1 -- 172.21.15.31:0/2860808781 learned_addr learned my addr 172.21.15.31:0/2860808781 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:38.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.660+0000 7f6865f36640 1 --2- 172.21.15.31:0/2860808781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f686014b4c0 0x7f68601e1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:38.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.660+0000 7f6864f34640 1 --2- 172.21.15.31:0/2860808781 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68600b8be0 0x7f68601e0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:38.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.660+0000 7f6865735640 1 -- 172.21.15.31:0/2860808781 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68600b8be0 msgr2=0x7f68601e0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:38.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.660+0000 7f6865735640 1 --2- 172.21.15.31:0/2860808781 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68600b8be0 0x7f68601e0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:38.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.660+0000 7f6865735640 1 -- 172.21.15.31:0/2860808781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f686014b4c0 msgr2=0x7f68601e1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:38.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.660+0000 7f6865735640 1 --2- 172.21.15.31:0/2860808781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f686014b4c0 0x7f68601e1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:38.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.660+0000 7f6865735640 1 -- 172.21.15.31:0/2860808781 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68600b6e40 con 0x7f68600b80d0 2024-04-15T00:31:38.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.660+0000 7f6865f36640 1 --2- 172.21.15.31:0/2860808781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f686014b4c0 0x7f68601e1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:31:38.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.660+0000 7f6864f34640 1 --2- 172.21.15.31:0/2860808781 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68600b8be0 0x7f68601e0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:31:38.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.660+0000 7f6865735640 1 --2- 172.21.15.31:0/2860808781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68600b80d0 0x7f68601466c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f685802b8a0 tx=0x7f68580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:38.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.660+0000 7f685dffb640 1 -- 172.21.15.31:0/2860808781 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6858032860 con 0x7f68600b80d0 2024-04-15T00:31:38.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.660+0000 7f685dffb640 1 -- 172.21.15.31:0/2860808781 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6858032a00 con 0x7f68600b80d0 2024-04-15T00:31:38.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.660+0000 7f6867999640 1 -- 172.21.15.31:0/2860808781 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68601480a0 con 0x7f68600b80d0 2024-04-15T00:31:38.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.661+0000 7f685dffb640 1 -- 172.21.15.31:0/2860808781 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6858032df0 con 0x7f68600b80d0 2024-04-15T00:31:38.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.661+0000 7f6867999640 1 -- 172.21.15.31:0/2860808781 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6860146f90 con 0x7f68600b80d0 2024-04-15T00:31:38.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.662+0000 7f6867999640 1 -- 172.21.15.31:0/2860808781 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f686009f730 con 0x7f68600b80d0 2024-04-15T00:31:38.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.662+0000 7f685dffb640 1 -- 172.21.15.31:0/2860808781 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f685804c060 con 0x7f68600b80d0 2024-04-15T00:31:38.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.663+0000 7f685dffb640 1 --2- 172.21.15.31:0/2860808781 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f684c06b990 0x7f684c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:38.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.663+0000 7f6864f34640 1 --2- 172.21.15.31:0/2860808781 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f684c06b990 0x7f684c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:38.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.663+0000 7f685dffb640 1 -- 172.21.15.31:0/2860808781 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f68580ac980 con 0x7f68600b80d0 2024-04-15T00:31:38.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.663+0000 7f6864f34640 1 --2- 172.21.15.31:0/2860808781 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f684c06b990 0x7f684c06de50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f68600b6880 tx=0x7f6854009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:38.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.667+0000 7f685dffb640 1 -- 172.21.15.31:0/2860808781 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6858040070 con 0x7f68600b80d0 2024-04-15T00:31:38.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.861+0000 7f6867999640 1 -- 172.21.15.31:0/2860808781 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f686004f620 con 0x7f68600b80d0 2024-04-15T00:31:38.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.861+0000 7f685dffb640 1 -- 172.21.15.31:0/2860808781 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f685807ab50 con 0x7f68600b80d0 2024-04-15T00:31:38.869 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-04-15T00:31:38.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.863+0000 7f6867999640 1 -- 172.21.15.31:0/2860808781 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f684c06b990 msgr2=0x7f684c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:38.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.863+0000 7f6867999640 1 --2- 172.21.15.31:0/2860808781 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f684c06b990 0x7f684c06de50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f68600b6880 tx=0x7f6854009040 comp rx=0 tx=0).stop 2024-04-15T00:31:38.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.863+0000 7f6867999640 1 -- 172.21.15.31:0/2860808781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68600b80d0 msgr2=0x7f68601466c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:38.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.863+0000 7f6867999640 1 --2- 172.21.15.31:0/2860808781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68600b80d0 0x7f68601466c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f685802b8a0 tx=0x7f68580046c0 comp rx=0 tx=0).stop 2024-04-15T00:31:38.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.863+0000 7f6867999640 1 -- 172.21.15.31:0/2860808781 shutdown_connections 2024-04-15T00:31:38.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.863+0000 7f6867999640 1 --2- 172.21.15.31:0/2860808781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f686014b4c0 0x7f68601e1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:38.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.863+0000 7f6867999640 1 --2- 172.21.15.31:0/2860808781 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f684c06b990 0x7f684c06de50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:38.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.863+0000 7f6867999640 1 --2- 172.21.15.31:0/2860808781 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f68600b8be0 0x7f68601e0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:38.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.863+0000 7f6867999640 1 --2- 172.21.15.31:0/2860808781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68600b80d0 0x7f68601466c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:38.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.863+0000 7f6867999640 1 -- 172.21.15.31:0/2860808781 >> 172.21.15.31:0/2860808781 conn(0x7f68600bd020 msgr2=0x7f68600bac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:38.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.863+0000 7f6867999640 1 -- 172.21.15.31:0/2860808781 shutdown_connections 2024-04-15T00:31:38.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:38.863+0000 7f6867999640 1 -- 172.21.15.31:0/2860808781 wait complete. 2024-04-15T00:31:38.882 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-15T00:31:38.882 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T00:31:38.897 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:31:39.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.032+0000 7fc32c9d8640 1 Processor -- start 2024-04-15T00:31:39.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.032+0000 7fc32c9d8640 1 -- start start 2024-04-15T00:31:39.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.032+0000 7fc32c9d8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3280b56b0 0x7fc328148080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:39.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.032+0000 7fc32c9d8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc3280b5a90 0x7fc3280b6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:39.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.032+0000 7fc32c9d8640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc32806c6d0 0x7fc3280b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:39.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.032+0000 7fc32c9d8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fc328147bf0 con 0x7fc3280b5a90 2024-04-15T00:31:39.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.032+0000 7fc32c9d8640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc32806cc20 con 0x7fc3280b56b0 2024-04-15T00:31:39.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.032+0000 7fc32c9d8640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fc32806bcf0 con 0x7fc32806c6d0 2024-04-15T00:31:39.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.033+0000 7fc31dd9b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc3280b5a90 0x7fc3280b6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:39.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.033+0000 7fc31dd9b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc3280b5a90 0x7fc3280b6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59126/0 (socket says 172.21.15.31:59126) 2024-04-15T00:31:39.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.033+0000 7fc31dd9b640 1 -- 172.21.15.31:0/517199240 learned_addr learned my addr 172.21.15.31:0/517199240 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:39.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.033+0000 7fc32659c640 1 --2- 172.21.15.31:0/517199240 >> v2:172.21.15.50:3300/0 conn(0x7fc3280b56b0 0x7fc328148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:39.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.033+0000 7fc326d9d640 1 --2- 172.21.15.31:0/517199240 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc32806c6d0 0x7fc3280b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:39.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.033+0000 7fc31dd9b640 1 -- 172.21.15.31:0/517199240 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc32806c6d0 msgr2=0x7fc3280b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:39.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.033+0000 7fc31dd9b640 1 --2- 172.21.15.31:0/517199240 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc32806c6d0 0x7fc3280b6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.033+0000 7fc31dd9b640 1 -- 172.21.15.31:0/517199240 >> v2:172.21.15.50:3300/0 conn(0x7fc3280b56b0 msgr2=0x7fc328148080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:39.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.033+0000 7fc31dd9b640 1 --2- 172.21.15.31:0/517199240 >> v2:172.21.15.50:3300/0 conn(0x7fc3280b56b0 0x7fc328148080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.033+0000 7fc31dd9b640 1 -- 172.21.15.31:0/517199240 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc328147880 con 0x7fc3280b5a90 2024-04-15T00:31:39.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.033+0000 7fc32659c640 1 --2- 172.21.15.31:0/517199240 >> v2:172.21.15.50:3300/0 conn(0x7fc3280b56b0 0x7fc328148080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:31:39.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.034+0000 7fc31dd9b640 1 --2- 172.21.15.31:0/517199240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3280b5a90 0x7fc3280b6820 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc328074e60 tx=0x7fc31002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc6a4fdd7dd0df6 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:39.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.034+0000 7fc325d9b640 1 -- 172.21.15.31:0/517199240 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31002e070 con 0x7fc3280b5a90 2024-04-15T00:31:39.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.034+0000 7fc325d9b640 1 -- 172.21.15.31:0/517199240 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc310037070 con 0x7fc3280b5a90 2024-04-15T00:31:39.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.034+0000 7fc325d9b640 1 -- 172.21.15.31:0/517199240 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc310031a00 con 0x7fc3280b5a90 2024-04-15T00:31:39.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.034+0000 7fc32c9d8640 1 -- 172.21.15.31:0/517199240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3280b5a90 msgr2=0x7fc3280b6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:39.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.034+0000 7fc32c9d8640 1 --2- 172.21.15.31:0/517199240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3280b5a90 0x7fc3280b6820 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc328074e60 tx=0x7fc31002b880 comp rx=0 tx=0).stop 2024-04-15T00:31:39.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.034+0000 7fc32c9d8640 1 -- 172.21.15.31:0/517199240 shutdown_connections 2024-04-15T00:31:39.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.034+0000 7fc32c9d8640 1 --2- 172.21.15.31:0/517199240 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc32806c6d0 0x7fc3280b6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.034+0000 7fc32c9d8640 1 --2- 172.21.15.31:0/517199240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3280b5a90 0x7fc3280b6820 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.034+0000 7fc32c9d8640 1 --2- 172.21.15.31:0/517199240 >> v2:172.21.15.50:3300/0 conn(0x7fc3280b56b0 0x7fc328148080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.034+0000 7fc32c9d8640 1 -- 172.21.15.31:0/517199240 >> 172.21.15.31:0/517199240 conn(0x7fc3280b77b0 msgr2=0x7fc3280b7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:39.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.034+0000 7fc32c9d8640 1 -- 172.21.15.31:0/517199240 shutdown_connections 2024-04-15T00:31:39.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.034+0000 7fc32c9d8640 1 -- 172.21.15.31:0/517199240 wait complete. 2024-04-15T00:31:39.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.036+0000 7fc32c9d8640 1 Processor -- start 2024-04-15T00:31:39.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.036+0000 7fc32c9d8640 1 -- start start 2024-04-15T00:31:39.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.036+0000 7fc32c9d8640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc32806c6d0 0x7fc328143bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:39.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.036+0000 7fc32c9d8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3280b56b0 0x7fc3281e0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:39.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.036+0000 7fc32c9d8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3280b5a90 0x7fc328142690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:39.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.036+0000 7fc32c9d8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc3280b6240 con 0x7fc3280b5a90 2024-04-15T00:31:39.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.036+0000 7fc32c9d8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc3280b60c0 con 0x7fc3280b56b0 2024-04-15T00:31:39.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.036+0000 7fc32c9d8640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fc32806d050 con 0x7fc32806c6d0 2024-04-15T00:31:39.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.036+0000 7fc326d9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3280b5a90 0x7fc328142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:39.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.036+0000 7fc326d9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3280b5a90 0x7fc328142690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59136/0 (socket says 172.21.15.31:59136) 2024-04-15T00:31:39.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.036+0000 7fc326d9d640 1 -- 172.21.15.31:0/3438550195 learned_addr learned my addr 172.21.15.31:0/3438550195 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:39.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.036+0000 7fc31dd9b640 1 --2- 172.21.15.31:0/3438550195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3280b56b0 0x7fc3281e0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:39.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.036+0000 7fc32659c640 1 --2- 172.21.15.31:0/3438550195 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc32806c6d0 0x7fc328143bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:39.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.037+0000 7fc326d9d640 1 -- 172.21.15.31:0/3438550195 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc32806c6d0 msgr2=0x7fc328143bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:39.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.037+0000 7fc326d9d640 1 --2- 172.21.15.31:0/3438550195 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc32806c6d0 0x7fc328143bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.037+0000 7fc326d9d640 1 -- 172.21.15.31:0/3438550195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3280b56b0 msgr2=0x7fc3281e0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:39.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.037+0000 7fc326d9d640 1 --2- 172.21.15.31:0/3438550195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3280b56b0 0x7fc3281e0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.037+0000 7fc326d9d640 1 -- 172.21.15.31:0/3438550195 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3281489d0 con 0x7fc3280b5a90 2024-04-15T00:31:39.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.037+0000 7fc326d9d640 1 --2- 172.21.15.31:0/3438550195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3280b5a90 0x7fc328142690 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc32000cb80 tx=0x7fc32000a4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:39.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.037+0000 7fc31f7fe640 1 -- 172.21.15.31:0/3438550195 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc320015070 con 0x7fc3280b5a90 2024-04-15T00:31:39.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.037+0000 7fc31f7fe640 1 -- 172.21.15.31:0/3438550195 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc32000abd0 con 0x7fc3280b5a90 2024-04-15T00:31:39.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.037+0000 7fc32c9d8640 1 -- 172.21.15.31:0/3438550195 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3281e0480 con 0x7fc3280b5a90 2024-04-15T00:31:39.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.037+0000 7fc31f7fe640 1 -- 172.21.15.31:0/3438550195 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32000d040 con 0x7fc3280b5a90 2024-04-15T00:31:39.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.037+0000 7fc32c9d8640 1 -- 172.21.15.31:0/3438550195 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc328144130 con 0x7fc3280b5a90 2024-04-15T00:31:39.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.038+0000 7fc32c9d8640 1 -- 172.21.15.31:0/3438550195 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc32804f620 con 0x7fc3280b5a90 2024-04-15T00:31:39.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.039+0000 7fc31f7fe640 1 -- 172.21.15.31:0/3438550195 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc320018070 con 0x7fc3280b5a90 2024-04-15T00:31:39.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.039+0000 7fc31f7fe640 1 --2- 172.21.15.31:0/3438550195 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc30806b990 0x7fc30806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:39.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.039+0000 7fc31f7fe640 1 -- 172.21.15.31:0/3438550195 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fc32008a720 con 0x7fc3280b5a90 2024-04-15T00:31:39.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.039+0000 7fc32659c640 1 --2- 172.21.15.31:0/3438550195 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc30806b990 0x7fc30806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:39.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.039+0000 7fc32659c640 1 --2- 172.21.15.31:0/3438550195 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc30806b990 0x7fc30806de50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc31800ab60 tx=0x7fc318008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:39.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.043+0000 7fc31f7fe640 1 -- 172.21.15.31:0/3438550195 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc3281489d0 con 0x7fc3280b5a90 2024-04-15T00:31:39.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.225+0000 7fc32c9d8640 1 -- 172.21.15.31:0/3438550195 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc3281e1180 con 0x7fc3280b5a90 2024-04-15T00:31:39.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.227+0000 7fc31f7fe640 1 -- 172.21.15.31:0/3438550195 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18841 (secure 0 0 0) 0x7fc320058970 con 0x7fc3280b5a90 2024-04-15T00:31:39.235 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:31:39.235 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":27,"fsid":"b57c03ab-2810-4ea5-b233-6164468328c0","created":"2024-04-15T00:20:44.073217+0000","modified":"2024-04-15T00:21:49.696289+0000","last_up_change":"2024-04-15T00:20:55.515596+0000","last_in_change":"2024-04-15T00:20:46.364541+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:20:56.423161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:21:06.436169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:21:06.888505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:21:10.610300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b085a2f4-5565-4ccc-a98e-e56180791550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6817","nonce":2355720818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6819","nonce":2355720818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6823","nonce":2355720818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6821","nonce":2355720818}]},"public_addr":"172.21.15.31:6817/2355720818","cluster_addr":"172.21.15.31:6819/2355720818","heartbeat_back_addr":"172.21.15.31:6823/2355720818","heartbeat_front_addr":"172.21.15.31:6821/2355720818","state":["exists","up"]},{"osd":1,"uuid":"0f751557-3f18-464f-8b78-614d19549f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6809","nonce":2705297130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6811","nonce":2705297130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6815","nonce":2705297130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6813","nonce":2705297130}]},"public_addr":"172.21.15.31:6809/2705297130","cluster_addr":"172.21.15.31:6811/2705297130","heartbeat_back_addr":"172.21.15.31:6815/2705297130","heartbeat_front_addr":"172.21.15.31:6813/2705297130","state":["exists","up"]},{"osd":2,"uuid":"17371b09-2bd7-4ef7-926f-e7706319f064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6801","nonce":225061474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6803","nonce":225061474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6807","nonce":225061474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6805","nonce":225061474}]},"public_addr":"172.21.15.31:6801/225061474","cluster_addr":"172.21.15.31:6803/225061474","heartbeat_back_addr":"172.21.15.31:6807/225061474","heartbeat_front_addr":"172.21.15.31:6805/225061474","state":["exists","up"]},{"osd":3,"uuid":"315b6949-f009-4291-9581-aa4912642dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6825","nonce":3722449780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6827","nonce":3722449780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6831","nonce":3722449780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6829","nonce":3722449780}]},"public_addr":"172.21.15.31:6825/3722449780","cluster_addr":"172.21.15.31:6827/3722449780","heartbeat_back_addr":"172.21.15.31:6831/3722449780","heartbeat_front_addr":"172.21.15.31:6829/3722449780","state":["exists","up"]},{"osd":4,"uuid":"e3659369-cc78-4aa8-bd10-a199d4a1569d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6801","nonce":1279970071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6803","nonce":1279970071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6807","nonce":1279970071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6805","nonce":1279970071}]},"public_addr":"172.21.15.50:6801/1279970071","cluster_addr":"172.21.15.50:6803/1279970071","heartbeat_back_addr":"172.21.15.50:6807/1279970071","heartbeat_front_addr":"172.21.15.50:6805/1279970071","state":["exists","up"]},{"osd":5,"uuid":"35c3a4c0-0b45-45d2-85b9-301c347602f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6809","nonce":1589417182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6811","nonce":1589417182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6815","nonce":1589417182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6813","nonce":1589417182}]},"public_addr":"172.21.15.50:6809/1589417182","cluster_addr":"172.21.15.50:6811/1589417182","heartbeat_back_addr":"172.21.15.50:6815/1589417182","heartbeat_front_addr":"172.21.15.50:6813/1589417182","state":["exists","up"]},{"osd":6,"uuid":"20df7a76-245f-4946-9624-6ca9e949227b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6817","nonce":682288274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6819","nonce":682288274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6823","nonce":682288274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6821","nonce":682288274}]},"public_addr":"172.21.15.50:6817/682288274","cluster_addr":"172.21.15.50:6819/682288274","heartbeat_back_addr":"172.21.15.50:6823/682288274","heartbeat_front_addr":"172.21.15.50:6821/682288274","state":["exists","up"]},{"osd":7,"uuid":"95a504b7-e13a-49e6-8484-9dff4d5fc048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6825","nonce":4129060906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6827","nonce":4129060906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6831","nonce":4129060906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6829","nonce":4129060906}]},"public_addr":"172.21.15.50:6825/4129060906","cluster_addr":"172.21.15.50:6827/4129060906","heartbeat_back_addr":"172.21.15.50:6831/4129060906","heartbeat_front_addr":"172.21.15.50:6829/4129060906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.501980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.529961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.540913+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.521396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.448364+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.514136+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.527229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.508950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:31:39.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.229+0000 7fc32c9d8640 1 -- 172.21.15.31:0/3438550195 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc30806b990 msgr2=0x7fc30806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:39.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.229+0000 7fc32c9d8640 1 --2- 172.21.15.31:0/3438550195 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc30806b990 0x7fc30806de50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc31800ab60 tx=0x7fc318008040 comp rx=0 tx=0).stop 2024-04-15T00:31:39.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.229+0000 7fc32c9d8640 1 -- 172.21.15.31:0/3438550195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3280b5a90 msgr2=0x7fc328142690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:39.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.229+0000 7fc32c9d8640 1 --2- 172.21.15.31:0/3438550195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3280b5a90 0x7fc328142690 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc32000cb80 tx=0x7fc32000a4c0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.229+0000 7fc32c9d8640 1 -- 172.21.15.31:0/3438550195 shutdown_connections 2024-04-15T00:31:39.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.229+0000 7fc32c9d8640 1 --2- 172.21.15.31:0/3438550195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3280b5a90 0x7fc328142690 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.229+0000 7fc32c9d8640 1 --2- 172.21.15.31:0/3438550195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3280b56b0 0x7fc3281e0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.229+0000 7fc32c9d8640 1 --2- 172.21.15.31:0/3438550195 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc30806b990 0x7fc30806de50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.229+0000 7fc32c9d8640 1 --2- 172.21.15.31:0/3438550195 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc32806c6d0 0x7fc328143bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.229+0000 7fc32c9d8640 1 -- 172.21.15.31:0/3438550195 >> 172.21.15.31:0/3438550195 conn(0x7fc3280b77b0 msgr2=0x7fc328146cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:39.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.229+0000 7fc32c9d8640 1 -- 172.21.15.31:0/3438550195 shutdown_connections 2024-04-15T00:31:39.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.229+0000 7fc32c9d8640 1 -- 172.21.15.31:0/3438550195 wait complete. 2024-04-15T00:31:39.248 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T00:20:56.423161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T00:21:06.436169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T00:21:06.888505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-15T00:21:10.610300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-15T00:31:39.249 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T00:31:39.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.346+0000 7f3a3d3d8640 1 Processor -- start 2024-04-15T00:31:39.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.346+0000 7f3a3d3d8640 1 -- start start 2024-04-15T00:31:39.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.346+0000 7f3a3d3d8640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a380baef0 0x7f3a38147670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:39.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.346+0000 7f3a3d3d8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3a380b8bf0 0x7f3a38151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:39.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.346+0000 7f3a3d3d8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a380bb2d0 con 0x7f3a3814b8e0 2024-04-15T00:31:39.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.346+0000 7f3a3d3d8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f3a38147bb0 con 0x7f3a380b8bf0 2024-04-15T00:31:39.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.346+0000 7f3a3d3d8640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f3a3814ae00 con 0x7f3a380baef0 2024-04-15T00:31:39.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.346+0000 7f3a377fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3a380b8bf0 0x7f3a38151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:39.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.346+0000 7f3a377fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3a380b8bf0 0x7f3a38151ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59152/0 (socket says 172.21.15.31:59152) 2024-04-15T00:31:39.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.346+0000 7f3a377fe640 1 -- 172.21.15.31:0/2145197953 learned_addr learned my addr 172.21.15.31:0/2145197953 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:39.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.347+0000 7f3a36ffd640 1 --2- 172.21.15.31:0/2145197953 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a380baef0 0x7f3a38147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:39.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.347+0000 7f3a377fe640 1 -- 172.21.15.31:0/2145197953 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a380baef0 msgr2=0x7f3a38147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:39.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.347+0000 7f3a377fe640 1 --2- 172.21.15.31:0/2145197953 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a380baef0 0x7f3a38147670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.347+0000 7f3a377fe640 1 -- 172.21.15.31:0/2145197953 >> v1:172.21.15.50:6789/0 conn(0x7f3a3814b8e0 legacy=0x7f3a380b9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:39.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.347+0000 7f3a377fe640 1 -- 172.21.15.31:0/2145197953 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a3814b0e0 con 0x7f3a380b8bf0 2024-04-15T00:31:39.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.347+0000 7f3a377fe640 1 --2- 172.21.15.31:0/2145197953 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a380b8bf0 0x7f3a38151ff0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3a30009e50 tx=0x7f3a3002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b1cb00e44641638 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:39.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.348+0000 7f3a367fc640 1 -- 172.21.15.31:0/2145197953 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3002c9e0 con 0x7f3a380b8bf0 2024-04-15T00:31:39.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.348+0000 7f3a367fc640 1 -- 172.21.15.31:0/2145197953 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a3002cb80 con 0x7f3a380b8bf0 2024-04-15T00:31:39.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.348+0000 7f3a367fc640 1 -- 172.21.15.31:0/2145197953 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a300343f0 con 0x7f3a380b8bf0 2024-04-15T00:31:39.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.348+0000 7f3a3d3d8640 1 -- 172.21.15.31:0/2145197953 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a380b8bf0 msgr2=0x7f3a38151ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:39.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.348+0000 7f3a3d3d8640 1 --2- 172.21.15.31:0/2145197953 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a380b8bf0 0x7f3a38151ff0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3a30009e50 tx=0x7f3a3002be40 comp rx=0 tx=0).stop 2024-04-15T00:31:39.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.348+0000 7f3a3d3d8640 1 -- 172.21.15.31:0/2145197953 shutdown_connections 2024-04-15T00:31:39.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.348+0000 7f3a3d3d8640 1 --2- 172.21.15.31:0/2145197953 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a380b8bf0 0x7f3a38151ff0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.348+0000 7f3a3d3d8640 1 --2- 172.21.15.31:0/2145197953 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a380baef0 0x7f3a38147670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.348+0000 7f3a3d3d8640 1 -- 172.21.15.31:0/2145197953 >> 172.21.15.31:0/2145197953 conn(0x7f3a3809ed70 msgr2=0x7f3a3809f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:39.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.348+0000 7f3a3d3d8640 1 -- 172.21.15.31:0/2145197953 shutdown_connections 2024-04-15T00:31:39.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.348+0000 7f3a3d3d8640 1 -- 172.21.15.31:0/2145197953 wait complete. 2024-04-15T00:31:39.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.349+0000 7f3a3d3d8640 1 Processor -- start 2024-04-15T00:31:39.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.349+0000 7f3a3d3d8640 1 -- start start 2024-04-15T00:31:39.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.350+0000 7f3a3d3d8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a380b8bf0 0x7f3a38140ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:39.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.350+0000 7f3a3d3d8640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a380baef0 0x7f3a381411e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:39.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.350+0000 7f3a3d3d8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a3814b8e0 0x7f3a38149a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:39.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.350+0000 7f3a3d3d8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3a380b91e0 con 0x7f3a380b8bf0 2024-04-15T00:31:39.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.350+0000 7f3a3d3d8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3a380b9060 con 0x7f3a3814b8e0 2024-04-15T00:31:39.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.350+0000 7f3a3d3d8640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f3a380b9360 con 0x7f3a380baef0 2024-04-15T00:31:39.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.350+0000 7f3a36ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a380b8bf0 0x7f3a38140ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:39.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.350+0000 7f3a36ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a380b8bf0 0x7f3a38140ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59168/0 (socket says 172.21.15.31:59168) 2024-04-15T00:31:39.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.350+0000 7f3a36ffd640 1 -- 172.21.15.31:0/1916924495 learned_addr learned my addr 172.21.15.31:0/1916924495 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:39.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.350+0000 7f3a36ffd640 1 -- 172.21.15.31:0/1916924495 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a380baef0 msgr2=0x7f3a381411e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:39.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.350+0000 7f3a36ffd640 1 --2- 172.21.15.31:0/1916924495 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a380baef0 0x7f3a381411e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.350+0000 7f3a36ffd640 1 -- 172.21.15.31:0/1916924495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a3814b8e0 msgr2=0x7f3a38149a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:39.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.350+0000 7f3a36ffd640 1 --2- 172.21.15.31:0/1916924495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a3814b8e0 0x7f3a38149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.350+0000 7f3a36ffd640 1 -- 172.21.15.31:0/1916924495 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a38142bf0 con 0x7f3a380b8bf0 2024-04-15T00:31:39.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.350+0000 7f3a36ffd640 1 --2- 172.21.15.31:0/1916924495 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a380b8bf0 0x7f3a38140ca0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3a2800c7f0 tx=0x7f3a2800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:39.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.350+0000 7f3a2f7fe640 1 -- 172.21.15.31:0/1916924495 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a28015070 con 0x7f3a380b8bf0 2024-04-15T00:31:39.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.350+0000 7f3a2f7fe640 1 -- 172.21.15.31:0/1916924495 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a28004220 con 0x7f3a380b8bf0 2024-04-15T00:31:39.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.351+0000 7f3a3d3d8640 1 -- 172.21.15.31:0/1916924495 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a381e1a70 con 0x7f3a380b8bf0 2024-04-15T00:31:39.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.351+0000 7f3a2f7fe640 1 -- 172.21.15.31:0/1916924495 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a28007620 con 0x7f3a380b8bf0 2024-04-15T00:31:39.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.351+0000 7f3a3d3d8640 1 -- 172.21.15.31:0/1916924495 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a38145040 con 0x7f3a380b8bf0 2024-04-15T00:31:39.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.351+0000 7f3a3d3d8640 1 -- 172.21.15.31:0/1916924495 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a381e1c40 con 0x7f3a380b8bf0 2024-04-15T00:31:39.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.352+0000 7f3a2f7fe640 1 -- 172.21.15.31:0/1916924495 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f3a280079d0 con 0x7f3a380b8bf0 2024-04-15T00:31:39.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.352+0000 7f3a2f7fe640 1 --2- 172.21.15.31:0/1916924495 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f3a1806b990 0x7f3a1806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:39.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.352+0000 7f3a2f7fe640 1 -- 172.21.15.31:0/1916924495 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f3a2808aee0 con 0x7f3a380b8bf0 2024-04-15T00:31:39.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.352+0000 7f3a2ffff640 1 --2- 172.21.15.31:0/1916924495 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f3a1806b990 0x7f3a1806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:39.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.353+0000 7f3a2ffff640 1 --2- 172.21.15.31:0/1916924495 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f3a1806b990 0x7f3a1806de50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3a3814ad80 tx=0x7f3a200079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:39.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.356+0000 7f3a2f7fe640 1 -- 172.21.15.31:0/1916924495 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f3a28059780 con 0x7f3a380b8bf0 2024-04-15T00:31:39.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.539+0000 7f3a3d3d8640 1 -- 172.21.15.31:0/1916924495 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3a381455e0 con 0x7f3a380b8bf0 2024-04-15T00:31:39.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.539+0000 7f3a2f7fe640 1 -- 172.21.15.31:0/1916924495 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f3a28059080 con 0x7f3a380b8bf0 2024-04-15T00:31:39.548 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-15T00:31:39.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.541+0000 7f3a3d3d8640 1 -- 172.21.15.31:0/1916924495 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f3a1806b990 msgr2=0x7f3a1806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:39.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.541+0000 7f3a3d3d8640 1 --2- 172.21.15.31:0/1916924495 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f3a1806b990 0x7f3a1806de50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3a3814ad80 tx=0x7f3a200079b0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.541+0000 7f3a3d3d8640 1 -- 172.21.15.31:0/1916924495 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a380b8bf0 msgr2=0x7f3a38140ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:39.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.541+0000 7f3a3d3d8640 1 --2- 172.21.15.31:0/1916924495 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a380b8bf0 0x7f3a38140ca0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3a2800c7f0 tx=0x7f3a2800ccb0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.541+0000 7f3a3d3d8640 1 -- 172.21.15.31:0/1916924495 shutdown_connections 2024-04-15T00:31:39.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.541+0000 7f3a3d3d8640 1 --2- 172.21.15.31:0/1916924495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a3814b8e0 0x7f3a38149a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.541+0000 7f3a3d3d8640 1 --2- 172.21.15.31:0/1916924495 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f3a1806b990 0x7f3a1806de50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.541+0000 7f3a3d3d8640 1 --2- 172.21.15.31:0/1916924495 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f3a380baef0 0x7f3a381411e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.541+0000 7f3a3d3d8640 1 --2- 172.21.15.31:0/1916924495 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a380b8bf0 0x7f3a38140ca0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.541+0000 7f3a3d3d8640 1 -- 172.21.15.31:0/1916924495 >> 172.21.15.31:0/1916924495 conn(0x7f3a3809ed70 msgr2=0x7f3a3809baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:39.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.541+0000 7f3a3d3d8640 1 -- 172.21.15.31:0/1916924495 shutdown_connections 2024-04-15T00:31:39.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.541+0000 7f3a3d3d8640 1 -- 172.21.15.31:0/1916924495 wait complete. 2024-04-15T00:31:39.560 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T00:31:39.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.657+0000 7f712df1e640 1 Processor -- start 2024-04-15T00:31:39.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.657+0000 7f712df1e640 1 -- start start 2024-04-15T00:31:39.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.658+0000 7f712df1e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f71280b7d20 0x7f7128145440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:39.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.658+0000 7f712df1e640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f71280b5fe0 0x7f712813f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.658+0000 7f712df1e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71280b8100 con 0x7f712813f880 2024-04-15T00:31:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.658+0000 7f712df1e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f71280b6ae0 con 0x7f71280b7d20 2024-04-15T00:31:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.658+0000 7f712df1e640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f71280b6dc0 con 0x7f71280b5fe0 2024-04-15T00:31:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.658+0000 7f7127fff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f712813f880 0x7f7128148a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50236/0 (socket says 172.21.15.31:50236) 2024-04-15T00:31:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.658+0000 7f7127fff640 1 -- 172.21.15.31:0/3426125707 learned_addr learned my addr 172.21.15.31:0/3426125707 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:31:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.658+0000 7f71277fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f71280b7d20 0x7f7128145440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.658+0000 7f7126ffd640 1 --2- 172.21.15.31:0/3426125707 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f71280b5fe0 0x7f712813f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.658+0000 7f71277fe640 1 -- 172.21.15.31:0/3426125707 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f71280b5fe0 msgr2=0x7f712813f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.658+0000 7f71277fe640 1 --2- 172.21.15.31:0/3426125707 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f71280b5fe0 0x7f712813f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.658+0000 7f71277fe640 1 -- 172.21.15.31:0/3426125707 >> v1:172.21.15.31:6789/0 conn(0x7f712813f880 legacy=0x7f7128148a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:39.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.658+0000 7f71277fe640 1 -- 172.21.15.31:0/3426125707 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71280b0450 con 0x7f71280b7d20 2024-04-15T00:31:39.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.658+0000 7f71267fc640 1 -- 172.21.15.31:0/3426125707 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1104143350 0 0) 0x7f71280b8100 con 0x7f712813f880 2024-04-15T00:31:39.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.659+0000 7f71277fe640 1 --2- 172.21.15.31:0/3426125707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71280b7d20 0x7f7128145440 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7118009d90 tx=0x7f711802be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f87aea62b9928a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:39.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.659+0000 7f71267fc640 1 -- 172.21.15.31:0/3426125707 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7118039070 con 0x7f71280b7d20 2024-04-15T00:31:39.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.659+0000 7f71267fc640 1 -- 172.21.15.31:0/3426125707 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f711802cbc0 con 0x7f71280b7d20 2024-04-15T00:31:39.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.659+0000 7f71267fc640 1 -- 172.21.15.31:0/3426125707 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7118034440 con 0x7f71280b7d20 2024-04-15T00:31:39.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.660+0000 7f712df1e640 1 -- 172.21.15.31:0/3426125707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71280b7d20 msgr2=0x7f7128145440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:39.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.660+0000 7f712df1e640 1 --2- 172.21.15.31:0/3426125707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71280b7d20 0x7f7128145440 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7118009d90 tx=0x7f711802be10 comp rx=0 tx=0).stop 2024-04-15T00:31:39.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.660+0000 7f712df1e640 1 -- 172.21.15.31:0/3426125707 shutdown_connections 2024-04-15T00:31:39.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.660+0000 7f712df1e640 1 --2- 172.21.15.31:0/3426125707 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f71280b5fe0 0x7f712813f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.660+0000 7f712df1e640 1 --2- 172.21.15.31:0/3426125707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71280b7d20 0x7f7128145440 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.660+0000 7f712df1e640 1 -- 172.21.15.31:0/3426125707 >> 172.21.15.31:0/3426125707 conn(0x7f712806e2b0 msgr2=0x7f712806e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:39.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.660+0000 7f712df1e640 1 -- 172.21.15.31:0/3426125707 shutdown_connections 2024-04-15T00:31:39.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.660+0000 7f712df1e640 1 -- 172.21.15.31:0/3426125707 wait complete. 2024-04-15T00:31:39.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.661+0000 7f712df1e640 1 Processor -- start 2024-04-15T00:31:39.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.661+0000 7f712df1e640 1 -- start start 2024-04-15T00:31:39.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.662+0000 7f712df1e640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f71280b7d20 0x7f71281494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:39.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.662+0000 7f712df1e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f712813f880 0x7f71281dcee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:39.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.662+0000 7f712df1e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f712806b200 0x7f712813bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:39.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.662+0000 7f712df1e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7128072ca0 con 0x7f712813f880 2024-04-15T00:31:39.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.662+0000 7f712df1e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7128072b20 con 0x7f712806b200 2024-04-15T00:31:39.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.662+0000 7f712df1e640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f71280b63f0 con 0x7f71280b7d20 2024-04-15T00:31:39.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.662+0000 7f7126ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f712813f880 0x7f71281dcee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:39.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.662+0000 7f7126ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f712813f880 0x7f71281dcee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59176/0 (socket says 172.21.15.31:59176) 2024-04-15T00:31:39.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.662+0000 7f7126ffd640 1 -- 172.21.15.31:0/969814454 learned_addr learned my addr 172.21.15.31:0/969814454 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:39.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.662+0000 7f71277fe640 1 --2- 172.21.15.31:0/969814454 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f71280b7d20 0x7f71281494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:39.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.662+0000 7f7127fff640 1 --2- 172.21.15.31:0/969814454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f712806b200 0x7f712813bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:39.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.662+0000 7f7126ffd640 1 -- 172.21.15.31:0/969814454 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f71280b7d20 msgr2=0x7f71281494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:39.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.662+0000 7f7126ffd640 1 --2- 172.21.15.31:0/969814454 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f71280b7d20 0x7f71281494f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.662+0000 7f7126ffd640 1 -- 172.21.15.31:0/969814454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f712806b200 msgr2=0x7f712813bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:39.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.662+0000 7f7126ffd640 1 --2- 172.21.15.31:0/969814454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f712806b200 0x7f712813bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.662+0000 7f7126ffd640 1 -- 172.21.15.31:0/969814454 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7128148df0 con 0x7f712813f880 2024-04-15T00:31:39.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.662+0000 7f7126ffd640 1 --2- 172.21.15.31:0/969814454 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f712813f880 0x7f71281dcee0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f711c00e9b0 tx=0x7f711c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:39.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.662+0000 7f710ffff640 1 -- 172.21.15.31:0/969814454 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711c017070 con 0x7f712813f880 2024-04-15T00:31:39.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.662+0000 7f710ffff640 1 -- 172.21.15.31:0/969814454 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f711c00c9a0 con 0x7f712813f880 2024-04-15T00:31:39.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.662+0000 7f712df1e640 1 -- 172.21.15.31:0/969814454 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f712806c910 con 0x7f712813f880 2024-04-15T00:31:39.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.663+0000 7f710ffff640 1 -- 172.21.15.31:0/969814454 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711c00cd90 con 0x7f712813f880 2024-04-15T00:31:39.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.663+0000 7f712df1e640 1 -- 172.21.15.31:0/969814454 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71281dd420 con 0x7f712813f880 2024-04-15T00:31:39.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.664+0000 7f712df1e640 1 -- 172.21.15.31:0/969814454 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f712804f540 con 0x7f712813f880 2024-04-15T00:31:39.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.664+0000 7f710ffff640 1 -- 172.21.15.31:0/969814454 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f711c01a070 con 0x7f712813f880 2024-04-15T00:31:39.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.664+0000 7f710ffff640 1 --2- 172.21.15.31:0/969814454 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f711406b990 0x7f711406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:39.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.664+0000 7f710ffff640 1 -- 172.21.15.31:0/969814454 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f711c08ac90 con 0x7f712813f880 2024-04-15T00:31:39.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.664+0000 7f71277fe640 1 --2- 172.21.15.31:0/969814454 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f711406b990 0x7f711406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:39.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.665+0000 7f71277fe640 1 --2- 172.21.15.31:0/969814454 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f711406b990 0x7f711406de50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7118036000 tx=0x7f7118030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:39.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.669+0000 7f710ffff640 1 -- 172.21.15.31:0/969814454 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f711c059490 con 0x7f712813f880 2024-04-15T00:31:39.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.848+0000 7f712df1e640 1 -- 172.21.15.31:0/969814454 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f712806cae0 con 0x7f712813f880 2024-04-15T00:31:39.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.848+0000 7f710ffff640 1 -- 172.21.15.31:0/969814454 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f711c058d90 con 0x7f712813f880 2024-04-15T00:31:39.856 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-15T00:31:39.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.850+0000 7f712df1e640 1 -- 172.21.15.31:0/969814454 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f711406b990 msgr2=0x7f711406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:39.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.850+0000 7f712df1e640 1 --2- 172.21.15.31:0/969814454 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f711406b990 0x7f711406de50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7118036000 tx=0x7f7118030000 comp rx=0 tx=0).stop 2024-04-15T00:31:39.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.850+0000 7f712df1e640 1 -- 172.21.15.31:0/969814454 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f712813f880 msgr2=0x7f71281dcee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:39.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.850+0000 7f712df1e640 1 --2- 172.21.15.31:0/969814454 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f712813f880 0x7f71281dcee0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f711c00e9b0 tx=0x7f711c00ee70 comp rx=0 tx=0).stop 2024-04-15T00:31:39.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.850+0000 7f712df1e640 1 -- 172.21.15.31:0/969814454 shutdown_connections 2024-04-15T00:31:39.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.850+0000 7f712df1e640 1 --2- 172.21.15.31:0/969814454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f712806b200 0x7f712813bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.850+0000 7f712df1e640 1 --2- 172.21.15.31:0/969814454 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f712813f880 0x7f71281dcee0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.850+0000 7f712df1e640 1 --2- 172.21.15.31:0/969814454 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f711406b990 0x7f711406de50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.850+0000 7f712df1e640 1 --2- 172.21.15.31:0/969814454 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f71280b7d20 0x7f71281494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.850+0000 7f712df1e640 1 -- 172.21.15.31:0/969814454 >> 172.21.15.31:0/969814454 conn(0x7f712806e2b0 msgr2=0x7f7128071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:39.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.850+0000 7f712df1e640 1 -- 172.21.15.31:0/969814454 shutdown_connections 2024-04-15T00:31:39.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.850+0000 7f712df1e640 1 -- 172.21.15.31:0/969814454 wait complete. 2024-04-15T00:31:39.869 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T00:31:39.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.966+0000 7f6df3e91640 1 Processor -- start 2024-04-15T00:31:39.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.966+0000 7f6df3e91640 1 -- start start 2024-04-15T00:31:39.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.967+0000 7f6df3e91640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6dec0b9bd0 0x7f6dec0bb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:39.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.967+0000 7f6df3e91640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6dec14b870 0x7f6dec0b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:39.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.967+0000 7f6df3e91640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dec0b9fb0 con 0x7f6dec0b94f0 2024-04-15T00:31:39.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.967+0000 7f6df3e91640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f6dec14b3e0 con 0x7f6dec0b9bd0 2024-04-15T00:31:39.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.967+0000 7f6df3e91640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f6dec14ad90 con 0x7f6dec14b870 2024-04-15T00:31:39.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.967+0000 7f6df1c2d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6dec0b9bd0 0x7f6dec0bb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:39.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.967+0000 7f6df1c2d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6dec0b9bd0 0x7f6dec0bb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59178/0 (socket says 172.21.15.31:59178) 2024-04-15T00:31:39.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.967+0000 7f6df1c2d640 1 -- 172.21.15.31:0/3030006972 learned_addr learned my addr 172.21.15.31:0/3030006972 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:39.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.967+0000 7f6df242e640 1 --2- 172.21.15.31:0/3030006972 >> v2:172.21.15.50:3300/0 conn(0x7f6dec14b870 0x7f6dec0b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:39.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.967+0000 7f6df1c2d640 1 -- 172.21.15.31:0/3030006972 >> v2:172.21.15.50:3300/0 conn(0x7f6dec14b870 msgr2=0x7f6dec0b8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:39.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.967+0000 7f6df1c2d640 1 --2- 172.21.15.31:0/3030006972 >> v2:172.21.15.50:3300/0 conn(0x7f6dec14b870 0x7f6dec0b8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.967+0000 7f6df1c2d640 1 -- 172.21.15.31:0/3030006972 >> v1:172.21.15.50:6789/0 conn(0x7f6dec0b94f0 legacy=0x7f6dec147600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:39.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.967+0000 7f6df1c2d640 1 -- 172.21.15.31:0/3030006972 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dec14b070 con 0x7f6dec0b9bd0 2024-04-15T00:31:39.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.968+0000 7f6df1c2d640 1 --2- 172.21.15.31:0/3030006972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dec0b9bd0 0x7f6dec0bb140 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6dec147d10 tx=0x7f6de402bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4981b3411e3965c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:39.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.968+0000 7f6df0c2b640 1 -- 172.21.15.31:0/3030006972 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de402c960 con 0x7f6dec0b9bd0 2024-04-15T00:31:39.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.968+0000 7f6df0c2b640 1 -- 172.21.15.31:0/3030006972 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6de402cb00 con 0x7f6dec0b9bd0 2024-04-15T00:31:39.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.968+0000 7f6df0c2b640 1 -- 172.21.15.31:0/3030006972 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de40343f0 con 0x7f6dec0b9bd0 2024-04-15T00:31:39.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.969+0000 7f6df3e91640 1 -- 172.21.15.31:0/3030006972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dec0b9bd0 msgr2=0x7f6dec0bb140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:39.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.969+0000 7f6df3e91640 1 --2- 172.21.15.31:0/3030006972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dec0b9bd0 0x7f6dec0bb140 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6dec147d10 tx=0x7f6de402bdc0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.969+0000 7f6df3e91640 1 -- 172.21.15.31:0/3030006972 shutdown_connections 2024-04-15T00:31:39.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.969+0000 7f6df3e91640 1 --2- 172.21.15.31:0/3030006972 >> v2:172.21.15.50:3300/0 conn(0x7f6dec14b870 0x7f6dec0b8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.969+0000 7f6df3e91640 1 --2- 172.21.15.31:0/3030006972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dec0b9bd0 0x7f6dec0bb140 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.969+0000 7f6df3e91640 1 -- 172.21.15.31:0/3030006972 >> 172.21.15.31:0/3030006972 conn(0x7f6dec09ed70 msgr2=0x7f6dec09f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:39.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.969+0000 7f6df3e91640 1 -- 172.21.15.31:0/3030006972 shutdown_connections 2024-04-15T00:31:39.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.969+0000 7f6df3e91640 1 -- 172.21.15.31:0/3030006972 wait complete. 2024-04-15T00:31:39.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.970+0000 7f6df3e91640 1 Processor -- start 2024-04-15T00:31:39.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.970+0000 7f6df3e91640 1 -- start start 2024-04-15T00:31:39.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.970+0000 7f6df3e91640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dec0b94f0 0x7f6dec0a19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:39.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.970+0000 7f6df3e91640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dec0b9bd0 0x7f6dec1dda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:39.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.970+0000 7f6df3e91640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6dec14b870 0x7f6dec1e08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:39.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.970+0000 7f6df3e91640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6dec0b9120 con 0x7f6dec0b9bd0 2024-04-15T00:31:39.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.970+0000 7f6df3e91640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6dec0b8fa0 con 0x7f6dec0b94f0 2024-04-15T00:31:39.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.970+0000 7f6df3e91640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f6dec0b92a0 con 0x7f6dec14b870 2024-04-15T00:31:39.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.971+0000 7f6df142c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dec0b9bd0 0x7f6dec1dda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:39.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.971+0000 7f6df1c2d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dec0b94f0 0x7f6dec0a19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:39.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.971+0000 7f6df142c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dec0b9bd0 0x7f6dec1dda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59190/0 (socket says 172.21.15.31:59190) 2024-04-15T00:31:39.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.971+0000 7f6df142c640 1 -- 172.21.15.31:0/1712886837 learned_addr learned my addr 172.21.15.31:0/1712886837 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:39.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.971+0000 7f6df242e640 1 --2- 172.21.15.31:0/1712886837 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6dec14b870 0x7f6dec1e08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:39.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.971+0000 7f6df142c640 1 -- 172.21.15.31:0/1712886837 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6dec14b870 msgr2=0x7f6dec1e08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:39.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.971+0000 7f6df142c640 1 --2- 172.21.15.31:0/1712886837 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6dec14b870 0x7f6dec1e08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.971+0000 7f6df142c640 1 -- 172.21.15.31:0/1712886837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dec0b94f0 msgr2=0x7f6dec0a19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:39.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.971+0000 7f6df142c640 1 --2- 172.21.15.31:0/1712886837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dec0b94f0 0x7f6dec0a19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:39.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.971+0000 7f6df142c640 1 -- 172.21.15.31:0/1712886837 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dec142300 con 0x7f6dec0b9bd0 2024-04-15T00:31:39.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.971+0000 7f6df142c640 1 --2- 172.21.15.31:0/1712886837 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dec0b9bd0 0x7f6dec1dda60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6de000c410 tx=0x7f6de000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:39.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.971+0000 7f6dea7fc640 1 -- 172.21.15.31:0/1712886837 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de0017070 con 0x7f6dec0b9bd0 2024-04-15T00:31:39.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.971+0000 7f6dea7fc640 1 -- 172.21.15.31:0/1712886837 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6de00035f0 con 0x7f6dec0b9bd0 2024-04-15T00:31:39.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.971+0000 7f6df3e91640 1 -- 172.21.15.31:0/1712886837 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dec0a29d0 con 0x7f6dec0b9bd0 2024-04-15T00:31:39.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.971+0000 7f6dea7fc640 1 -- 172.21.15.31:0/1712886837 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de00039e0 con 0x7f6dec0b9bd0 2024-04-15T00:31:39.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.971+0000 7f6df3e91640 1 -- 172.21.15.31:0/1712886837 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dec09e140 con 0x7f6dec0b9bd0 2024-04-15T00:31:39.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.972+0000 7f6df3e91640 1 -- 172.21.15.31:0/1712886837 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dec04f620 con 0x7f6dec0b9bd0 2024-04-15T00:31:39.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.973+0000 7f6dea7fc640 1 -- 172.21.15.31:0/1712886837 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f6de001a070 con 0x7f6dec0b9bd0 2024-04-15T00:31:39.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.973+0000 7f6dea7fc640 1 --2- 172.21.15.31:0/1712886837 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f6dd806b990 0x7f6dd806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:39.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.973+0000 7f6df1c2d640 1 --2- 172.21.15.31:0/1712886837 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f6dd806b990 0x7f6dd806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:39.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.973+0000 7f6dea7fc640 1 -- 172.21.15.31:0/1712886837 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f6de0089fa0 con 0x7f6dec0b9bd0 2024-04-15T00:31:39.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.974+0000 7f6df1c2d640 1 --2- 172.21.15.31:0/1712886837 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f6dd806b990 0x7f6dd806de50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6de4035000 tx=0x7f6de4030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:39.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:39.978+0000 7f6dea7fc640 1 -- 172.21.15.31:0/1712886837 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6dec142300 con 0x7f6dec0b9bd0 2024-04-15T00:31:40.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.159+0000 7f6df3e91640 1 -- 172.21.15.31:0/1712886837 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6dec145850 con 0x7f6dec0b9bd0 2024-04-15T00:31:40.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.160+0000 7f6dea7fc640 1 -- 172.21.15.31:0/1712886837 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f6de00010c0 con 0x7f6dec0b9bd0 2024-04-15T00:31:40.168 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-04-15T00:31:40.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.161+0000 7f6df3e91640 1 -- 172.21.15.31:0/1712886837 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f6dd806b990 msgr2=0x7f6dd806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:40.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.161+0000 7f6df3e91640 1 --2- 172.21.15.31:0/1712886837 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f6dd806b990 0x7f6dd806de50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6de4035000 tx=0x7f6de4030000 comp rx=0 tx=0).stop 2024-04-15T00:31:40.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.161+0000 7f6df3e91640 1 -- 172.21.15.31:0/1712886837 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dec0b9bd0 msgr2=0x7f6dec1dda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:40.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.161+0000 7f6df3e91640 1 --2- 172.21.15.31:0/1712886837 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dec0b9bd0 0x7f6dec1dda60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6de000c410 tx=0x7f6de000c8d0 comp rx=0 tx=0).stop 2024-04-15T00:31:40.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.161+0000 7f6df3e91640 1 -- 172.21.15.31:0/1712886837 shutdown_connections 2024-04-15T00:31:40.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.161+0000 7f6df3e91640 1 --2- 172.21.15.31:0/1712886837 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f6dd806b990 0x7f6dd806de50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:40.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.161+0000 7f6df3e91640 1 --2- 172.21.15.31:0/1712886837 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6dec14b870 0x7f6dec1e08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:40.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.161+0000 7f6df3e91640 1 --2- 172.21.15.31:0/1712886837 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dec0b9bd0 0x7f6dec1dda60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:40.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.161+0000 7f6df3e91640 1 --2- 172.21.15.31:0/1712886837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dec0b94f0 0x7f6dec0a19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:40.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.162+0000 7f6df3e91640 1 -- 172.21.15.31:0/1712886837 >> 172.21.15.31:0/1712886837 conn(0x7f6dec09ed70 msgr2=0x7f6dec072d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:40.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.162+0000 7f6df3e91640 1 -- 172.21.15.31:0/1712886837 shutdown_connections 2024-04-15T00:31:40.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.162+0000 7f6df3e91640 1 -- 172.21.15.31:0/1712886837 wait complete. 2024-04-15T00:31:40.180 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-15T00:31:40.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.277+0000 7f7b83374640 1 Processor -- start 2024-04-15T00:31:40.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.277+0000 7f7b83374640 1 -- start start 2024-04-15T00:31:40.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.278+0000 7f7b83374640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7b7c0b4f20 0x7f7b7c13f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:40.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.278+0000 7f7b83374640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b7c0b2740 con 0x7f7b7c0b2360 2024-04-15T00:31:40.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.278+0000 7f7b83374640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b7c072cf0 con 0x7f7b7c0af700 2024-04-15T00:31:40.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.278+0000 7f7b83374640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f7b7c0b36e0 con 0x7f7b7c0b4f20 2024-04-15T00:31:40.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.278+0000 7f7b81911640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7b7c0b4f20 0x7f7b7c13f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:40.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.278+0000 7f7b81110640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7b7c0b2360 0x7f7b7c0aeff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50246/0 (socket says 172.21.15.31:50246) 2024-04-15T00:31:40.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.278+0000 7f7b81110640 1 -- 172.21.15.31:0/1696532825 learned_addr learned my addr 172.21.15.31:0/1696532825 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:31:40.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.278+0000 7f7b81911640 1 -- 172.21.15.31:0/1696532825 >> v1:172.21.15.50:6789/0 conn(0x7f7b7c0af700 legacy=0x7f7b7c13ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:40.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.278+0000 7f7b81911640 1 -- 172.21.15.31:0/1696532825 >> v1:172.21.15.31:6789/0 conn(0x7f7b7c0b2360 legacy=0x7f7b7c0aeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:40.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.278+0000 7f7b7bfff640 1 -- 172.21.15.31:0/1696532825 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4280943277 0 0) 0x7f7b7c0b2740 con 0x7f7b7c0b2360 2024-04-15T00:31:40.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.278+0000 7f7b81911640 1 -- 172.21.15.31:0/1696532825 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b7c0b4430 con 0x7f7b7c0b4f20 2024-04-15T00:31:40.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.279+0000 7f7b81911640 1 --2- 172.21.15.31:0/1696532825 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b7c0b4f20 0x7f7b7c13f400 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c009d90 tx=0x7f7b6c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf2df320c6b4fbd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:40.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.279+0000 7f7b7bfff640 1 -- 172.21.15.31:0/1696532825 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c039070 con 0x7f7b7c0b4f20 2024-04-15T00:31:40.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.279+0000 7f7b7bfff640 1 -- 172.21.15.31:0/1696532825 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b6c02cbd0 con 0x7f7b7c0b4f20 2024-04-15T00:31:40.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.279+0000 7f7b7bfff640 1 -- 172.21.15.31:0/1696532825 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c034440 con 0x7f7b7c0b4f20 2024-04-15T00:31:40.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.280+0000 7f7b83374640 1 -- 172.21.15.31:0/1696532825 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b7c0b4f20 msgr2=0x7f7b7c13f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:40.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.280+0000 7f7b83374640 1 --2- 172.21.15.31:0/1696532825 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b7c0b4f20 0x7f7b7c13f400 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c009d90 tx=0x7f7b6c02be20 comp rx=0 tx=0).stop 2024-04-15T00:31:40.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.280+0000 7f7b83374640 1 -- 172.21.15.31:0/1696532825 shutdown_connections 2024-04-15T00:31:40.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.280+0000 7f7b83374640 1 --2- 172.21.15.31:0/1696532825 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b7c0b4f20 0x7f7b7c13f400 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:40.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.280+0000 7f7b83374640 1 -- 172.21.15.31:0/1696532825 >> 172.21.15.31:0/1696532825 conn(0x7f7b7c0b8e70 msgr2=0x7f7b7c0b9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:40.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.280+0000 7f7b83374640 1 -- 172.21.15.31:0/1696532825 shutdown_connections 2024-04-15T00:31:40.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.280+0000 7f7b83374640 1 -- 172.21.15.31:0/1696532825 wait complete. 2024-04-15T00:31:40.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.281+0000 7f7b83374640 1 Processor -- start 2024-04-15T00:31:40.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.281+0000 7f7b83374640 1 -- start start 2024-04-15T00:31:40.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.281+0000 7f7b83374640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b7c0af700 0x7f7b7c071460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:40.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.281+0000 7f7b83374640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7b7c0b2360 0x7f7b7c1dd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:40.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.281+0000 7f7b83374640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b7c0b4f20 0x7f7b7c1e0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:40.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.281+0000 7f7b83374640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7b7c072aa0 con 0x7f7b7c0b4f20 2024-04-15T00:31:40.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.281+0000 7f7b83374640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7b7c13fb90 con 0x7f7b7c0af700 2024-04-15T00:31:40.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.281+0000 7f7b83374640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f7b7c0b3400 con 0x7f7b7c0b2360 2024-04-15T00:31:40.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.281+0000 7f7b81911640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b7c0b4f20 0x7f7b7c1e0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:40.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.281+0000 7f7b81911640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b7c0b4f20 0x7f7b7c1e0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59202/0 (socket says 172.21.15.31:59202) 2024-04-15T00:31:40.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.281+0000 7f7b81911640 1 -- 172.21.15.31:0/3396801494 learned_addr learned my addr 172.21.15.31:0/3396801494 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:40.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.282+0000 7f7b81110640 1 --2- 172.21.15.31:0/3396801494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b7c0af700 0x7f7b7c071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:40.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.282+0000 7f7b8090f640 1 --2- 172.21.15.31:0/3396801494 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7b7c0b2360 0x7f7b7c1dd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:40.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.282+0000 7f7b81911640 1 -- 172.21.15.31:0/3396801494 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7b7c0b2360 msgr2=0x7f7b7c1dd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:40.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.282+0000 7f7b81911640 1 --2- 172.21.15.31:0/3396801494 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7b7c0b2360 0x7f7b7c1dd710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:40.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.282+0000 7f7b81911640 1 -- 172.21.15.31:0/3396801494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b7c0af700 msgr2=0x7f7b7c071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:40.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.282+0000 7f7b81911640 1 --2- 172.21.15.31:0/3396801494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b7c0af700 0x7f7b7c071460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:40.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.282+0000 7f7b81911640 1 -- 172.21.15.31:0/3396801494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b7c0af030 con 0x7f7b7c0b4f20 2024-04-15T00:31:40.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.282+0000 7f7b81911640 1 --2- 172.21.15.31:0/3396801494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b7c0b4f20 0x7f7b7c1e0b80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c009d90 tx=0x7f7b6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:40.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.282+0000 7f7b79ffb640 1 -- 172.21.15.31:0/3396801494 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c039050 con 0x7f7b7c0b4f20 2024-04-15T00:31:40.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.282+0000 7f7b79ffb640 1 -- 172.21.15.31:0/3396801494 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b6c03a040 con 0x7f7b7c0b4f20 2024-04-15T00:31:40.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.282+0000 7f7b79ffb640 1 -- 172.21.15.31:0/3396801494 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c03e610 con 0x7f7b7c0b4f20 2024-04-15T00:31:40.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.282+0000 7f7b83374640 1 -- 172.21.15.31:0/3396801494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b7c140480 con 0x7f7b7c0b4f20 2024-04-15T00:31:40.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.282+0000 7f7b83374640 1 -- 172.21.15.31:0/3396801494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b7c1401a0 con 0x7f7b7c0b4f20 2024-04-15T00:31:40.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.283+0000 7f7b83374640 1 -- 172.21.15.31:0/3396801494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b7c04f540 con 0x7f7b7c0b4f20 2024-04-15T00:31:40.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.284+0000 7f7b79ffb640 1 -- 172.21.15.31:0/3396801494 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f7b6c047020 con 0x7f7b7c0b4f20 2024-04-15T00:31:40.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.284+0000 7f7b79ffb640 1 --2- 172.21.15.31:0/3396801494 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f7b6806b990 0x7f7b6806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:40.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.284+0000 7f7b79ffb640 1 -- 172.21.15.31:0/3396801494 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f7b6c0acf80 con 0x7f7b7c0b4f20 2024-04-15T00:31:40.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.284+0000 7f7b81110640 1 --2- 172.21.15.31:0/3396801494 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f7b6806b990 0x7f7b6806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:40.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.284+0000 7f7b81110640 1 --2- 172.21.15.31:0/3396801494 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f7b6806b990 0x7f7b6806de50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7b74000f60 tx=0x7f7b74007b90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:40.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.288+0000 7f7b79ffb640 1 -- 172.21.15.31:0/3396801494 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7b6c04e020 con 0x7f7b7c0b4f20 2024-04-15T00:31:40.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.469+0000 7f7b83374640 1 -- 172.21.15.31:0/3396801494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f7b7c0b6900 con 0x7f7b7c0b4f20 2024-04-15T00:31:40.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.470+0000 7f7b79ffb640 1 -- 172.21.15.31:0/3396801494 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f7b7c140480 con 0x7f7b7c0b4f20 2024-04-15T00:31:40.478 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-15T00:31:40.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.471+0000 7f7b83374640 1 -- 172.21.15.31:0/3396801494 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f7b6806b990 msgr2=0x7f7b6806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:40.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.471+0000 7f7b83374640 1 --2- 172.21.15.31:0/3396801494 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f7b6806b990 0x7f7b6806de50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7b74000f60 tx=0x7f7b74007b90 comp rx=0 tx=0).stop 2024-04-15T00:31:40.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.471+0000 7f7b83374640 1 -- 172.21.15.31:0/3396801494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b7c0b4f20 msgr2=0x7f7b7c1e0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:40.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.471+0000 7f7b83374640 1 --2- 172.21.15.31:0/3396801494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b7c0b4f20 0x7f7b7c1e0b80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c009d90 tx=0x7f7b6c004a40 comp rx=0 tx=0).stop 2024-04-15T00:31:40.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.471+0000 7f7b83374640 1 -- 172.21.15.31:0/3396801494 shutdown_connections 2024-04-15T00:31:40.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.471+0000 7f7b83374640 1 --2- 172.21.15.31:0/3396801494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b7c0b4f20 0x7f7b7c1e0b80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:40.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.471+0000 7f7b83374640 1 --2- 172.21.15.31:0/3396801494 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f7b6806b990 0x7f7b6806de50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:40.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.471+0000 7f7b83374640 1 --2- 172.21.15.31:0/3396801494 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7b7c0b2360 0x7f7b7c1dd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:40.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.471+0000 7f7b83374640 1 --2- 172.21.15.31:0/3396801494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b7c0af700 0x7f7b7c071460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:40.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.471+0000 7f7b83374640 1 -- 172.21.15.31:0/3396801494 >> 172.21.15.31:0/3396801494 conn(0x7f7b7c0b8e70 msgr2=0x7f7b7c13e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:40.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.472+0000 7f7b83374640 1 -- 172.21.15.31:0/3396801494 shutdown_connections 2024-04-15T00:31:40.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.472+0000 7f7b83374640 1 -- 172.21.15.31:0/3396801494 wait complete. 2024-04-15T00:31:40.491 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-15T00:31:40.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.586+0000 7f6d73e29640 1 Processor -- start 2024-04-15T00:31:40.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.586+0000 7f6d73e29640 1 -- start start 2024-04-15T00:31:40.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.587+0000 7f6d73e29640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6d6c0b8be0 0x7f6d6c072570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:40.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.587+0000 7f6d73e29640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6d6c14b4c0 0x7f6d6c1449c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:40.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.587+0000 7f6d73e29640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d6c072c90 con 0x7f6d6c0b80d0 2024-04-15T00:31:40.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.587+0000 7f6d73e29640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f6d6c09c0e0 con 0x7f6d6c0b8be0 2024-04-15T00:31:40.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.587+0000 7f6d73e29640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f6d6c0b84b0 con 0x7f6d6c14b4c0 2024-04-15T00:31:40.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.587+0000 7f6d713c4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6d6c0b8be0 0x7f6d6c072570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:40.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.587+0000 7f6d723c6640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6d6c14b4c0 0x7f6d6c1449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:40.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.587+0000 7f6d713c4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6d6c0b8be0 0x7f6d6c072570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.31:42358/0 (socket says 172.21.15.31:42358) 2024-04-15T00:31:40.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.587+0000 7f6d71bc5640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6d6c0b80d0 0x7f6d6c14adb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.31:44524/0 (socket says 172.21.15.31:44524) 2024-04-15T00:31:40.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.587+0000 7f6d713c4640 1 -- 172.21.15.31:0/410921661 learned_addr learned my addr 172.21.15.31:0/410921661 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:40.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.588+0000 7f6d723c6640 1 -- 172.21.15.31:0/410921661 >> v2:172.21.15.50:3300/0 conn(0x7f6d6c0b8be0 msgr2=0x7f6d6c072570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:40.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.588+0000 7f6d723c6640 1 --2- 172.21.15.31:0/410921661 >> v2:172.21.15.50:3300/0 conn(0x7f6d6c0b8be0 0x7f6d6c072570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:40.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.588+0000 7f6d723c6640 1 -- 172.21.15.31:0/410921661 >> v1:172.21.15.50:6789/0 conn(0x7f6d6c0b80d0 legacy=0x7f6d6c14adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:40.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.588+0000 7f6d723c6640 1 -- 172.21.15.31:0/410921661 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d6c09c380 con 0x7f6d6c14b4c0 2024-04-15T00:31:40.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.588+0000 7f6d713c4640 1 --2- 172.21.15.31:0/410921661 >> v2:172.21.15.50:3300/0 conn(0x7f6d6c0b8be0 0x7f6d6c072570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:31:40.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.589+0000 7f6d723c6640 1 --2- 172.21.15.31:0/410921661 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6d6c14b4c0 0x7f6d6c1449c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6d64009d90 tx=0x7f6d6402bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dd180a9b36743ea server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:40.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.589+0000 7f6d70bc3640 1 -- 172.21.15.31:0/410921661 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d64039070 con 0x7f6d6c14b4c0 2024-04-15T00:31:40.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.589+0000 7f6d70bc3640 1 -- 172.21.15.31:0/410921661 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d6402cb30 con 0x7f6d6c14b4c0 2024-04-15T00:31:40.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.589+0000 7f6d70bc3640 1 -- 172.21.15.31:0/410921661 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d64034440 con 0x7f6d6c14b4c0 2024-04-15T00:31:40.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.589+0000 7f6d73e29640 1 -- 172.21.15.31:0/410921661 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6d6c14b4c0 msgr2=0x7f6d6c1449c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:40.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.589+0000 7f6d73e29640 1 --2- 172.21.15.31:0/410921661 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6d6c14b4c0 0x7f6d6c1449c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6d64009d90 tx=0x7f6d6402bd80 comp rx=0 tx=0).stop 2024-04-15T00:31:40.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.589+0000 7f6d73e29640 1 -- 172.21.15.31:0/410921661 shutdown_connections 2024-04-15T00:31:40.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.589+0000 7f6d73e29640 1 --2- 172.21.15.31:0/410921661 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6d6c14b4c0 0x7f6d6c1449c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:40.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.589+0000 7f6d73e29640 1 --2- 172.21.15.31:0/410921661 >> v2:172.21.15.50:3300/0 conn(0x7f6d6c0b8be0 0x7f6d6c072570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:40.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.589+0000 7f6d73e29640 1 -- 172.21.15.31:0/410921661 >> 172.21.15.31:0/410921661 conn(0x7f6d6c0bd020 msgr2=0x7f6d6c0bd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:40.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.589+0000 7f6d73e29640 1 -- 172.21.15.31:0/410921661 shutdown_connections 2024-04-15T00:31:40.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.589+0000 7f6d73e29640 1 -- 172.21.15.31:0/410921661 wait complete. 2024-04-15T00:31:40.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.590+0000 7f6d73e29640 1 Processor -- start 2024-04-15T00:31:40.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.590+0000 7f6d73e29640 1 -- start start 2024-04-15T00:31:40.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.591+0000 7f6d73e29640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d6c0b80d0 0x7f6d6c0b1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:40.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.591+0000 7f6d73e29640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d6c0b8be0 0x7f6d6c147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:40.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.591+0000 7f6d73e29640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6d6c14b4c0 0x7f6d6c1480b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:40.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.591+0000 7f6d73e29640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6c145080 con 0x7f6d6c0b8be0 2024-04-15T00:31:40.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.591+0000 7f6d73e29640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6c144f00 con 0x7f6d6c0b80d0 2024-04-15T00:31:40.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.591+0000 7f6d73e29640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f6d6c145200 con 0x7f6d6c14b4c0 2024-04-15T00:31:40.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.591+0000 7f6d713c4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d6c0b8be0 0x7f6d6c147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:40.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.591+0000 7f6d713c4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d6c0b8be0 0x7f6d6c147b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59218/0 (socket says 172.21.15.31:59218) 2024-04-15T00:31:40.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.591+0000 7f6d713c4640 1 -- 172.21.15.31:0/2757461603 learned_addr learned my addr 172.21.15.31:0/2757461603 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:40.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.591+0000 7f6d723c6640 1 --2- 172.21.15.31:0/2757461603 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6d6c14b4c0 0x7f6d6c1480b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:40.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.591+0000 7f6d71bc5640 1 --2- 172.21.15.31:0/2757461603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d6c0b80d0 0x7f6d6c0b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:40.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.591+0000 7f6d713c4640 1 -- 172.21.15.31:0/2757461603 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6d6c14b4c0 msgr2=0x7f6d6c1480b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:40.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.591+0000 7f6d713c4640 1 --2- 172.21.15.31:0/2757461603 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6d6c14b4c0 0x7f6d6c1480b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:40.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.591+0000 7f6d713c4640 1 -- 172.21.15.31:0/2757461603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d6c0b80d0 msgr2=0x7f6d6c0b1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:40.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.591+0000 7f6d713c4640 1 --2- 172.21.15.31:0/2757461603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d6c0b80d0 0x7f6d6c0b1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:40.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.591+0000 7f6d713c4640 1 -- 172.21.15.31:0/2757461603 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d6c0b5e90 con 0x7f6d6c0b8be0 2024-04-15T00:31:40.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.591+0000 7f6d713c4640 1 --2- 172.21.15.31:0/2757461603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d6c0b8be0 0x7f6d6c147b70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c00e9d0 tx=0x7f6d5c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:40.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.592+0000 7f6d627fc640 1 -- 172.21.15.31:0/2757461603 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c017070 con 0x7f6d6c0b8be0 2024-04-15T00:31:40.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.592+0000 7f6d627fc640 1 -- 172.21.15.31:0/2757461603 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d5c00ca60 con 0x7f6d6c0b8be0 2024-04-15T00:31:40.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.592+0000 7f6d73e29640 1 -- 172.21.15.31:0/2757461603 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d6c0a2b40 con 0x7f6d6c0b8be0 2024-04-15T00:31:40.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.592+0000 7f6d627fc640 1 -- 172.21.15.31:0/2757461603 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c00ce10 con 0x7f6d6c0b8be0 2024-04-15T00:31:40.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.592+0000 7f6d73e29640 1 -- 172.21.15.31:0/2757461603 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d6c0b6390 con 0x7f6d6c0b8be0 2024-04-15T00:31:40.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.593+0000 7f6d73e29640 1 -- 172.21.15.31:0/2757461603 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d6c09f730 con 0x7f6d6c0b8be0 2024-04-15T00:31:40.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.593+0000 7f6d627fc640 1 -- 172.21.15.31:0/2757461603 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f6d5c01a070 con 0x7f6d6c0b8be0 2024-04-15T00:31:40.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.594+0000 7f6d627fc640 1 --2- 172.21.15.31:0/2757461603 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f6d5006b990 0x7f6d5006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:40.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.594+0000 7f6d627fc640 1 -- 172.21.15.31:0/2757461603 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f6d5c08aab0 con 0x7f6d6c0b8be0 2024-04-15T00:31:40.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.594+0000 7f6d71bc5640 1 --2- 172.21.15.31:0/2757461603 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f6d5006b990 0x7f6d5006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:40.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.594+0000 7f6d71bc5640 1 --2- 172.21.15.31:0/2757461603 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f6d5006b990 0x7f6d5006de50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6d68007fd0 tx=0x7f6d68007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:40.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.598+0000 7f6d627fc640 1 -- 172.21.15.31:0/2757461603 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6d5c058d00 con 0x7f6d6c0b8be0 2024-04-15T00:31:40.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.793+0000 7f6d73e29640 1 -- 172.21.15.31:0/2757461603 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6d6c04f620 con 0x7f6d6c0b8be0 2024-04-15T00:31:40.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.793+0000 7f6d627fc640 1 -- 172.21.15.31:0/2757461603 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f6d5c05cda0 con 0x7f6d6c0b8be0 2024-04-15T00:31:40.803 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-04-15T00:31:40.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.795+0000 7f6d73e29640 1 -- 172.21.15.31:0/2757461603 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f6d5006b990 msgr2=0x7f6d5006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:40.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.795+0000 7f6d73e29640 1 --2- 172.21.15.31:0/2757461603 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f6d5006b990 0x7f6d5006de50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6d68007fd0 tx=0x7f6d68007e80 comp rx=0 tx=0).stop 2024-04-15T00:31:40.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.795+0000 7f6d73e29640 1 -- 172.21.15.31:0/2757461603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d6c0b8be0 msgr2=0x7f6d6c147b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:40.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.795+0000 7f6d73e29640 1 --2- 172.21.15.31:0/2757461603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d6c0b8be0 0x7f6d6c147b70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c00e9d0 tx=0x7f6d5c00ee90 comp rx=0 tx=0).stop 2024-04-15T00:31:40.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.795+0000 7f6d73e29640 1 -- 172.21.15.31:0/2757461603 shutdown_connections 2024-04-15T00:31:40.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.795+0000 7f6d73e29640 1 --2- 172.21.15.31:0/2757461603 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f6d5006b990 0x7f6d5006de50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:40.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.795+0000 7f6d73e29640 1 --2- 172.21.15.31:0/2757461603 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f6d6c14b4c0 0x7f6d6c1480b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:40.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.795+0000 7f6d73e29640 1 --2- 172.21.15.31:0/2757461603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d6c0b8be0 0x7f6d6c147b70 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:40.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.795+0000 7f6d73e29640 1 --2- 172.21.15.31:0/2757461603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d6c0b80d0 0x7f6d6c0b1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:40.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.795+0000 7f6d73e29640 1 -- 172.21.15.31:0/2757461603 >> 172.21.15.31:0/2757461603 conn(0x7f6d6c0bd020 msgr2=0x7f6d6c09ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:40.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.795+0000 7f6d73e29640 1 -- 172.21.15.31:0/2757461603 shutdown_connections 2024-04-15T00:31:40.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:40.795+0000 7f6d73e29640 1 -- 172.21.15.31:0/2757461603 wait complete. 2024-04-15T00:31:40.814 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi031.front.sepia.ceph.com... 2024-04-15T00:31:40.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:31:40.815 DEBUG:teuthology.orchestra.run.smithi031:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-15T00:31:40.850 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi031.stderr:ceph-fuse[48007]: fuse finished with error 0 and tester_r 0 2024-04-15T00:31:41.427 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T00:31:41.427 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2024-04-15T00:31:41.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:31:41.427 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-15T00:31:41.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:31:41.444 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-04-15T00:31:41.527 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-15T00:31:41.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:31:41.527 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T00:31:41.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:31:41.598 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link delete ceph-brx 2024-04-15T00:31:41.697 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-15T00:31:41.771 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-15T00:31:41.772 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T00:31:41.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.873+0000 7f4ad02de640 1 Processor -- start 2024-04-15T00:31:41.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.873+0000 7f4ad02de640 1 -- start start 2024-04-15T00:31:41.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.874+0000 7f4ad02de640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4ac80b8be0 0x7f4ac8072570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:41.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.874+0000 7f4ad02de640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ac8072c90 con 0x7f4ac80b80d0 2024-04-15T00:31:41.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.874+0000 7f4ad02de640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ac809c0e0 con 0x7f4ac814b4c0 2024-04-15T00:31:41.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.874+0000 7f4ad02de640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f4ac80b84b0 con 0x7f4ac80b8be0 2024-04-15T00:31:41.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.874+0000 7f4acd879640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4ac80b8be0 0x7f4ac8072570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:41.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.874+0000 7f4ace07a640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4ac80b80d0 0x7f4ac814adb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50248/0 (socket says 172.21.15.31:50248) 2024-04-15T00:31:41.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.874+0000 7f4ace07a640 1 -- 172.21.15.31:0/3474505526 learned_addr learned my addr 172.21.15.31:0/3474505526 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:31:41.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.874+0000 7f4acd879640 1 -- 172.21.15.31:0/3474505526 >> v1:172.21.15.50:6789/0 conn(0x7f4ac814b4c0 legacy=0x7f4ac81449c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:41.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.874+0000 7f4acd879640 1 -- 172.21.15.31:0/3474505526 >> v1:172.21.15.31:6789/0 conn(0x7f4ac80b80d0 legacy=0x7f4ac814adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:41.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.874+0000 7f4acd078640 1 -- 172.21.15.31:0/3474505526 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1512165502 0 0) 0x7f4ac8072c90 con 0x7f4ac80b80d0 2024-04-15T00:31:41.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.874+0000 7f4acd879640 1 -- 172.21.15.31:0/3474505526 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac809c380 con 0x7f4ac80b8be0 2024-04-15T00:31:41.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.875+0000 7f4acd879640 1 --2- 172.21.15.31:0/3474505526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ac80b8be0 0x7f4ac8072570 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4ab80097a0 tx=0x7f4ab802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b0a6663238a443 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:41.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.875+0000 7f4acd078640 1 -- 172.21.15.31:0/3474505526 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab80315a0 con 0x7f4ac80b8be0 2024-04-15T00:31:41.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.875+0000 7f4acd078640 1 -- 172.21.15.31:0/3474505526 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab8037070 con 0x7f4ac80b8be0 2024-04-15T00:31:41.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.875+0000 7f4acd078640 1 -- 172.21.15.31:0/3474505526 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8031960 con 0x7f4ac80b8be0 2024-04-15T00:31:41.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.875+0000 7f4ad02de640 1 -- 172.21.15.31:0/3474505526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ac80b8be0 msgr2=0x7f4ac8072570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:41.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.875+0000 7f4ad02de640 1 --2- 172.21.15.31:0/3474505526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ac80b8be0 0x7f4ac8072570 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4ab80097a0 tx=0x7f4ab802b840 comp rx=0 tx=0).stop 2024-04-15T00:31:41.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.876+0000 7f4ad02de640 1 -- 172.21.15.31:0/3474505526 shutdown_connections 2024-04-15T00:31:41.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.876+0000 7f4ad02de640 1 --2- 172.21.15.31:0/3474505526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ac80b8be0 0x7f4ac8072570 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:41.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.876+0000 7f4ad02de640 1 -- 172.21.15.31:0/3474505526 >> 172.21.15.31:0/3474505526 conn(0x7f4ac80bd020 msgr2=0x7f4ac80bd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:41.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.876+0000 7f4ad02de640 1 -- 172.21.15.31:0/3474505526 shutdown_connections 2024-04-15T00:31:41.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.876+0000 7f4ad02de640 1 -- 172.21.15.31:0/3474505526 wait complete. 2024-04-15T00:31:41.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.877+0000 7f4ad02de640 1 Processor -- start 2024-04-15T00:31:41.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.877+0000 7f4ad02de640 1 -- start start 2024-04-15T00:31:41.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.877+0000 7f4ad02de640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ac80b80d0 0x7f4ac80b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:41.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.877+0000 7f4ad02de640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ac80b8be0 0x7f4ac81dd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:41.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.878+0000 7f4ad02de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac814b4c0 0x7f4ac81ddb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:41.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.878+0000 7f4ad02de640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac8145250 con 0x7f4ac80b8be0 2024-04-15T00:31:41.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.878+0000 7f4ad02de640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac81450d0 con 0x7f4ac814b4c0 2024-04-15T00:31:41.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.878+0000 7f4ad02de640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac81453d0 con 0x7f4ac80b80d0 2024-04-15T00:31:41.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.878+0000 7f4acd879640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ac80b8be0 0x7f4ac81dd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:41.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.878+0000 7f4acd879640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ac80b8be0 0x7f4ac81dd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59244/0 (socket says 172.21.15.31:59244) 2024-04-15T00:31:41.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.878+0000 7f4acd879640 1 -- 172.21.15.31:0/2378496125 learned_addr learned my addr 172.21.15.31:0/2378496125 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:41.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.878+0000 7f4ace07a640 1 --2- 172.21.15.31:0/2378496125 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ac80b80d0 0x7f4ac80b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:41.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.878+0000 7f4ace87b640 1 --2- 172.21.15.31:0/2378496125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac814b4c0 0x7f4ac81ddb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:41.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.878+0000 7f4acd879640 1 -- 172.21.15.31:0/2378496125 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ac80b80d0 msgr2=0x7f4ac80b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:41.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.878+0000 7f4acd879640 1 --2- 172.21.15.31:0/2378496125 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ac80b80d0 0x7f4ac80b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:41.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.878+0000 7f4acd879640 1 -- 172.21.15.31:0/2378496125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac814b4c0 msgr2=0x7f4ac81ddb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:41.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.878+0000 7f4acd879640 1 --2- 172.21.15.31:0/2378496125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac814b4c0 0x7f4ac81ddb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:41.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.878+0000 7f4acd879640 1 -- 172.21.15.31:0/2378496125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac81459a0 con 0x7f4ac80b8be0 2024-04-15T00:31:41.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.878+0000 7f4acd879640 1 --2- 172.21.15.31:0/2378496125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ac80b8be0 0x7f4ac81dd5c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8034040 tx=0x7f4ab80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:41.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.878+0000 7f4abeffd640 1 -- 172.21.15.31:0/2378496125 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8004230 con 0x7f4ac80b8be0 2024-04-15T00:31:41.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.878+0000 7f4abeffd640 1 -- 172.21.15.31:0/2378496125 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab80043d0 con 0x7f4ac80b8be0 2024-04-15T00:31:41.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.878+0000 7f4ad02de640 1 -- 172.21.15.31:0/2378496125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ac80b2a60 con 0x7f4ac80b8be0 2024-04-15T00:31:41.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.878+0000 7f4abeffd640 1 -- 172.21.15.31:0/2378496125 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8032880 con 0x7f4ac80b8be0 2024-04-15T00:31:41.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.878+0000 7f4ad02de640 1 -- 172.21.15.31:0/2378496125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ac80b0140 con 0x7f4ac80b8be0 2024-04-15T00:31:41.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.879+0000 7f4ad02de640 1 -- 172.21.15.31:0/2378496125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ac809f730 con 0x7f4ac80b8be0 2024-04-15T00:31:41.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.880+0000 7f4abeffd640 1 -- 172.21.15.31:0/2378496125 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f4ab8032a20 con 0x7f4ac80b8be0 2024-04-15T00:31:41.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.880+0000 7f4abeffd640 1 --2- 172.21.15.31:0/2378496125 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f4aac06b9c0 0x7f4aac06de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:41.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.880+0000 7f4abeffd640 1 -- 172.21.15.31:0/2378496125 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f4ab802f030 con 0x7f4ac80b8be0 2024-04-15T00:31:41.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.880+0000 7f4ace07a640 1 --2- 172.21.15.31:0/2378496125 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f4aac06b9c0 0x7f4aac06de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:41.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.881+0000 7f4ace07a640 1 --2- 172.21.15.31:0/2378496125 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f4aac06b9c0 0x7f4aac06de80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4007f70 tx=0x7f4ac4007f00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:41.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:41.884+0000 7f4abeffd640 1 -- 172.21.15.31:0/2378496125 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4ab8041070 con 0x7f4ac80b8be0 2024-04-15T00:31:42.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.065+0000 7f4ad02de640 1 -- 172.21.15.31:0/2378496125 --> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4ac804f620 con 0x7f4aac06b9c0 2024-04-15T00:31:42.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.073+0000 7f4abeffd640 1 -- 172.21.15.31:0/2378496125 <== mgr.4107 v2:172.21.15.31:6832/915470279 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334303 (secure 0 0 0) 0x7f4ac804f620 con 0x7f4aac06b9c0 2024-04-15T00:31:42.085 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:31:42.087 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-15T00:31:42.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.076+0000 7f4ad02de640 1 -- 172.21.15.31:0/2378496125 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f4aac06b9c0 msgr2=0x7f4aac06de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:42.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.076+0000 7f4ad02de640 1 --2- 172.21.15.31:0/2378496125 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f4aac06b9c0 0x7f4aac06de80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4007f70 tx=0x7f4ac4007f00 comp rx=0 tx=0).stop 2024-04-15T00:31:42.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.076+0000 7f4ad02de640 1 -- 172.21.15.31:0/2378496125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ac80b8be0 msgr2=0x7f4ac81dd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:42.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.076+0000 7f4ad02de640 1 --2- 172.21.15.31:0/2378496125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ac80b8be0 0x7f4ac81dd5c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8034040 tx=0x7f4ab80046c0 comp rx=0 tx=0).stop 2024-04-15T00:31:42.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.077+0000 7f4ad02de640 1 -- 172.21.15.31:0/2378496125 shutdown_connections 2024-04-15T00:31:42.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.077+0000 7f4ad02de640 1 --2- 172.21.15.31:0/2378496125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac814b4c0 0x7f4ac81ddb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:42.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.077+0000 7f4ad02de640 1 --2- 172.21.15.31:0/2378496125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ac80b8be0 0x7f4ac81dd5c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:42.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.077+0000 7f4ad02de640 1 --2- 172.21.15.31:0/2378496125 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f4aac06b9c0 0x7f4aac06de80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:42.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.077+0000 7f4ad02de640 1 --2- 172.21.15.31:0/2378496125 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f4ac80b80d0 0x7f4ac80b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:42.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.077+0000 7f4ad02de640 1 -- 172.21.15.31:0/2378496125 >> 172.21.15.31:0/2378496125 conn(0x7f4ac80bd020 msgr2=0x7f4ac809aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:42.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.077+0000 7f4ad02de640 1 -- 172.21.15.31:0/2378496125 shutdown_connections 2024-04-15T00:31:42.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.077+0000 7f4ad02de640 1 -- 172.21.15.31:0/2378496125 wait complete. 2024-04-15T00:31:42.096 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-04-15T00:31:40.530838+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":13436213640,"num_objects":3426,"num_object_clones":0,"num_object_copies":13632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3426,"num_whiteouts":0,"num_read":152,"num_read_kb":172,"num_write":151397,"num_write_kb":13705833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32718,"ondisk_log_size":32718,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":28054680,"kb_used_data":26246872,"kb_used_omap":12,"kb_used_meta":1807731,"kb_avail":726920040,"statfs":{"total":773094113280,"available":744366120960,"internally_reserved":0,"allocated":26876796928,"data_stored":26875380858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1851117105},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,1,2,1,5,2,14,12,20,45,35,61,65],"upper_bound":8192},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":156276,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22670,"num_write_kb":91463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003228"},"pg_stats":[{"pgid":"2.1f","version":"27'5","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:31.459095+0000","last_change":"2024-04-15T00:21:07.577313+0000","last_active":"2024-04-15T00:29:31.459095+0000","last_peered":"2024-04-15T00:29:31.459095+0000","last_clean":"2024-04-15T00:29:31.459095+0000","last_became_active":"2024-04-15T00:21:07.576921+0000","last_became_peered":"2024-04-15T00:21:07.576921+0000","last_unstale":"2024-04-15T00:29:31.459095+0000","last_undegraded":"2024-04-15T00:29:31.459095+0000","last_fullsized":"2024-04-15T00:29:31.459095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:41:31.846500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:11.454463+0000","last_change":"2024-04-15T00:21:08.579912+0000","last_active":"2024-04-15T00:29:11.454463+0000","last_peered":"2024-04-15T00:29:11.454463+0000","last_clean":"2024-04-15T00:29:11.454463+0000","last_became_active":"2024-04-15T00:21:08.579545+0000","last_became_peered":"2024-04-15T00:21:08.579545+0000","last_unstale":"2024-04-15T00:29:11.454463+0000","last_undegraded":"2024-04-15T00:29:11.454463+0000","last_fullsized":"2024-04-15T00:29:11.454463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'1071","reported_seq":1093,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.698383+0000","last_change":"2024-04-15T00:21:12.634366+0000","last_active":"2024-04-15T00:31:32.698383+0000","last_peered":"2024-04-15T00:31:32.698383+0000","last_clean":"2024-04-15T00:31:32.698383+0000","last_became_active":"2024-04-15T00:21:12.633323+0000","last_became_peered":"2024-04-15T00:21:12.633323+0000","last_unstale":"2024-04-15T00:31:32.698383+0000","last_undegraded":"2024-04-15T00:31:32.698383+0000","last_fullsized":"2024-04-15T00:31:32.698383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1071,"log_dups_size":0,"ondisk_log_size":1071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:26:21.575108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444643618,"num_objects":114,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5549,"num_write_kb":456057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:11.454494+0000","last_change":"2024-04-15T00:21:07.569057+0000","last_active":"2024-04-15T00:29:11.454494+0000","last_peered":"2024-04-15T00:29:11.454494+0000","last_clean":"2024-04-15T00:29:11.454494+0000","last_became_active":"2024-04-15T00:21:07.568724+0000","last_became_peered":"2024-04-15T00:21:07.568724+0000","last_unstale":"2024-04-15T00:29:11.454494+0000","last_undegraded":"2024-04-15T00:29:11.454494+0000","last_fullsized":"2024-04-15T00:29:11.454494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:21:35.113136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'6","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:31.459085+0000","last_change":"2024-04-15T00:21:08.598196+0000","last_active":"2024-04-15T00:29:31.459085+0000","last_peered":"2024-04-15T00:29:31.459085+0000","last_clean":"2024-04-15T00:29:31.459085+0000","last_became_active":"2024-04-15T00:21:08.597625+0000","last_became_peered":"2024-04-15T00:21:08.597625+0000","last_unstale":"2024-04-15T00:29:31.459085+0000","last_undegraded":"2024-04-15T00:29:31.459085+0000","last_fullsized":"2024-04-15T00:29:31.459085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'864","reported_seq":886,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.174953+0000","last_change":"2024-04-15T00:21:12.624625+0000","last_active":"2024-04-15T00:31:30.174953+0000","last_peered":"2024-04-15T00:31:30.174953+0000","last_clean":"2024-04-15T00:31:30.174953+0000","last_became_active":"2024-04-15T00:21:12.624222+0000","last_became_peered":"2024-04-15T00:21:12.624222+0000","last_unstale":"2024-04-15T00:31:30.174953+0000","last_undegraded":"2024-04-15T00:31:30.174953+0000","last_fullsized":"2024-04-15T00:31:30.174953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":864,"log_dups_size":0,"ondisk_log_size":864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:28.534842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432116108,"num_objects":108,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4130,"num_write_kb":438054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'7","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:13.937261+0000","last_change":"2024-04-15T00:21:07.576936+0000","last_active":"2024-04-15T00:29:13.937261+0000","last_peered":"2024-04-15T00:29:13.937261+0000","last_clean":"2024-04-15T00:29:13.937261+0000","last_became_active":"2024-04-15T00:21:07.576674+0000","last_became_peered":"2024-04-15T00:21:07.576674+0000","last_unstale":"2024-04-15T00:29:13.937261+0000","last_undegraded":"2024-04-15T00:29:13.937261+0000","last_fullsized":"2024-04-15T00:29:13.937261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:40.459416+0000","last_change":"2024-04-15T00:21:08.587098+0000","last_active":"2024-04-15T00:28:40.459416+0000","last_peered":"2024-04-15T00:28:40.459416+0000","last_clean":"2024-04-15T00:28:40.459416+0000","last_became_active":"2024-04-15T00:21:08.586825+0000","last_became_peered":"2024-04-15T00:21:08.586825+0000","last_unstale":"2024-04-15T00:28:40.459416+0000","last_undegraded":"2024-04-15T00:28:40.459416+0000","last_fullsized":"2024-04-15T00:28:40.459416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:30.470116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'1019","reported_seq":1041,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.357740+0000","last_change":"2024-04-15T00:21:12.619903+0000","last_active":"2024-04-15T00:31:30.357740+0000","last_peered":"2024-04-15T00:31:30.357740+0000","last_clean":"2024-04-15T00:31:30.357740+0000","last_became_active":"2024-04-15T00:21:12.619259+0000","last_became_peered":"2024-04-15T00:21:12.619259+0000","last_unstale":"2024-04-15T00:31:30.357740+0000","last_undegraded":"2024-04-15T00:31:30.357740+0000","last_fullsized":"2024-04-15T00:31:30.357740+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1019,"log_dups_size":0,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:31.463828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411101590,"num_objects":106,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4869,"num_write_kb":420502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'4","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:13.316381+0000","last_change":"2024-04-15T00:21:07.579089+0000","last_active":"2024-04-15T00:29:13.316381+0000","last_peered":"2024-04-15T00:29:13.316381+0000","last_clean":"2024-04-15T00:29:13.316381+0000","last_became_active":"2024-04-15T00:21:07.578733+0000","last_became_peered":"2024-04-15T00:21:07.578733+0000","last_unstale":"2024-04-15T00:29:13.316381+0000","last_undegraded":"2024-04-15T00:29:13.316381+0000","last_fullsized":"2024-04-15T00:29:13.316381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:44:30.015803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:40.459434+0000","last_change":"2024-04-15T00:21:08.588235+0000","last_active":"2024-04-15T00:28:40.459434+0000","last_peered":"2024-04-15T00:28:40.459434+0000","last_clean":"2024-04-15T00:28:40.459434+0000","last_became_active":"2024-04-15T00:21:08.587951+0000","last_became_peered":"2024-04-15T00:21:08.587951+0000","last_unstale":"2024-04-15T00:28:40.459434+0000","last_undegraded":"2024-04-15T00:28:40.459434+0000","last_fullsized":"2024-04-15T00:28:40.459434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:08.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'897","reported_seq":919,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.101297+0000","last_change":"2024-04-15T00:21:12.613395+0000","last_active":"2024-04-15T00:31:30.101297+0000","last_peered":"2024-04-15T00:31:30.101297+0000","last_clean":"2024-04-15T00:31:30.101297+0000","last_became_active":"2024-04-15T00:21:12.612976+0000","last_became_peered":"2024-04-15T00:21:12.612976+0000","last_unstale":"2024-04-15T00:31:30.101297+0000","last_undegraded":"2024-04-15T00:31:30.101297+0000","last_fullsized":"2024-04-15T00:31:30.101297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":897,"log_dups_size":0,"ondisk_log_size":897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:05.044024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360723173,"num_objects":88,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4357,"num_write_kb":369330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:40.453065+0000","last_change":"2024-04-15T00:21:08.585248+0000","last_active":"2024-04-15T00:27:40.453065+0000","last_peered":"2024-04-15T00:27:40.453065+0000","last_clean":"2024-04-15T00:27:40.453065+0000","last_became_active":"2024-04-15T00:21:08.584882+0000","last_became_peered":"2024-04-15T00:21:08.584882+0000","last_unstale":"2024-04-15T00:27:40.453065+0000","last_undegraded":"2024-04-15T00:27:40.453065+0000","last_fullsized":"2024-04-15T00:27:40.453065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:27:41.268464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'848","reported_seq":878,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:31.961219+0000","last_change":"2024-04-15T00:21:07.580541+0000","last_active":"2024-04-15T00:31:31.961219+0000","last_peered":"2024-04-15T00:31:31.961219+0000","last_clean":"2024-04-15T00:31:31.961219+0000","last_became_active":"2024-04-15T00:21:07.580229+0000","last_became_peered":"2024-04-15T00:21:07.580229+0000","last_unstale":"2024-04-15T00:31:31.961219+0000","last_undegraded":"2024-04-15T00:31:31.961219+0000","last_fullsized":"2024-04-15T00:31:31.961219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:34:26.325595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2948310,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":847,"num_write_kb":3058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'817","reported_seq":839,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.023590+0000","last_change":"2024-04-15T00:21:12.624175+0000","last_active":"2024-04-15T00:31:30.023590+0000","last_peered":"2024-04-15T00:31:30.023590+0000","last_clean":"2024-04-15T00:31:30.023590+0000","last_became_active":"2024-04-15T00:21:12.623783+0000","last_became_peered":"2024-04-15T00:21:12.623783+0000","last_unstale":"2024-04-15T00:31:30.023590+0000","last_undegraded":"2024-04-15T00:31:30.023590+0000","last_fullsized":"2024-04-15T00:31:30.023590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:22:04.031788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":419652210,"num_objects":107,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4013,"num_write_kb":425701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'8","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:56.448391+0000","last_change":"2024-04-15T00:21:08.594955+0000","last_active":"2024-04-15T00:27:56.448391+0000","last_peered":"2024-04-15T00:27:56.448391+0000","last_clean":"2024-04-15T00:27:56.448391+0000","last_became_active":"2024-04-15T00:21:08.594535+0000","last_became_peered":"2024-04-15T00:21:08.594535+0000","last_unstale":"2024-04-15T00:27:56.448391+0000","last_undegraded":"2024-04-15T00:27:56.448391+0000","last_fullsized":"2024-04-15T00:27:56.448391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:40.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:40.456499+0000","last_change":"2024-04-15T00:21:07.570862+0000","last_active":"2024-04-15T00:27:40.456499+0000","last_peered":"2024-04-15T00:27:40.456499+0000","last_clean":"2024-04-15T00:27:40.456499+0000","last_became_active":"2024-04-15T00:21:07.570555+0000","last_became_peered":"2024-04-15T00:21:07.570555+0000","last_unstale":"2024-04-15T00:27:40.456499+0000","last_undegraded":"2024-04-15T00:27:40.456499+0000","last_fullsized":"2024-04-15T00:27:40.456499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:54.810223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'900","reported_seq":929,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.386105+0000","last_change":"2024-04-15T00:21:50.135837+0000","last_active":"2024-04-15T00:31:30.386105+0000","last_peered":"2024-04-15T00:31:30.386105+0000","last_clean":"2024-04-15T00:31:30.386105+0000","last_became_active":"2024-04-15T00:21:50.135204+0000","last_became_peered":"2024-04-15T00:21:50.135204+0000","last_unstale":"2024-04-15T00:31:30.386105+0000","last_undegraded":"2024-04-15T00:31:30.386105+0000","last_fullsized":"2024-04-15T00:31:30.386105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:15:08.738300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423642109,"num_objects":107,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4534,"num_write_kb":431423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'8","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:41.447068+0000","last_change":"2024-04-15T00:21:08.574901+0000","last_active":"2024-04-15T00:27:41.447068+0000","last_peered":"2024-04-15T00:27:41.447068+0000","last_clean":"2024-04-15T00:27:41.447068+0000","last_became_active":"2024-04-15T00:21:08.574536+0000","last_became_peered":"2024-04-15T00:21:08.574536+0000","last_unstale":"2024-04-15T00:27:41.447068+0000","last_undegraded":"2024-04-15T00:27:41.447068+0000","last_fullsized":"2024-04-15T00:27:41.447068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:08.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:40.456476+0000","last_change":"2024-04-15T00:21:07.577048+0000","last_active":"2024-04-15T00:27:40.456476+0000","last_peered":"2024-04-15T00:27:40.456476+0000","last_clean":"2024-04-15T00:27:40.456476+0000","last_became_active":"2024-04-15T00:21:07.576739+0000","last_became_peered":"2024-04-15T00:21:07.576739+0000","last_unstale":"2024-04-15T00:27:40.456476+0000","last_undegraded":"2024-04-15T00:27:40.456476+0000","last_fullsized":"2024-04-15T00:27:40.456476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:14.441186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'1173","reported_seq":1195,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.552356+0000","last_change":"2024-04-15T00:21:12.632213+0000","last_active":"2024-04-15T00:31:32.552356+0000","last_peered":"2024-04-15T00:31:32.552356+0000","last_clean":"2024-04-15T00:31:32.552356+0000","last_became_active":"2024-04-15T00:21:12.631900+0000","last_became_peered":"2024-04-15T00:21:12.631900+0000","last_unstale":"2024-04-15T00:31:32.552356+0000","last_undegraded":"2024-04-15T00:31:32.552356+0000","last_fullsized":"2024-04-15T00:31:32.552356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1173,"log_dups_size":0,"ondisk_log_size":1173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:52:31.142377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":507526656,"num_objects":125,"num_object_clones":0,"num_object_copies":500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5839,"num_write_kb":518448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:40.467738+0000","last_change":"2024-04-15T00:21:08.590270+0000","last_active":"2024-04-15T00:27:40.467738+0000","last_peered":"2024-04-15T00:27:40.467738+0000","last_clean":"2024-04-15T00:27:40.467738+0000","last_became_active":"2024-04-15T00:21:08.589960+0000","last_became_peered":"2024-04-15T00:21:08.589960+0000","last_unstale":"2024-04-15T00:27:40.467738+0000","last_undegraded":"2024-04-15T00:27:40.467738+0000","last_fullsized":"2024-04-15T00:27:40.467738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:52.880065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:40.459480+0000","last_change":"2024-04-15T00:21:07.577518+0000","last_active":"2024-04-15T00:27:40.459480+0000","last_peered":"2024-04-15T00:27:40.459480+0000","last_clean":"2024-04-15T00:27:40.459480+0000","last_became_active":"2024-04-15T00:21:07.576961+0000","last_became_peered":"2024-04-15T00:21:07.576961+0000","last_unstale":"2024-04-15T00:27:40.459480+0000","last_undegraded":"2024-04-15T00:27:40.459480+0000","last_fullsized":"2024-04-15T00:27:40.459480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:14.441186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'743","reported_seq":772,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.215032+0000","last_change":"2024-04-15T00:21:50.136014+0000","last_active":"2024-04-15T00:31:30.215032+0000","last_peered":"2024-04-15T00:31:30.215032+0000","last_clean":"2024-04-15T00:31:30.215032+0000","last_became_active":"2024-04-15T00:21:50.135523+0000","last_became_peered":"2024-04-15T00:21:50.135523+0000","last_unstale":"2024-04-15T00:31:30.215032+0000","last_undegraded":"2024-04-15T00:31:30.215032+0000","last_fullsized":"2024-04-15T00:31:30.215032+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:29.469506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373416048,"num_objects":97,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3682,"num_write_kb":379037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'13","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:41.450054+0000","last_change":"2024-04-15T00:21:08.601349+0000","last_active":"2024-04-15T00:27:41.450054+0000","last_peered":"2024-04-15T00:27:41.450054+0000","last_clean":"2024-04-15T00:27:41.450054+0000","last_became_active":"2024-04-15T00:21:08.601048+0000","last_became_peered":"2024-04-15T00:21:08.601048+0000","last_unstale":"2024-04-15T00:27:41.450054+0000","last_undegraded":"2024-04-15T00:27:41.450054+0000","last_fullsized":"2024-04-15T00:27:41.450054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:27:41.268464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'4","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:40.453118+0000","last_change":"2024-04-15T00:21:07.577793+0000","last_active":"2024-04-15T00:27:40.453118+0000","last_peered":"2024-04-15T00:27:40.453118+0000","last_clean":"2024-04-15T00:27:40.453118+0000","last_became_active":"2024-04-15T00:21:07.577472+0000","last_became_peered":"2024-04-15T00:21:07.577472+0000","last_unstale":"2024-04-15T00:27:40.453118+0000","last_undegraded":"2024-04-15T00:27:40.453118+0000","last_fullsized":"2024-04-15T00:27:40.453118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:54.810223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'847","reported_seq":870,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.090056+0000","last_change":"2024-04-15T00:21:12.634814+0000","last_active":"2024-04-15T00:31:30.090056+0000","last_peered":"2024-04-15T00:31:30.090056+0000","last_clean":"2024-04-15T00:31:30.090056+0000","last_became_active":"2024-04-15T00:21:12.633228+0000","last_became_peered":"2024-04-15T00:21:12.633228+0000","last_unstale":"2024-04-15T00:31:30.090056+0000","last_undegraded":"2024-04-15T00:31:30.090056+0000","last_fullsized":"2024-04-15T00:31:30.090056+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:13.312501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411134922,"num_objects":101,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3991,"num_write_kb":416955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'8","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:20.459653+0000","last_change":"2024-04-15T00:21:49.708455+0000","last_active":"2024-04-15T00:28:20.459653+0000","last_peered":"2024-04-15T00:28:20.459653+0000","last_clean":"2024-04-15T00:28:20.459653+0000","last_became_active":"2024-04-15T00:21:49.708106+0000","last_became_peered":"2024-04-15T00:21:49.708106+0000","last_unstale":"2024-04-15T00:28:20.459653+0000","last_undegraded":"2024-04-15T00:28:20.459653+0000","last_fullsized":"2024-04-15T00:28:20.459653+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:04:14.156671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"27'321","reported_seq":351,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:34.662403+0000","last_change":"2024-04-15T00:21:07.573285+0000","last_active":"2024-04-15T00:31:34.662403+0000","last_peered":"2024-04-15T00:31:34.662403+0000","last_clean":"2024-04-15T00:31:34.662403+0000","last_became_active":"2024-04-15T00:21:07.572973+0000","last_became_peered":"2024-04-15T00:21:07.572973+0000","last_unstale":"2024-04-15T00:31:34.662403+0000","last_undegraded":"2024-04-15T00:31:34.662403+0000","last_fullsized":"2024-04-15T00:31:34.662403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":663,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'847","reported_seq":870,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.320976+0000","last_change":"2024-04-15T00:21:12.633602+0000","last_active":"2024-04-15T00:31:32.320976+0000","last_peered":"2024-04-15T00:31:32.320976+0000","last_clean":"2024-04-15T00:31:32.320976+0000","last_became_active":"2024-04-15T00:21:12.633178+0000","last_became_peered":"2024-04-15T00:21:12.633178+0000","last_unstale":"2024-04-15T00:31:32.320976+0000","last_undegraded":"2024-04-15T00:31:32.320976+0000","last_fullsized":"2024-04-15T00:31:32.320976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:01:48.959493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448855783,"num_objects":113,"num_object_clones":0,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4294,"num_write_kb":455043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'5","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.465238+0000","last_change":"2024-04-15T00:21:08.580727+0000","last_active":"2024-04-15T00:29:30.465238+0000","last_peered":"2024-04-15T00:29:30.465238+0000","last_clean":"2024-04-15T00:29:30.465238+0000","last_became_active":"2024-04-15T00:21:08.580418+0000","last_became_peered":"2024-04-15T00:21:08.580418+0000","last_unstale":"2024-04-15T00:29:30.465238+0000","last_undegraded":"2024-04-15T00:29:30.465238+0000","last_fullsized":"2024-04-15T00:29:30.465238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'1","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.470869+0000","last_change":"2024-04-15T00:21:07.575864+0000","last_active":"2024-04-15T00:29:30.470869+0000","last_peered":"2024-04-15T00:29:30.470869+0000","last_clean":"2024-04-15T00:29:30.470869+0000","last_became_active":"2024-04-15T00:21:07.575562+0000","last_became_peered":"2024-04-15T00:21:07.575562+0000","last_unstale":"2024-04-15T00:29:30.470869+0000","last_undegraded":"2024-04-15T00:29:30.470869+0000","last_fullsized":"2024-04-15T00:29:30.470869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:35:39.009511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'992","reported_seq":1014,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.358746+0000","last_change":"2024-04-15T00:21:12.633674+0000","last_active":"2024-04-15T00:31:30.358746+0000","last_peered":"2024-04-15T00:31:30.358746+0000","last_clean":"2024-04-15T00:31:30.358746+0000","last_became_active":"2024-04-15T00:21:12.633277+0000","last_became_peered":"2024-04-15T00:21:12.633277+0000","last_unstale":"2024-04-15T00:31:30.358746+0000","last_undegraded":"2024-04-15T00:31:30.358746+0000","last_fullsized":"2024-04-15T00:31:30.358746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":992,"log_dups_size":0,"ondisk_log_size":992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:49.295552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":382066035,"num_objects":93,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4954,"num_write_kb":392450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'6","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.464590+0000","last_change":"2024-04-15T00:21:08.578321+0000","last_active":"2024-04-15T00:29:30.464590+0000","last_peered":"2024-04-15T00:29:30.464590+0000","last_clean":"2024-04-15T00:29:30.464590+0000","last_became_active":"2024-04-15T00:21:08.578017+0000","last_became_peered":"2024-04-15T00:21:08.578017+0000","last_unstale":"2024-04-15T00:29:30.464590+0000","last_undegraded":"2024-04-15T00:29:30.464590+0000","last_fullsized":"2024-04-15T00:29:30.464590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:40.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.465258+0000","last_change":"2024-04-15T00:21:07.575183+0000","last_active":"2024-04-15T00:29:30.465258+0000","last_peered":"2024-04-15T00:29:30.465258+0000","last_clean":"2024-04-15T00:29:30.465258+0000","last_became_active":"2024-04-15T00:21:07.574822+0000","last_became_peered":"2024-04-15T00:21:07.574822+0000","last_unstale":"2024-04-15T00:29:30.465258+0000","last_undegraded":"2024-04-15T00:29:30.465258+0000","last_fullsized":"2024-04-15T00:29:30.465258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:26:22.612110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'1180","reported_seq":1202,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:33.169343+0000","last_change":"2024-04-15T00:21:12.620150+0000","last_active":"2024-04-15T00:31:33.169343+0000","last_peered":"2024-04-15T00:31:33.169343+0000","last_clean":"2024-04-15T00:31:33.169343+0000","last_became_active":"2024-04-15T00:21:12.619694+0000","last_became_peered":"2024-04-15T00:21:12.619694+0000","last_unstale":"2024-04-15T00:31:33.169343+0000","last_undegraded":"2024-04-15T00:31:33.169343+0000","last_fullsized":"2024-04-15T00:31:33.169343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1180,"log_dups_size":0,"ondisk_log_size":1180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:34.506827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474051932,"num_objects":120,"num_object_clones":0,"num_object_copies":480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":120,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5768,"num_write_kb":485640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'6","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.479223+0000","last_change":"2024-04-15T00:21:08.596959+0000","last_active":"2024-04-15T00:29:30.479223+0000","last_peered":"2024-04-15T00:29:30.479223+0000","last_clean":"2024-04-15T00:29:30.479223+0000","last_became_active":"2024-04-15T00:21:08.596678+0000","last_became_peered":"2024-04-15T00:21:08.596678+0000","last_unstale":"2024-04-15T00:29:30.479223+0000","last_undegraded":"2024-04-15T00:29:30.479223+0000","last_fullsized":"2024-04-15T00:29:30.479223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:35:40.014598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.464535+0000","last_change":"2024-04-15T00:21:07.574514+0000","last_active":"2024-04-15T00:29:30.464535+0000","last_peered":"2024-04-15T00:29:30.464535+0000","last_clean":"2024-04-15T00:29:30.464535+0000","last_became_active":"2024-04-15T00:21:07.574228+0000","last_became_peered":"2024-04-15T00:21:07.574228+0000","last_unstale":"2024-04-15T00:29:30.464535+0000","last_undegraded":"2024-04-15T00:29:30.464535+0000","last_fullsized":"2024-04-15T00:29:30.464535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'1049","reported_seq":1071,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:31.971272+0000","last_change":"2024-04-15T00:21:12.619733+0000","last_active":"2024-04-15T00:31:31.971272+0000","last_peered":"2024-04-15T00:31:31.971272+0000","last_clean":"2024-04-15T00:31:31.971272+0000","last_became_active":"2024-04-15T00:21:12.619307+0000","last_became_peered":"2024-04-15T00:21:12.619307+0000","last_unstale":"2024-04-15T00:31:31.971272+0000","last_undegraded":"2024-04-15T00:31:31.971272+0000","last_fullsized":"2024-04-15T00:31:31.971272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1049,"log_dups_size":0,"ondisk_log_size":1049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:48:00.696018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415249523,"num_objects":103,"num_object_clones":0,"num_object_copies":412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5497,"num_write_kb":427157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'10","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:10.463508+0000","last_change":"2024-04-15T00:21:08.589246+0000","last_active":"2024-04-15T00:29:10.463508+0000","last_peered":"2024-04-15T00:29:10.463508+0000","last_clean":"2024-04-15T00:29:10.463508+0000","last_became_active":"2024-04-15T00:21:08.588920+0000","last_became_peered":"2024-04-15T00:21:08.588920+0000","last_unstale":"2024-04-15T00:29:10.463508+0000","last_undegraded":"2024-04-15T00:29:10.463508+0000","last_fullsized":"2024-04-15T00:29:10.463508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'37","reported_seq":104,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:31.451426+0000","last_change":"2024-04-15T00:21:07.566537+0000","last_active":"2024-04-15T00:29:31.451426+0000","last_peered":"2024-04-15T00:29:31.451426+0000","last_clean":"2024-04-15T00:29:31.451426+0000","last_became_active":"2024-04-15T00:21:07.566240+0000","last_became_peered":"2024-04-15T00:21:07.566240+0000","last_unstale":"2024-04-15T00:29:31.451426+0000","last_undegraded":"2024-04-15T00:29:31.451426+0000","last_fullsized":"2024-04-15T00:29:31.451426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:16:52.647503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50889,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":72,"num_write":36,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'862","reported_seq":884,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.536387+0000","last_change":"2024-04-15T00:21:12.623452+0000","last_active":"2024-04-15T00:31:32.536387+0000","last_peered":"2024-04-15T00:31:32.536387+0000","last_clean":"2024-04-15T00:31:32.536387+0000","last_became_active":"2024-04-15T00:21:12.623066+0000","last_became_peered":"2024-04-15T00:21:12.623066+0000","last_unstale":"2024-04-15T00:31:32.536387+0000","last_undegraded":"2024-04-15T00:31:32.536387+0000","last_fullsized":"2024-04-15T00:31:32.536387+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:11:16.107864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":453040013,"num_objects":117,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4260,"num_write_kb":459037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:31.459038+0000","last_change":"2024-04-15T00:21:08.586376+0000","last_active":"2024-04-15T00:29:31.459038+0000","last_peered":"2024-04-15T00:29:31.459038+0000","last_clean":"2024-04-15T00:29:31.459038+0000","last_became_active":"2024-04-15T00:21:08.586054+0000","last_became_peered":"2024-04-15T00:21:08.586054+0000","last_unstale":"2024-04-15T00:29:31.459038+0000","last_undegraded":"2024-04-15T00:29:31.459038+0000","last_fullsized":"2024-04-15T00:29:31.459038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:02:56.329428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:10.468749+0000","last_change":"2024-04-15T00:21:07.577289+0000","last_active":"2024-04-15T00:29:10.468749+0000","last_peered":"2024-04-15T00:29:10.468749+0000","last_clean":"2024-04-15T00:29:10.468749+0000","last_became_active":"2024-04-15T00:21:07.576602+0000","last_became_peered":"2024-04-15T00:21:07.576602+0000","last_unstale":"2024-04-15T00:29:10.468749+0000","last_undegraded":"2024-04-15T00:29:10.468749+0000","last_fullsized":"2024-04-15T00:29:10.468749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:26:22.612110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'902","reported_seq":924,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.470317+0000","last_change":"2024-04-15T00:21:12.634248+0000","last_active":"2024-04-15T00:31:30.470317+0000","last_peered":"2024-04-15T00:31:30.470317+0000","last_clean":"2024-04-15T00:31:30.470317+0000","last_became_active":"2024-04-15T00:21:12.633239+0000","last_became_peered":"2024-04-15T00:21:12.633239+0000","last_unstale":"2024-04-15T00:31:30.470317+0000","last_undegraded":"2024-04-15T00:31:30.470317+0000","last_fullsized":"2024-04-15T00:31:30.470317+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:52:31.142377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356541982,"num_objects":92,"num_object_clones":0,"num_object_copies":368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4244,"num_write_kb":364740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'4","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:31.462298+0000","last_change":"2024-04-15T00:21:08.591060+0000","last_active":"2024-04-15T00:29:31.462298+0000","last_peered":"2024-04-15T00:29:31.462298+0000","last_clean":"2024-04-15T00:29:31.462298+0000","last_became_active":"2024-04-15T00:21:08.590781+0000","last_became_peered":"2024-04-15T00:21:08.590781+0000","last_unstale":"2024-04-15T00:29:31.462298+0000","last_undegraded":"2024-04-15T00:29:31.462298+0000","last_fullsized":"2024-04-15T00:29:31.462298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.464552+0000","last_change":"2024-04-15T00:21:07.573617+0000","last_active":"2024-04-15T00:29:30.464552+0000","last_peered":"2024-04-15T00:29:30.464552+0000","last_clean":"2024-04-15T00:29:30.464552+0000","last_became_active":"2024-04-15T00:21:07.573308+0000","last_became_peered":"2024-04-15T00:21:07.573308+0000","last_unstale":"2024-04-15T00:29:30.464552+0000","last_undegraded":"2024-04-15T00:29:30.464552+0000","last_fullsized":"2024-04-15T00:29:30.464552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:36:11.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":187,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:00.467601+0000","last_change":"2024-04-15T00:20:57.937516+0000","last_active":"2024-04-15T00:29:00.467601+0000","last_peered":"2024-04-15T00:29:00.467601+0000","last_clean":"2024-04-15T00:29:00.467601+0000","last_became_active":"2024-04-15T00:20:57.936329+0000","last_became_peered":"2024-04-15T00:20:57.936329+0000","last_unstale":"2024-04-15T00:29:00.467601+0000","last_undegraded":"2024-04-15T00:29:00.467601+0000","last_fullsized":"2024-04-15T00:29:00.467601+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:20:56.517419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:20:56.517419+0000","last_clean_scrub_stamp":"2024-04-15T00:20:56.517419+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:07:23.949459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'923","reported_seq":946,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.464035+0000","last_change":"2024-04-15T00:21:12.633530+0000","last_active":"2024-04-15T00:31:30.464035+0000","last_peered":"2024-04-15T00:31:30.464035+0000","last_clean":"2024-04-15T00:31:30.464035+0000","last_became_active":"2024-04-15T00:21:12.633124+0000","last_became_peered":"2024-04-15T00:21:12.633124+0000","last_unstale":"2024-04-15T00:31:30.464035+0000","last_undegraded":"2024-04-15T00:31:30.464035+0000","last_fullsized":"2024-04-15T00:31:30.464035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":923,"log_dups_size":0,"ondisk_log_size":923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:49.295552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406896485,"num_objects":106,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4652,"num_write_kb":415602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:55.460924+0000","last_change":"2024-04-15T00:21:08.583443+0000","last_active":"2024-04-15T00:27:55.460924+0000","last_peered":"2024-04-15T00:27:55.460924+0000","last_clean":"2024-04-15T00:27:55.460924+0000","last_became_active":"2024-04-15T00:21:08.583143+0000","last_became_peered":"2024-04-15T00:21:08.583143+0000","last_unstale":"2024-04-15T00:27:55.460924+0000","last_undegraded":"2024-04-15T00:27:55.460924+0000","last_fullsized":"2024-04-15T00:27:55.460924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:01.007313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:56.444232+0000","last_change":"2024-04-15T00:21:07.579386+0000","last_active":"2024-04-15T00:27:56.444232+0000","last_peered":"2024-04-15T00:27:56.444232+0000","last_clean":"2024-04-15T00:27:56.444232+0000","last_became_active":"2024-04-15T00:21:07.579024+0000","last_became_peered":"2024-04-15T00:21:07.579024+0000","last_unstale":"2024-04-15T00:27:56.444232+0000","last_undegraded":"2024-04-15T00:27:56.444232+0000","last_fullsized":"2024-04-15T00:27:56.444232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:36:11.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'783","reported_seq":805,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.088053+0000","last_change":"2024-04-15T00:21:12.635286+0000","last_active":"2024-04-15T00:31:30.088053+0000","last_peered":"2024-04-15T00:31:30.088053+0000","last_clean":"2024-04-15T00:31:30.088053+0000","last_became_active":"2024-04-15T00:21:12.634689+0000","last_became_peered":"2024-04-15T00:21:12.634689+0000","last_unstale":"2024-04-15T00:31:30.088053+0000","last_undegraded":"2024-04-15T00:31:30.088053+0000","last_fullsized":"2024-04-15T00:31:30.088053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:05.044024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":419485282,"num_objects":105,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3792,"num_write_kb":424412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'7","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:36.447262+0000","last_change":"2024-04-15T00:21:49.708583+0000","last_active":"2024-04-15T00:28:36.447262+0000","last_peered":"2024-04-15T00:28:36.447262+0000","last_clean":"2024-04-15T00:28:36.447262+0000","last_became_active":"2024-04-15T00:21:49.708252+0000","last_became_peered":"2024-04-15T00:21:49.708252+0000","last_unstale":"2024-04-15T00:28:36.447262+0000","last_undegraded":"2024-04-15T00:28:36.447262+0000","last_fullsized":"2024-04-15T00:28:36.447262+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:01.007313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:55.457685+0000","last_change":"2024-04-15T00:21:07.571553+0000","last_active":"2024-04-15T00:27:55.457685+0000","last_peered":"2024-04-15T00:27:55.457685+0000","last_clean":"2024-04-15T00:27:55.457685+0000","last_became_active":"2024-04-15T00:21:07.571238+0000","last_became_peered":"2024-04-15T00:21:07.571238+0000","last_unstale":"2024-04-15T00:27:55.457685+0000","last_undegraded":"2024-04-15T00:27:55.457685+0000","last_fullsized":"2024-04-15T00:27:55.457685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:35:39.009511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'910","reported_seq":932,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.379637+0000","last_change":"2024-04-15T00:21:12.619646+0000","last_active":"2024-04-15T00:31:30.379637+0000","last_peered":"2024-04-15T00:31:30.379637+0000","last_clean":"2024-04-15T00:31:30.379637+0000","last_became_active":"2024-04-15T00:21:12.619263+0000","last_became_peered":"2024-04-15T00:21:12.619263+0000","last_unstale":"2024-04-15T00:31:30.379637+0000","last_undegraded":"2024-04-15T00:31:30.379637+0000","last_fullsized":"2024-04-15T00:31:30.379637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:31.463828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394550963,"num_objects":102,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4303,"num_write_kb":402124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'8","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:55.461007+0000","last_change":"2024-04-15T00:21:08.599410+0000","last_active":"2024-04-15T00:27:55.461007+0000","last_peered":"2024-04-15T00:27:55.461007+0000","last_clean":"2024-04-15T00:27:55.461007+0000","last_became_active":"2024-04-15T00:21:08.599132+0000","last_became_peered":"2024-04-15T00:21:08.599132+0000","last_unstale":"2024-04-15T00:27:55.461007+0000","last_undegraded":"2024-04-15T00:27:55.461007+0000","last_fullsized":"2024-04-15T00:27:55.461007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:47:56.659307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'3","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:56.444256+0000","last_change":"2024-04-15T00:21:07.567917+0000","last_active":"2024-04-15T00:27:56.444256+0000","last_peered":"2024-04-15T00:27:56.444256+0000","last_clean":"2024-04-15T00:27:56.444256+0000","last_became_active":"2024-04-15T00:21:07.567673+0000","last_became_peered":"2024-04-15T00:21:07.567673+0000","last_unstale":"2024-04-15T00:27:56.444256+0000","last_undegraded":"2024-04-15T00:27:56.444256+0000","last_fullsized":"2024-04-15T00:27:56.444256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:54.810223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'711","reported_seq":733,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.109666+0000","last_change":"2024-04-15T00:21:12.632937+0000","last_active":"2024-04-15T00:31:30.109666+0000","last_peered":"2024-04-15T00:31:30.109666+0000","last_clean":"2024-04-15T00:31:30.109666+0000","last_became_active":"2024-04-15T00:21:12.632508+0000","last_became_peered":"2024-04-15T00:21:12.632508+0000","last_unstale":"2024-04-15T00:31:30.109666+0000","last_undegraded":"2024-04-15T00:31:30.109666+0000","last_fullsized":"2024-04-15T00:31:30.109666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:07:36.246879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":385889695,"num_objects":96,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3516,"num_write_kb":390521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:55.460975+0000","last_change":"2024-04-15T00:21:08.600430+0000","last_active":"2024-04-15T00:27:55.460975+0000","last_peered":"2024-04-15T00:27:55.460975+0000","last_clean":"2024-04-15T00:27:55.460975+0000","last_became_active":"2024-04-15T00:21:08.600142+0000","last_became_peered":"2024-04-15T00:21:08.600142+0000","last_unstale":"2024-04-15T00:27:55.460975+0000","last_undegraded":"2024-04-15T00:27:55.460975+0000","last_fullsized":"2024-04-15T00:27:55.460975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:30.470116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:55.469451+0000","last_change":"2024-04-15T00:21:07.576781+0000","last_active":"2024-04-15T00:27:55.469451+0000","last_peered":"2024-04-15T00:27:55.469451+0000","last_clean":"2024-04-15T00:27:55.469451+0000","last_became_active":"2024-04-15T00:21:07.576491+0000","last_became_peered":"2024-04-15T00:21:07.576491+0000","last_unstale":"2024-04-15T00:27:55.469451+0000","last_undegraded":"2024-04-15T00:27:55.469451+0000","last_fullsized":"2024-04-15T00:27:55.469451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:41:31.846500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'793","reported_seq":815,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.146293+0000","last_change":"2024-04-15T00:21:12.620247+0000","last_active":"2024-04-15T00:31:30.146293+0000","last_peered":"2024-04-15T00:31:30.146293+0000","last_clean":"2024-04-15T00:31:30.146293+0000","last_became_active":"2024-04-15T00:21:12.619257+0000","last_became_peered":"2024-04-15T00:21:12.619257+0000","last_unstale":"2024-04-15T00:31:30.146293+0000","last_undegraded":"2024-04-15T00:31:30.146293+0000","last_fullsized":"2024-04-15T00:31:30.146293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:44.287619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398629714,"num_objects":100,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3893,"num_write_kb":404464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'9","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:10.462737+0000","last_change":"2024-04-15T00:21:08.590732+0000","last_active":"2024-04-15T00:28:10.462737+0000","last_peered":"2024-04-15T00:28:10.462737+0000","last_clean":"2024-04-15T00:28:10.462737+0000","last_became_active":"2024-04-15T00:21:08.590450+0000","last_became_peered":"2024-04-15T00:21:08.590450+0000","last_unstale":"2024-04-15T00:28:10.462737+0000","last_undegraded":"2024-04-15T00:28:10.462737+0000","last_fullsized":"2024-04-15T00:28:10.462737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:10:24.477646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'10","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:11.445299+0000","last_change":"2024-04-15T00:21:07.566984+0000","last_active":"2024-04-15T00:28:11.445299+0000","last_peered":"2024-04-15T00:28:11.445299+0000","last_clean":"2024-04-15T00:28:11.445299+0000","last_became_active":"2024-04-15T00:21:07.566681+0000","last_became_peered":"2024-04-15T00:21:07.566681+0000","last_unstale":"2024-04-15T00:28:11.445299+0000","last_undegraded":"2024-04-15T00:28:11.445299+0000","last_fullsized":"2024-04-15T00:28:11.445299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:21:35.113136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'1080","reported_seq":1102,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.437365+0000","last_change":"2024-04-15T00:21:12.615981+0000","last_active":"2024-04-15T00:31:30.437365+0000","last_peered":"2024-04-15T00:31:30.437365+0000","last_clean":"2024-04-15T00:31:30.437365+0000","last_became_active":"2024-04-15T00:21:12.615577+0000","last_became_peered":"2024-04-15T00:21:12.615577+0000","last_unstale":"2024-04-15T00:31:30.437365+0000","last_undegraded":"2024-04-15T00:31:30.437365+0000","last_fullsized":"2024-04-15T00:31:30.437365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1080,"log_dups_size":0,"ondisk_log_size":1080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:52:14.595303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440503524,"num_objects":114,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5539,"num_write_kb":451979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:10.456403+0000","last_change":"2024-04-15T00:21:08.588266+0000","last_active":"2024-04-15T00:28:10.456403+0000","last_peered":"2024-04-15T00:28:10.456403+0000","last_clean":"2024-04-15T00:28:10.456403+0000","last_became_active":"2024-04-15T00:21:08.587962+0000","last_became_peered":"2024-04-15T00:21:08.587962+0000","last_unstale":"2024-04-15T00:28:10.456403+0000","last_undegraded":"2024-04-15T00:28:10.456403+0000","last_fullsized":"2024-04-15T00:28:10.456403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:10.456423+0000","last_change":"2024-04-15T00:21:07.573664+0000","last_active":"2024-04-15T00:28:10.456423+0000","last_peered":"2024-04-15T00:28:10.456423+0000","last_clean":"2024-04-15T00:28:10.456423+0000","last_became_active":"2024-04-15T00:21:07.573325+0000","last_became_peered":"2024-04-15T00:21:07.573325+0000","last_unstale":"2024-04-15T00:28:10.456423+0000","last_undegraded":"2024-04-15T00:28:10.456423+0000","last_fullsized":"2024-04-15T00:28:10.456423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:16:52.647503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'921","reported_seq":950,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.745387+0000","last_change":"2024-04-15T00:21:50.136384+0000","last_active":"2024-04-15T00:31:32.745387+0000","last_peered":"2024-04-15T00:31:32.745387+0000","last_clean":"2024-04-15T00:31:32.745387+0000","last_became_active":"2024-04-15T00:21:50.135899+0000","last_became_peered":"2024-04-15T00:21:50.135899+0000","last_unstale":"2024-04-15T00:31:32.745387+0000","last_undegraded":"2024-04-15T00:31:32.745387+0000","last_fullsized":"2024-04-15T00:31:32.745387+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:16:56.946948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444634187,"num_objects":110,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4674,"num_write_kb":452484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'10","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:10.462759+0000","last_change":"2024-04-15T00:21:08.593412+0000","last_active":"2024-04-15T00:28:10.462759+0000","last_peered":"2024-04-15T00:28:10.462759+0000","last_clean":"2024-04-15T00:28:10.462759+0000","last_became_active":"2024-04-15T00:21:08.593112+0000","last_became_peered":"2024-04-15T00:21:08.593112+0000","last_unstale":"2024-04-15T00:28:10.462759+0000","last_undegraded":"2024-04-15T00:28:10.462759+0000","last_fullsized":"2024-04-15T00:28:10.462759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:45.258841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:10.456433+0000","last_change":"2024-04-15T00:21:07.576800+0000","last_active":"2024-04-15T00:28:10.456433+0000","last_peered":"2024-04-15T00:28:10.456433+0000","last_clean":"2024-04-15T00:28:10.456433+0000","last_became_active":"2024-04-15T00:21:07.576501+0000","last_became_peered":"2024-04-15T00:21:07.576501+0000","last_unstale":"2024-04-15T00:28:10.456433+0000","last_undegraded":"2024-04-15T00:28:10.456433+0000","last_fullsized":"2024-04-15T00:28:10.456433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:54.810223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'976","reported_seq":998,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:33.308898+0000","last_change":"2024-04-15T00:21:12.634065+0000","last_active":"2024-04-15T00:31:33.308898+0000","last_peered":"2024-04-15T00:31:33.308898+0000","last_clean":"2024-04-15T00:31:33.308898+0000","last_became_active":"2024-04-15T00:21:12.633242+0000","last_became_peered":"2024-04-15T00:21:12.633242+0000","last_unstale":"2024-04-15T00:31:33.308898+0000","last_undegraded":"2024-04-15T00:31:33.308898+0000","last_fullsized":"2024-04-15T00:31:33.308898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":976,"log_dups_size":0,"ondisk_log_size":976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:38:32.207334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":453069136,"num_objects":118,"num_object_clones":0,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4842,"num_write_kb":461390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'10","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:51.448456+0000","last_change":"2024-04-15T00:21:49.706390+0000","last_active":"2024-04-15T00:28:51.448456+0000","last_peered":"2024-04-15T00:28:51.448456+0000","last_clean":"2024-04-15T00:28:51.448456+0000","last_became_active":"2024-04-15T00:21:49.705916+0000","last_became_peered":"2024-04-15T00:21:49.705916+0000","last_unstale":"2024-04-15T00:28:51.448456+0000","last_undegraded":"2024-04-15T00:28:51.448456+0000","last_fullsized":"2024-04-15T00:28:51.448456+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:10:24.477646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.13","version":"27'4","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:13.316890+0000","last_change":"2024-04-15T00:21:07.573340+0000","last_active":"2024-04-15T00:29:13.316890+0000","last_peered":"2024-04-15T00:29:13.316890+0000","last_clean":"2024-04-15T00:29:13.316890+0000","last_became_active":"2024-04-15T00:21:07.572749+0000","last_became_peered":"2024-04-15T00:21:07.572749+0000","last_unstale":"2024-04-15T00:29:13.316890+0000","last_undegraded":"2024-04-15T00:29:13.316890+0000","last_fullsized":"2024-04-15T00:29:13.316890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:05:06.225337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'1053","reported_seq":1075,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.353159+0000","last_change":"2024-04-15T00:21:12.632412+0000","last_active":"2024-04-15T00:31:30.353159+0000","last_peered":"2024-04-15T00:31:30.353159+0000","last_clean":"2024-04-15T00:31:30.353159+0000","last_became_active":"2024-04-15T00:21:12.631982+0000","last_became_peered":"2024-04-15T00:21:12.631982+0000","last_unstale":"2024-04-15T00:31:30.353159+0000","last_undegraded":"2024-04-15T00:31:30.353159+0000","last_fullsized":"2024-04-15T00:31:30.353159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1053,"log_dups_size":0,"ondisk_log_size":1053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:11:44.674232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402653184,"num_objects":96,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5184,"num_write_kb":413411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'9","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.464106+0000","last_change":"2024-04-15T00:21:08.582822+0000","last_active":"2024-04-15T00:28:25.464106+0000","last_peered":"2024-04-15T00:28:25.464106+0000","last_clean":"2024-04-15T00:28:25.464106+0000","last_became_active":"2024-04-15T00:21:08.582531+0000","last_became_peered":"2024-04-15T00:21:08.582531+0000","last_unstale":"2024-04-15T00:28:25.464106+0000","last_undegraded":"2024-04-15T00:28:25.464106+0000","last_fullsized":"2024-04-15T00:28:25.464106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:21:59.995077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'287","reported_seq":317,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:11.997546+0000","last_change":"2024-04-15T00:21:07.576694+0000","last_active":"2024-04-15T00:31:11.997546+0000","last_peered":"2024-04-15T00:31:11.997546+0000","last_clean":"2024-04-15T00:31:11.997546+0000","last_became_active":"2024-04-15T00:21:07.576380+0000","last_became_peered":"2024-04-15T00:21:07.576380+0000","last_unstale":"2024-04-15T00:31:11.997546+0000","last_undegraded":"2024-04-15T00:31:11.997546+0000","last_fullsized":"2024-04-15T00:31:11.997546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:36:11.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":4242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'986","reported_seq":1008,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:33.149195+0000","last_change":"2024-04-15T00:21:12.620928+0000","last_active":"2024-04-15T00:31:33.149195+0000","last_peered":"2024-04-15T00:31:33.149195+0000","last_clean":"2024-04-15T00:31:33.149195+0000","last_became_active":"2024-04-15T00:21:12.620536+0000","last_became_peered":"2024-04-15T00:21:12.620536+0000","last_unstale":"2024-04-15T00:31:33.149195+0000","last_undegraded":"2024-04-15T00:31:33.149195+0000","last_fullsized":"2024-04-15T00:31:33.149195+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":986,"log_dups_size":0,"ondisk_log_size":986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:52:14.595303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402669397,"num_objects":101,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4803,"num_write_kb":412051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:10.471091+0000","last_change":"2024-04-15T00:21:08.588132+0000","last_active":"2024-04-15T00:28:10.471091+0000","last_peered":"2024-04-15T00:28:10.471091+0000","last_clean":"2024-04-15T00:28:10.471091+0000","last_became_active":"2024-04-15T00:21:08.587383+0000","last_became_peered":"2024-04-15T00:21:08.587383+0000","last_unstale":"2024-04-15T00:28:10.471091+0000","last_undegraded":"2024-04-15T00:28:10.471091+0000","last_fullsized":"2024-04-15T00:28:10.471091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:15.446273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'21","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:13.316687+0000","last_change":"2024-04-15T00:21:07.574695+0000","last_active":"2024-04-15T00:29:13.316687+0000","last_peered":"2024-04-15T00:29:13.316687+0000","last_clean":"2024-04-15T00:29:13.316687+0000","last_became_active":"2024-04-15T00:21:07.574389+0000","last_became_peered":"2024-04-15T00:21:07.574389+0000","last_unstale":"2024-04-15T00:29:13.316687+0000","last_undegraded":"2024-04-15T00:29:13.316687+0000","last_fullsized":"2024-04-15T00:29:13.316687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:34:26.325595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'1044","reported_seq":1066,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.256686+0000","last_change":"2024-04-15T00:21:12.620255+0000","last_active":"2024-04-15T00:31:30.256686+0000","last_peered":"2024-04-15T00:31:30.256686+0000","last_clean":"2024-04-15T00:31:30.256686+0000","last_became_active":"2024-04-15T00:21:12.619218+0000","last_became_peered":"2024-04-15T00:21:12.619218+0000","last_unstale":"2024-04-15T00:31:30.256686+0000","last_undegraded":"2024-04-15T00:31:30.256686+0000","last_fullsized":"2024-04-15T00:31:30.256686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1044,"log_dups_size":0,"ondisk_log_size":1044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:49.295552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423735680,"num_objects":112,"num_object_clones":0,"num_object_copies":448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5284,"num_write_kb":434520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'9","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:26.453674+0000","last_change":"2024-04-15T00:21:08.597898+0000","last_active":"2024-04-15T00:28:26.453674+0000","last_peered":"2024-04-15T00:28:26.453674+0000","last_clean":"2024-04-15T00:28:26.453674+0000","last_became_active":"2024-04-15T00:21:08.597262+0000","last_became_peered":"2024-04-15T00:21:08.597262+0000","last_unstale":"2024-04-15T00:28:26.453674+0000","last_undegraded":"2024-04-15T00:28:26.453674+0000","last_fullsized":"2024-04-15T00:28:26.453674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.457852+0000","last_change":"2024-04-15T00:21:07.574003+0000","last_active":"2024-04-15T00:28:25.457852+0000","last_peered":"2024-04-15T00:28:25.457852+0000","last_clean":"2024-04-15T00:28:25.457852+0000","last_became_active":"2024-04-15T00:21:07.573469+0000","last_became_peered":"2024-04-15T00:21:07.573469+0000","last_unstale":"2024-04-15T00:28:25.457852+0000","last_undegraded":"2024-04-15T00:28:25.457852+0000","last_fullsized":"2024-04-15T00:28:25.457852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:16:52.647503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'945","reported_seq":967,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.343735+0000","last_change":"2024-04-15T00:21:12.624850+0000","last_active":"2024-04-15T00:31:32.343735+0000","last_peered":"2024-04-15T00:31:32.343735+0000","last_clean":"2024-04-15T00:31:32.343735+0000","last_became_active":"2024-04-15T00:21:12.624484+0000","last_became_peered":"2024-04-15T00:21:12.624484+0000","last_unstale":"2024-04-15T00:31:32.343735+0000","last_undegraded":"2024-04-15T00:31:32.343735+0000","last_fullsized":"2024-04-15T00:31:32.343735+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":945,"log_dups_size":0,"ondisk_log_size":945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:15:08.738300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402666169,"num_objects":101,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4734,"num_write_kb":411824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.457835+0000","last_change":"2024-04-15T00:21:08.591705+0000","last_active":"2024-04-15T00:28:25.457835+0000","last_peered":"2024-04-15T00:28:25.457835+0000","last_clean":"2024-04-15T00:28:25.457835+0000","last_became_active":"2024-04-15T00:21:08.591407+0000","last_became_peered":"2024-04-15T00:21:08.591407+0000","last_unstale":"2024-04-15T00:28:25.457835+0000","last_undegraded":"2024-04-15T00:28:25.457835+0000","last_fullsized":"2024-04-15T00:28:25.457835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.457818+0000","last_change":"2024-04-15T00:21:07.574971+0000","last_active":"2024-04-15T00:28:25.457818+0000","last_peered":"2024-04-15T00:28:25.457818+0000","last_clean":"2024-04-15T00:28:25.457818+0000","last_became_active":"2024-04-15T00:21:07.574656+0000","last_became_peered":"2024-04-15T00:21:07.574656+0000","last_unstale":"2024-04-15T00:28:25.457818+0000","last_undegraded":"2024-04-15T00:28:25.457818+0000","last_fullsized":"2024-04-15T00:28:25.457818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:21:35.113136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'741","reported_seq":763,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.711934+0000","last_change":"2024-04-15T00:21:12.633646+0000","last_active":"2024-04-15T00:31:32.711934+0000","last_peered":"2024-04-15T00:31:32.711934+0000","last_clean":"2024-04-15T00:31:32.711934+0000","last_became_active":"2024-04-15T00:21:12.633262+0000","last_became_peered":"2024-04-15T00:21:12.633262+0000","last_unstale":"2024-04-15T00:31:32.711934+0000","last_undegraded":"2024-04-15T00:31:32.711934+0000","last_fullsized":"2024-04-15T00:31:32.711934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:26:17.136974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":419466538,"num_objects":105,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3547,"num_write_kb":423381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'1101","reported_seq":1124,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.423734+0000","last_change":"2024-04-15T00:21:12.634552+0000","last_active":"2024-04-15T00:31:30.423734+0000","last_peered":"2024-04-15T00:31:30.423734+0000","last_clean":"2024-04-15T00:31:30.423734+0000","last_became_active":"2024-04-15T00:21:12.633824+0000","last_became_peered":"2024-04-15T00:21:12.633824+0000","last_unstale":"2024-04-15T00:31:30.423734+0000","last_undegraded":"2024-04-15T00:31:30.423734+0000","last_fullsized":"2024-04-15T00:31:30.423734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1101,"log_dups_size":0,"ondisk_log_size":1101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:34.506827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482370782,"num_objects":121,"num_object_clones":0,"num_object_copies":484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5837,"num_write_kb":494050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.460010+0000","last_change":"2024-04-15T00:21:08.577988+0000","last_active":"2024-04-15T00:28:25.460010+0000","last_peered":"2024-04-15T00:28:25.460010+0000","last_clean":"2024-04-15T00:28:25.460010+0000","last_became_active":"2024-04-15T00:21:08.577692+0000","last_became_peered":"2024-04-15T00:21:08.577692+0000","last_unstale":"2024-04-15T00:28:25.460010+0000","last_undegraded":"2024-04-15T00:28:25.460010+0000","last_fullsized":"2024-04-15T00:28:25.460010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.457793+0000","last_change":"2024-04-15T00:21:07.563155+0000","last_active":"2024-04-15T00:28:25.457793+0000","last_peered":"2024-04-15T00:28:25.457793+0000","last_clean":"2024-04-15T00:28:25.457793+0000","last_became_active":"2024-04-15T00:21:07.562747+0000","last_became_peered":"2024-04-15T00:21:07.562747+0000","last_unstale":"2024-04-15T00:28:25.457793+0000","last_undegraded":"2024-04-15T00:28:25.457793+0000","last_fullsized":"2024-04-15T00:28:25.457793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:21:35.113136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'958","reported_seq":981,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.212363+0000","last_change":"2024-04-15T00:21:12.624627+0000","last_active":"2024-04-15T00:31:30.212363+0000","last_peered":"2024-04-15T00:31:30.212363+0000","last_clean":"2024-04-15T00:31:30.212363+0000","last_became_active":"2024-04-15T00:21:12.624245+0000","last_became_peered":"2024-04-15T00:21:12.624245+0000","last_unstale":"2024-04-15T00:31:30.212363+0000","last_undegraded":"2024-04-15T00:31:30.212363+0000","last_fullsized":"2024-04-15T00:31:30.212363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":958,"log_dups_size":0,"ondisk_log_size":958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:31.463828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432096512,"num_objects":111,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4784,"num_write_kb":440700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'14","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:26.450736+0000","last_change":"2024-04-15T00:21:08.590595+0000","last_active":"2024-04-15T00:28:26.450736+0000","last_peered":"2024-04-15T00:28:26.450736+0000","last_clean":"2024-04-15T00:28:26.450736+0000","last_became_active":"2024-04-15T00:21:08.590333+0000","last_became_peered":"2024-04-15T00:21:08.590333+0000","last_unstale":"2024-04-15T00:28:26.450736+0000","last_undegraded":"2024-04-15T00:28:26.450736+0000","last_fullsized":"2024-04-15T00:28:26.450736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:26.450774+0000","last_change":"2024-04-15T00:21:07.576399+0000","last_active":"2024-04-15T00:28:26.450774+0000","last_peered":"2024-04-15T00:28:26.450774+0000","last_clean":"2024-04-15T00:28:26.450774+0000","last_became_active":"2024-04-15T00:21:07.576008+0000","last_became_peered":"2024-04-15T00:21:07.576008+0000","last_unstale":"2024-04-15T00:28:26.450774+0000","last_undegraded":"2024-04-15T00:28:26.450774+0000","last_fullsized":"2024-04-15T00:28:26.450774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:16:52.647503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:40.459371+0000","last_change":"2024-04-15T00:21:07.572597+0000","last_active":"2024-04-15T00:28:40.459371+0000","last_peered":"2024-04-15T00:28:40.459371+0000","last_clean":"2024-04-15T00:28:40.459371+0000","last_became_active":"2024-04-15T00:21:07.572273+0000","last_became_peered":"2024-04-15T00:21:07.572273+0000","last_unstale":"2024-04-15T00:28:40.459371+0000","last_undegraded":"2024-04-15T00:28:40.459371+0000","last_fullsized":"2024-04-15T00:28:40.459371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'8","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:41.454818+0000","last_change":"2024-04-15T00:21:08.587210+0000","last_active":"2024-04-15T00:28:41.454818+0000","last_peered":"2024-04-15T00:28:41.454818+0000","last_clean":"2024-04-15T00:28:41.454818+0000","last_became_active":"2024-04-15T00:21:08.586910+0000","last_became_peered":"2024-04-15T00:21:08.586910+0000","last_unstale":"2024-04-15T00:28:41.454818+0000","last_undegraded":"2024-04-15T00:28:41.454818+0000","last_fullsized":"2024-04-15T00:28:41.454818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'803","reported_seq":825,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.280770+0000","last_change":"2024-04-15T00:21:12.622128+0000","last_active":"2024-04-15T00:31:30.280770+0000","last_peered":"2024-04-15T00:31:30.280770+0000","last_clean":"2024-04-15T00:31:30.280770+0000","last_became_active":"2024-04-15T00:21:12.621682+0000","last_became_peered":"2024-04-15T00:21:12.621682+0000","last_unstale":"2024-04-15T00:31:30.280770+0000","last_undegraded":"2024-04-15T00:31:30.280770+0000","last_fullsized":"2024-04-15T00:31:30.280770+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":803,"log_dups_size":0,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:03:00.366139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":339750667,"num_objects":83,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4004,"num_write_kb":347535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'636","reported_seq":666,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:13.317066+0000","last_change":"2024-04-15T00:21:07.577069+0000","last_active":"2024-04-15T00:29:13.317066+0000","last_peered":"2024-04-15T00:29:13.317066+0000","last_clean":"2024-04-15T00:29:13.317066+0000","last_became_active":"2024-04-15T00:21:07.576791+0000","last_became_peered":"2024-04-15T00:21:07.576791+0000","last_unstale":"2024-04-15T00:29:13.317066+0000","last_undegraded":"2024-04-15T00:29:13.317066+0000","last_fullsized":"2024-04-15T00:29:13.317066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:36:11.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":636,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'9","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:40.474199+0000","last_change":"2024-04-15T00:21:08.584214+0000","last_active":"2024-04-15T00:28:40.474199+0000","last_peered":"2024-04-15T00:28:40.474199+0000","last_clean":"2024-04-15T00:28:40.474199+0000","last_became_active":"2024-04-15T00:21:08.583909+0000","last_became_peered":"2024-04-15T00:21:08.583909+0000","last_unstale":"2024-04-15T00:28:40.474199+0000","last_undegraded":"2024-04-15T00:28:40.474199+0000","last_fullsized":"2024-04-15T00:28:40.474199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:55.815311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'1057","reported_seq":1079,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.450905+0000","last_change":"2024-04-15T00:21:12.624156+0000","last_active":"2024-04-15T00:31:32.450905+0000","last_peered":"2024-04-15T00:31:32.450905+0000","last_clean":"2024-04-15T00:31:32.450905+0000","last_became_active":"2024-04-15T00:21:12.623756+0000","last_became_peered":"2024-04-15T00:21:12.623756+0000","last_unstale":"2024-04-15T00:31:32.450905+0000","last_undegraded":"2024-04-15T00:31:32.450905+0000","last_fullsized":"2024-04-15T00:31:32.450905+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1057,"log_dups_size":0,"ondisk_log_size":1057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:31:33.202296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":461404378,"num_objects":118,"num_object_clones":0,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5333,"num_write_kb":471487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'7","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.464489+0000","last_change":"2024-04-15T00:21:08.588647+0000","last_active":"2024-04-15T00:29:30.464489+0000","last_peered":"2024-04-15T00:29:30.464489+0000","last_clean":"2024-04-15T00:29:30.464489+0000","last_became_active":"2024-04-15T00:21:08.587719+0000","last_became_peered":"2024-04-15T00:21:08.587719+0000","last_unstale":"2024-04-15T00:29:30.464489+0000","last_undegraded":"2024-04-15T00:29:30.464489+0000","last_fullsized":"2024-04-15T00:29:30.464489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:39.454082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'11","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:31.451411+0000","last_change":"2024-04-15T00:21:08.596094+0000","last_active":"2024-04-15T00:29:31.451411+0000","last_peered":"2024-04-15T00:29:31.451411+0000","last_clean":"2024-04-15T00:29:31.451411+0000","last_became_active":"2024-04-15T00:21:08.595790+0000","last_became_peered":"2024-04-15T00:21:08.595790+0000","last_unstale":"2024-04-15T00:29:31.451411+0000","last_undegraded":"2024-04-15T00:29:31.451411+0000","last_fullsized":"2024-04-15T00:29:31.451411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:15.446273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'9","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.464509+0000","last_change":"2024-04-15T00:21:08.583148+0000","last_active":"2024-04-15T00:29:30.464509+0000","last_peered":"2024-04-15T00:29:30.464509+0000","last_clean":"2024-04-15T00:29:30.464509+0000","last_became_active":"2024-04-15T00:21:08.582801+0000","last_became_peered":"2024-04-15T00:21:08.582801+0000","last_unstale":"2024-04-15T00:29:30.464509+0000","last_undegraded":"2024-04-15T00:29:30.464509+0000","last_fullsized":"2024-04-15T00:29:30.464509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:01.007313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'9","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:31.459060+0000","last_change":"2024-04-15T00:21:08.596406+0000","last_active":"2024-04-15T00:29:31.459060+0000","last_peered":"2024-04-15T00:29:31.459060+0000","last_clean":"2024-04-15T00:29:31.459060+0000","last_became_active":"2024-04-15T00:21:08.596144+0000","last_became_peered":"2024-04-15T00:21:08.596144+0000","last_unstale":"2024-04-15T00:29:31.459060+0000","last_undegraded":"2024-04-15T00:29:31.459060+0000","last_fullsized":"2024-04-15T00:29:31.459060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:41.447119+0000","last_change":"2024-04-15T00:21:08.591959+0000","last_active":"2024-04-15T00:27:41.447119+0000","last_peered":"2024-04-15T00:27:41.447119+0000","last_clean":"2024-04-15T00:27:41.447119+0000","last_became_active":"2024-04-15T00:21:08.591479+0000","last_became_peered":"2024-04-15T00:21:08.591479+0000","last_unstale":"2024-04-15T00:27:41.447119+0000","last_undegraded":"2024-04-15T00:27:41.447119+0000","last_fullsized":"2024-04-15T00:27:41.447119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:40.456524+0000","last_change":"2024-04-15T00:21:08.577658+0000","last_active":"2024-04-15T00:27:40.456524+0000","last_peered":"2024-04-15T00:27:40.456524+0000","last_clean":"2024-04-15T00:27:40.456524+0000","last_became_active":"2024-04-15T00:21:08.577358+0000","last_became_peered":"2024-04-15T00:21:08.577358+0000","last_unstale":"2024-04-15T00:27:40.456524+0000","last_undegraded":"2024-04-15T00:27:40.456524+0000","last_fullsized":"2024-04-15T00:27:40.456524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:40.453104+0000","last_change":"2024-04-15T00:21:08.593462+0000","last_active":"2024-04-15T00:27:40.453104+0000","last_peered":"2024-04-15T00:27:40.453104+0000","last_clean":"2024-04-15T00:27:40.453104+0000","last_became_active":"2024-04-15T00:21:08.593174+0000","last_became_peered":"2024-04-15T00:21:08.593174+0000","last_unstale":"2024-04-15T00:27:40.453104+0000","last_undegraded":"2024-04-15T00:27:40.453104+0000","last_fullsized":"2024-04-15T00:27:40.453104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:41.447142+0000","last_change":"2024-04-15T00:21:08.582109+0000","last_active":"2024-04-15T00:27:41.447142+0000","last_peered":"2024-04-15T00:27:41.447142+0000","last_clean":"2024-04-15T00:27:41.447142+0000","last_became_active":"2024-04-15T00:21:08.581828+0000","last_became_peered":"2024-04-15T00:21:08.581828+0000","last_unstale":"2024-04-15T00:27:41.447142+0000","last_undegraded":"2024-04-15T00:27:41.447142+0000","last_fullsized":"2024-04-15T00:27:41.447142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:01.007313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:40.453055+0000","last_change":"2024-04-15T00:21:08.582329+0000","last_active":"2024-04-15T00:27:40.453055+0000","last_peered":"2024-04-15T00:27:40.453055+0000","last_clean":"2024-04-15T00:27:40.453055+0000","last_became_active":"2024-04-15T00:21:08.582011+0000","last_became_peered":"2024-04-15T00:21:08.582011+0000","last_unstale":"2024-04-15T00:27:40.453055+0000","last_undegraded":"2024-04-15T00:27:40.453055+0000","last_fullsized":"2024-04-15T00:27:40.453055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'10","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:56.448358+0000","last_change":"2024-04-15T00:21:08.581215+0000","last_active":"2024-04-15T00:27:56.448358+0000","last_peered":"2024-04-15T00:27:56.448358+0000","last_clean":"2024-04-15T00:27:56.448358+0000","last_became_active":"2024-04-15T00:21:08.579860+0000","last_became_peered":"2024-04-15T00:21:08.579860+0000","last_unstale":"2024-04-15T00:27:56.448358+0000","last_undegraded":"2024-04-15T00:27:56.448358+0000","last_fullsized":"2024-04-15T00:27:56.448358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'8","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:55.454850+0000","last_change":"2024-04-15T00:21:08.592785+0000","last_active":"2024-04-15T00:27:55.454850+0000","last_peered":"2024-04-15T00:27:55.454850+0000","last_clean":"2024-04-15T00:27:55.454850+0000","last_became_active":"2024-04-15T00:21:08.592110+0000","last_became_peered":"2024-04-15T00:21:08.592110+0000","last_unstale":"2024-04-15T00:27:55.454850+0000","last_undegraded":"2024-04-15T00:27:55.454850+0000","last_fullsized":"2024-04-15T00:27:55.454850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:45.258841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'10","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:56.451238+0000","last_change":"2024-04-15T00:21:08.599781+0000","last_active":"2024-04-15T00:27:56.451238+0000","last_peered":"2024-04-15T00:27:56.451238+0000","last_clean":"2024-04-15T00:27:56.451238+0000","last_became_active":"2024-04-15T00:21:08.599460+0000","last_became_peered":"2024-04-15T00:21:08.599460+0000","last_unstale":"2024-04-15T00:27:56.451238+0000","last_undegraded":"2024-04-15T00:27:56.451238+0000","last_fullsized":"2024-04-15T00:27:56.451238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:39.454082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:55.454839+0000","last_change":"2024-04-15T00:21:08.588233+0000","last_active":"2024-04-15T00:27:55.454839+0000","last_peered":"2024-04-15T00:27:55.454839+0000","last_clean":"2024-04-15T00:27:55.454839+0000","last_became_active":"2024-04-15T00:21:08.586235+0000","last_became_peered":"2024-04-15T00:21:08.586235+0000","last_unstale":"2024-04-15T00:27:55.454839+0000","last_undegraded":"2024-04-15T00:27:55.454839+0000","last_fullsized":"2024-04-15T00:27:55.454839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'10","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:55.460955+0000","last_change":"2024-04-15T00:21:08.582000+0000","last_active":"2024-04-15T00:27:55.460955+0000","last_peered":"2024-04-15T00:27:55.460955+0000","last_clean":"2024-04-15T00:27:55.460955+0000","last_became_active":"2024-04-15T00:21:08.581714+0000","last_became_peered":"2024-04-15T00:21:08.581714+0000","last_unstale":"2024-04-15T00:27:55.460955+0000","last_undegraded":"2024-04-15T00:27:55.460955+0000","last_fullsized":"2024-04-15T00:27:55.460955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:27.427117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'11","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:11.445341+0000","last_change":"2024-04-15T00:21:08.582994+0000","last_active":"2024-04-15T00:28:11.445341+0000","last_peered":"2024-04-15T00:28:11.445341+0000","last_clean":"2024-04-15T00:28:11.445341+0000","last_became_active":"2024-04-15T00:21:08.582594+0000","last_became_peered":"2024-04-15T00:21:08.582594+0000","last_unstale":"2024-04-15T00:28:11.445341+0000","last_undegraded":"2024-04-15T00:28:11.445341+0000","last_fullsized":"2024-04-15T00:28:11.445341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:26:23.617197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:10.456477+0000","last_change":"2024-04-15T00:21:08.591937+0000","last_active":"2024-04-15T00:28:10.456477+0000","last_peered":"2024-04-15T00:28:10.456477+0000","last_clean":"2024-04-15T00:28:10.456477+0000","last_became_active":"2024-04-15T00:21:08.591655+0000","last_became_peered":"2024-04-15T00:21:08.591655+0000","last_unstale":"2024-04-15T00:28:10.456477+0000","last_undegraded":"2024-04-15T00:28:10.456477+0000","last_fullsized":"2024-04-15T00:28:10.456477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:21:59.995077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'6","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:51.448433+0000","last_change":"2024-04-15T00:21:49.707724+0000","last_active":"2024-04-15T00:28:51.448433+0000","last_peered":"2024-04-15T00:28:51.448433+0000","last_clean":"2024-04-15T00:28:51.448433+0000","last_became_active":"2024-04-15T00:21:49.707397+0000","last_became_peered":"2024-04-15T00:21:49.707397+0000","last_unstale":"2024-04-15T00:28:51.448433+0000","last_undegraded":"2024-04-15T00:28:51.448433+0000","last_fullsized":"2024-04-15T00:28:51.448433+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:21:59.995077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"27'9","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:10.458822+0000","last_change":"2024-04-15T00:21:08.581452+0000","last_active":"2024-04-15T00:28:10.458822+0000","last_peered":"2024-04-15T00:28:10.458822+0000","last_clean":"2024-04-15T00:28:10.458822+0000","last_became_active":"2024-04-15T00:21:08.580967+0000","last_became_peered":"2024-04-15T00:21:08.580967+0000","last_unstale":"2024-04-15T00:28:10.458822+0000","last_undegraded":"2024-04-15T00:28:10.458822+0000","last_fullsized":"2024-04-15T00:28:10.458822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'9","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:11.452407+0000","last_change":"2024-04-15T00:21:08.587249+0000","last_active":"2024-04-15T00:28:11.452407+0000","last_peered":"2024-04-15T00:28:11.452407+0000","last_clean":"2024-04-15T00:28:11.452407+0000","last_became_active":"2024-04-15T00:21:08.586885+0000","last_became_peered":"2024-04-15T00:21:08.586885+0000","last_unstale":"2024-04-15T00:28:11.452407+0000","last_undegraded":"2024-04-15T00:28:11.452407+0000","last_fullsized":"2024-04-15T00:28:11.452407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:44:31.020890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:26.450795+0000","last_change":"2024-04-15T00:21:08.579970+0000","last_active":"2024-04-15T00:28:26.450795+0000","last_peered":"2024-04-15T00:28:26.450795+0000","last_clean":"2024-04-15T00:28:26.450795+0000","last_became_active":"2024-04-15T00:21:08.579652+0000","last_became_peered":"2024-04-15T00:21:08.579652+0000","last_unstale":"2024-04-15T00:28:26.450795+0000","last_undegraded":"2024-04-15T00:28:26.450795+0000","last_fullsized":"2024-04-15T00:28:26.450795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:10:24.477646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.472704+0000","last_change":"2024-04-15T00:21:08.588376+0000","last_active":"2024-04-15T00:28:25.472704+0000","last_peered":"2024-04-15T00:28:25.472704+0000","last_clean":"2024-04-15T00:28:25.472704+0000","last_became_active":"2024-04-15T00:21:08.587712+0000","last_became_peered":"2024-04-15T00:21:08.587712+0000","last_unstale":"2024-04-15T00:28:25.472704+0000","last_undegraded":"2024-04-15T00:28:25.472704+0000","last_fullsized":"2024-04-15T00:28:25.472704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:34:27.330682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'11","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.457788+0000","last_change":"2024-04-15T00:21:08.597204+0000","last_active":"2024-04-15T00:28:25.457788+0000","last_peered":"2024-04-15T00:28:25.457788+0000","last_clean":"2024-04-15T00:28:25.457788+0000","last_became_active":"2024-04-15T00:21:08.596862+0000","last_became_peered":"2024-04-15T00:21:08.596862+0000","last_unstale":"2024-04-15T00:28:25.457788+0000","last_undegraded":"2024-04-15T00:28:25.457788+0000","last_fullsized":"2024-04-15T00:28:25.457788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'8","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.457806+0000","last_change":"2024-04-15T00:21:08.598199+0000","last_active":"2024-04-15T00:28:25.457806+0000","last_peered":"2024-04-15T00:28:25.457806+0000","last_clean":"2024-04-15T00:28:25.457806+0000","last_became_active":"2024-04-15T00:21:08.597790+0000","last_became_peered":"2024-04-15T00:21:08.597790+0000","last_unstale":"2024-04-15T00:28:25.457806+0000","last_undegraded":"2024-04-15T00:28:25.457806+0000","last_fullsized":"2024-04-15T00:28:25.457806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'10","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.464140+0000","last_change":"2024-04-15T00:21:08.600496+0000","last_active":"2024-04-15T00:28:25.464140+0000","last_peered":"2024-04-15T00:28:25.464140+0000","last_clean":"2024-04-15T00:28:25.464140+0000","last_became_active":"2024-04-15T00:21:08.600121+0000","last_became_peered":"2024-04-15T00:21:08.600121+0000","last_unstale":"2024-04-15T00:28:25.464140+0000","last_undegraded":"2024-04-15T00:28:25.464140+0000","last_fullsized":"2024-04-15T00:28:25.464140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:11:12.071153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:41.452071+0000","last_change":"2024-04-15T00:21:08.583866+0000","last_active":"2024-04-15T00:28:41.452071+0000","last_peered":"2024-04-15T00:28:41.452071+0000","last_clean":"2024-04-15T00:28:41.452071+0000","last_became_active":"2024-04-15T00:21:08.583563+0000","last_became_peered":"2024-04-15T00:21:08.583563+0000","last_unstale":"2024-04-15T00:28:41.452071+0000","last_undegraded":"2024-04-15T00:28:41.452071+0000","last_fullsized":"2024-04-15T00:28:41.452071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:27:41.268464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:40.465745+0000","last_change":"2024-04-15T00:21:08.596983+0000","last_active":"2024-04-15T00:28:40.465745+0000","last_peered":"2024-04-15T00:28:40.465745+0000","last_clean":"2024-04-15T00:28:40.465745+0000","last_became_active":"2024-04-15T00:21:08.596640+0000","last_became_peered":"2024-04-15T00:21:08.596640+0000","last_unstale":"2024-04-15T00:28:40.465745+0000","last_undegraded":"2024-04-15T00:28:40.465745+0000","last_fullsized":"2024-04-15T00:28:40.465745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:40.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'8","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:40.459376+0000","last_change":"2024-04-15T00:21:08.593027+0000","last_active":"2024-04-15T00:28:40.459376+0000","last_peered":"2024-04-15T00:28:40.459376+0000","last_clean":"2024-04-15T00:28:40.459376+0000","last_became_active":"2024-04-15T00:21:08.592476+0000","last_became_peered":"2024-04-15T00:21:08.592476+0000","last_unstale":"2024-04-15T00:28:40.459376+0000","last_undegraded":"2024-04-15T00:28:40.459376+0000","last_fullsized":"2024-04-15T00:28:40.459376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:10:24.477646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:40.465766+0000","last_change":"2024-04-15T00:21:08.591419+0000","last_active":"2024-04-15T00:28:40.465766+0000","last_peered":"2024-04-15T00:28:40.465766+0000","last_clean":"2024-04-15T00:28:40.465766+0000","last_became_active":"2024-04-15T00:21:08.591101+0000","last_became_peered":"2024-04-15T00:21:08.591101+0000","last_unstale":"2024-04-15T00:28:40.465766+0000","last_undegraded":"2024-04-15T00:28:40.465766+0000","last_fullsized":"2024-04-15T00:28:40.465766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:52:10.558592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:10.462657+0000","last_change":"2024-04-15T00:21:08.581621+0000","last_active":"2024-04-15T00:29:10.462657+0000","last_peered":"2024-04-15T00:29:10.462657+0000","last_clean":"2024-04-15T00:29:10.462657+0000","last_became_active":"2024-04-15T00:21:08.581316+0000","last_became_peered":"2024-04-15T00:21:08.581316+0000","last_unstale":"2024-04-15T00:29:10.462657+0000","last_undegraded":"2024-04-15T00:29:10.462657+0000","last_fullsized":"2024-04-15T00:29:10.462657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:27.427117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'7","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:31.459072+0000","last_change":"2024-04-15T00:21:08.590252+0000","last_active":"2024-04-15T00:29:31.459072+0000","last_peered":"2024-04-15T00:29:31.459072+0000","last_clean":"2024-04-15T00:29:31.459072+0000","last_became_active":"2024-04-15T00:21:08.589919+0000","last_became_peered":"2024-04-15T00:21:08.589919+0000","last_unstale":"2024-04-15T00:29:31.459072+0000","last_undegraded":"2024-04-15T00:29:31.459072+0000","last_fullsized":"2024-04-15T00:29:31.459072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:46:53.537904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.465273+0000","last_change":"2024-04-15T00:21:08.588530+0000","last_active":"2024-04-15T00:29:30.465273+0000","last_peered":"2024-04-15T00:29:30.465273+0000","last_clean":"2024-04-15T00:29:30.465273+0000","last_became_active":"2024-04-15T00:21:08.588208+0000","last_became_peered":"2024-04-15T00:21:08.588208+0000","last_unstale":"2024-04-15T00:29:30.465273+0000","last_undegraded":"2024-04-15T00:29:30.465273+0000","last_fullsized":"2024-04-15T00:29:30.465273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:08.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'5","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.470890+0000","last_change":"2024-04-15T00:21:08.588469+0000","last_active":"2024-04-15T00:29:30.470890+0000","last_peered":"2024-04-15T00:29:30.470890+0000","last_clean":"2024-04-15T00:29:30.470890+0000","last_became_active":"2024-04-15T00:21:08.587646+0000","last_became_peered":"2024-04-15T00:21:08.587646+0000","last_unstale":"2024-04-15T00:29:30.470890+0000","last_undegraded":"2024-04-15T00:29:30.470890+0000","last_fullsized":"2024-04-15T00:29:30.470890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:52:27.105666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":13424233995,"num_objects":3390,"num_object_clones":0,"num_object_copies":13560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3390,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148702,"num_write_kb":13691509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26850476032,"data_stored":26850476032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29948,"ondisk_log_size":29948,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":453,"ondisk_log_size":453,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":11389277,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":36,"num_read_kb":72,"num_write":2536,"num_write_kb":11908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":22839296,"data_stored":22778554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2200,"ondisk_log_size":2200,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542276,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4663072,"kb_used_data":4365464,"kb_used_omap":1,"kb_used_meta":297598,"kb_avail":89708768,"statfs":{"total":96636764160,"available":91861778432,"internally_reserved":0,"allocated":4470235136,"data_stored":4470056729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":304740807},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542276,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2797748,"kb_used_data":2626412,"kb_used_omap":1,"kb_used_meta":171326,"kb_avail":91574092,"statfs":{"total":96636764160,"available":93771870208,"internally_reserved":0,"allocated":2689445888,"data_stored":2689275001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":175438277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542276,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3076828,"kb_used_data":2887444,"kb_used_omap":1,"kb_used_meta":189374,"kb_avail":91295012,"statfs":{"total":96636764160,"available":93486092288,"internally_reserved":0,"allocated":2956742656,"data_stored":2956558926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":193919429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574981,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3118448,"kb_used_data":2920744,"kb_used_omap":1,"kb_used_meta":197694,"kb_avail":91253392,"statfs":{"total":96636764160,"available":93443473408,"internally_reserved":0,"allocated":2990841856,"data_stored":2990665452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":202439114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574981,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3681748,"kb_used_data":3443788,"kb_used_omap":1,"kb_used_meta":237950,"kb_avail":90690092,"statfs":{"total":96636764160,"available":92866654208,"internally_reserved":0,"allocated":3526438912,"data_stored":3526262864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":243661254},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574980,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2562512,"kb_used_data":2382856,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":91809328,"statfs":{"total":96636764160,"available":94012751872,"internally_reserved":0,"allocated":2440044544,"data_stored":2439872010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574980,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3506600,"kb_used_data":3268640,"kb_used_omap":1,"kb_used_meta":237950,"kb_avail":90865240,"statfs":{"total":96636764160,"available":93046005760,"internally_reserved":0,"allocated":3347087360,"data_stored":3346905860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243661253},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574980,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4647724,"kb_used_data":4351524,"kb_used_omap":1,"kb_used_meta":296190,"kb_avail":89724116,"statfs":{"total":96636764160,"available":91877494784,"internally_reserved":0,"allocated":4455960576,"data_stored":4455784016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":303299014},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,1,2,1,5,2,14,12,20,45,35,61,65],"upper_bound":8192},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":50889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8450048,"data_stored":8440169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2961408,"data_stored":2948436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7147520,"data_stored":7143196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2955849728,"data_stored":2955849728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4455665664,"data_stored":4455665664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2689105920,"data_stored":2689105920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4461498368,"data_stored":4461498368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3343839232,"data_stored":3343839232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2439753728,"data_stored":2439753728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3521949696,"data_stored":3521949696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2982813696,"data_stored":2982813696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T00:31:42.103 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T00:31:42.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.232+0000 7fe3c3b55640 1 Processor -- start 2024-04-15T00:31:42.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.233+0000 7fe3c3b55640 1 -- start start 2024-04-15T00:31:42.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.233+0000 7fe3c3b55640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe3bc0b80d0 0x7fe3bc072570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:42.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.233+0000 7fe3c3b55640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe3bc0b8be0 0x7fe3bc14adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:42.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.233+0000 7fe3c3b55640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3bc072c90 con 0x7fe3bc14b2f0 2024-04-15T00:31:42.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.233+0000 7fe3c3b55640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fe3bc09c0e0 con 0x7fe3bc0b8be0 2024-04-15T00:31:42.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.233+0000 7fe3c3b55640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe3bc0b84b0 con 0x7fe3bc0b80d0 2024-04-15T00:31:42.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.233+0000 7fe3c10f0640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe3bc0b8be0 0x7fe3bc14adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:42.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.233+0000 7fe3c10f0640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe3bc0b8be0 0x7fe3bc14adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59252/0 (socket says 172.21.15.31:59252) 2024-04-15T00:31:42.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.233+0000 7fe3c10f0640 1 -- 172.21.15.31:0/4201076718 learned_addr learned my addr 172.21.15.31:0/4201076718 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:42.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.234+0000 7fe3c18f1640 1 --2- 172.21.15.31:0/4201076718 >> v2:172.21.15.50:3300/0 conn(0x7fe3bc0b80d0 0x7fe3bc072570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:42.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.234+0000 7fe3c10f0640 1 -- 172.21.15.31:0/4201076718 >> v2:172.21.15.50:3300/0 conn(0x7fe3bc0b80d0 msgr2=0x7fe3bc072570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:42.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.234+0000 7fe3c10f0640 1 --2- 172.21.15.31:0/4201076718 >> v2:172.21.15.50:3300/0 conn(0x7fe3bc0b80d0 0x7fe3bc072570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:42.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.234+0000 7fe3c10f0640 1 -- 172.21.15.31:0/4201076718 >> v1:172.21.15.50:6789/0 conn(0x7fe3bc14b2f0 legacy=0x7fe3bc1449c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:42.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.234+0000 7fe3c10f0640 1 -- 172.21.15.31:0/4201076718 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3bc14b740 con 0x7fe3bc0b8be0 2024-04-15T00:31:42.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.234+0000 7fe3c10f0640 1 --2- 172.21.15.31:0/4201076718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3bc0b8be0 0x7fe3bc14adb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc072ee0 tx=0x7fe3ac02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac8885a5bc12a91 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:42.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.235+0000 7fe3c08ef640 1 -- 172.21.15.31:0/4201076718 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac02e070 con 0x7fe3bc0b8be0 2024-04-15T00:31:42.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.235+0000 7fe3c08ef640 1 -- 172.21.15.31:0/4201076718 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3ac037070 con 0x7fe3bc0b8be0 2024-04-15T00:31:42.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.235+0000 7fe3c08ef640 1 -- 172.21.15.31:0/4201076718 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac031a00 con 0x7fe3bc0b8be0 2024-04-15T00:31:42.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.235+0000 7fe3c3b55640 1 -- 172.21.15.31:0/4201076718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3bc0b8be0 msgr2=0x7fe3bc14adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:42.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.235+0000 7fe3c3b55640 1 --2- 172.21.15.31:0/4201076718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3bc0b8be0 0x7fe3bc14adb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc072ee0 tx=0x7fe3ac02b880 comp rx=0 tx=0).stop 2024-04-15T00:31:42.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.235+0000 7fe3c3b55640 1 -- 172.21.15.31:0/4201076718 shutdown_connections 2024-04-15T00:31:42.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.235+0000 7fe3c3b55640 1 --2- 172.21.15.31:0/4201076718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3bc0b8be0 0x7fe3bc14adb0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:42.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.235+0000 7fe3c3b55640 1 --2- 172.21.15.31:0/4201076718 >> v2:172.21.15.50:3300/0 conn(0x7fe3bc0b80d0 0x7fe3bc072570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:42.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.235+0000 7fe3c3b55640 1 -- 172.21.15.31:0/4201076718 >> 172.21.15.31:0/4201076718 conn(0x7fe3bc0bd020 msgr2=0x7fe3bc0bd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:42.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.235+0000 7fe3c3b55640 1 -- 172.21.15.31:0/4201076718 shutdown_connections 2024-04-15T00:31:42.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.235+0000 7fe3c3b55640 1 -- 172.21.15.31:0/4201076718 wait complete. 2024-04-15T00:31:42.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.236+0000 7fe3c3b55640 1 Processor -- start 2024-04-15T00:31:42.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.236+0000 7fe3c3b55640 1 -- start start 2024-04-15T00:31:42.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.237+0000 7fe3c3b55640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe3bc0b80d0 0x7fe3bc1e06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:42.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.237+0000 7fe3c3b55640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3bc0b8be0 0x7fe3bc1e0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:42.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.237+0000 7fe3c3b55640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3bc14b2f0 0x7fe3bc1dcef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:42.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.237+0000 7fe3c3b55640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc1450d0 con 0x7fe3bc0b8be0 2024-04-15T00:31:42.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.237+0000 7fe3c3b55640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc0b9620 con 0x7fe3bc14b2f0 2024-04-15T00:31:42.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.237+0000 7fe3c3b55640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fe3bc145250 con 0x7fe3bc0b80d0 2024-04-15T00:31:42.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.237+0000 7fe3c10f0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3bc0b8be0 0x7fe3bc1e0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:42.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.237+0000 7fe3c10f0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3bc0b8be0 0x7fe3bc1e0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59256/0 (socket says 172.21.15.31:59256) 2024-04-15T00:31:42.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.237+0000 7fe3c10f0640 1 -- 172.21.15.31:0/103125299 learned_addr learned my addr 172.21.15.31:0/103125299 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:42.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.237+0000 7fe3c20f2640 1 --2- 172.21.15.31:0/103125299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3bc14b2f0 0x7fe3bc1dcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:42.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.237+0000 7fe3c18f1640 1 --2- 172.21.15.31:0/103125299 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe3bc0b80d0 0x7fe3bc1e06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:42.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.237+0000 7fe3c10f0640 1 -- 172.21.15.31:0/103125299 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe3bc0b80d0 msgr2=0x7fe3bc1e06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:42.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.237+0000 7fe3c10f0640 1 --2- 172.21.15.31:0/103125299 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe3bc0b80d0 0x7fe3bc1e06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:42.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.237+0000 7fe3c10f0640 1 -- 172.21.15.31:0/103125299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3bc14b2f0 msgr2=0x7fe3bc1dcef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:42.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.237+0000 7fe3c10f0640 1 --2- 172.21.15.31:0/103125299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3bc14b2f0 0x7fe3bc1dcef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:42.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.237+0000 7fe3c10f0640 1 -- 172.21.15.31:0/103125299 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3bc0b09e0 con 0x7fe3bc0b8be0 2024-04-15T00:31:42.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.237+0000 7fe3c18f1640 1 --2- 172.21.15.31:0/103125299 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe3bc0b80d0 0x7fe3bc1e06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:31:42.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.237+0000 7fe3c10f0640 1 --2- 172.21.15.31:0/103125299 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3bc0b8be0 0x7fe3bc1e0ee0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac000c00 tx=0x7fe3ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:42.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.238+0000 7fe3b27fc640 1 -- 172.21.15.31:0/103125299 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac032880 con 0x7fe3bc0b8be0 2024-04-15T00:31:42.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.238+0000 7fe3b27fc640 1 -- 172.21.15.31:0/103125299 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3ac032a40 con 0x7fe3bc0b8be0 2024-04-15T00:31:42.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.238+0000 7fe3c3b55640 1 -- 172.21.15.31:0/103125299 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3bc14ad70 con 0x7fe3bc0b8be0 2024-04-15T00:31:42.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.238+0000 7fe3b27fc640 1 -- 172.21.15.31:0/103125299 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac032e30 con 0x7fe3bc0b8be0 2024-04-15T00:31:42.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.238+0000 7fe3c3b55640 1 -- 172.21.15.31:0/103125299 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3bc0b6f40 con 0x7fe3bc0b8be0 2024-04-15T00:31:42.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.239+0000 7fe3c3b55640 1 -- 172.21.15.31:0/103125299 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3bc09f730 con 0x7fe3bc0b8be0 2024-04-15T00:31:42.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.239+0000 7fe3b27fc640 1 -- 172.21.15.31:0/103125299 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fe3ac04c060 con 0x7fe3bc0b8be0 2024-04-15T00:31:42.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.239+0000 7fe3b27fc640 1 --2- 172.21.15.31:0/103125299 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe3a006b990 0x7fe3a006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:42.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.240+0000 7fe3b27fc640 1 -- 172.21.15.31:0/103125299 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fe3ac0ac690 con 0x7fe3bc0b8be0 2024-04-15T00:31:42.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.240+0000 7fe3c18f1640 1 --2- 172.21.15.31:0/103125299 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe3a006b990 0x7fe3a006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:42.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.240+0000 7fe3c18f1640 1 --2- 172.21.15.31:0/103125299 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe3a006b990 0x7fe3a006de50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8006fd0 tx=0x7fe3b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:42.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.244+0000 7fe3b27fc640 1 -- 172.21.15.31:0/103125299 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe3ac040070 con 0x7fe3bc0b8be0 2024-04-15T00:31:42.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.422+0000 7fe3c3b55640 1 -- 172.21.15.31:0/103125299 --> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe3bc068760 con 0x7fe3a006b990 2024-04-15T00:31:42.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.430+0000 7fe3b27fc640 1 -- 172.21.15.31:0/103125299 <== mgr.4107 v2:172.21.15.31:6832/915470279 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334303 (secure 0 0 0) 0x7fe3bc068760 con 0x7fe3a006b990 2024-04-15T00:31:42.442 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:31:42.443 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-15T00:31:42.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.433+0000 7fe3c3b55640 1 -- 172.21.15.31:0/103125299 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe3a006b990 msgr2=0x7fe3a006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:42.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.433+0000 7fe3c3b55640 1 --2- 172.21.15.31:0/103125299 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe3a006b990 0x7fe3a006de50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8006fd0 tx=0x7fe3b8008040 comp rx=0 tx=0).stop 2024-04-15T00:31:42.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.433+0000 7fe3c3b55640 1 -- 172.21.15.31:0/103125299 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3bc0b8be0 msgr2=0x7fe3bc1e0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:42.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.433+0000 7fe3c3b55640 1 --2- 172.21.15.31:0/103125299 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3bc0b8be0 0x7fe3bc1e0ee0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac000c00 tx=0x7fe3ac0046c0 comp rx=0 tx=0).stop 2024-04-15T00:31:42.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.433+0000 7fe3c3b55640 1 -- 172.21.15.31:0/103125299 shutdown_connections 2024-04-15T00:31:42.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.433+0000 7fe3c3b55640 1 --2- 172.21.15.31:0/103125299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3bc14b2f0 0x7fe3bc1dcef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:42.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.433+0000 7fe3c3b55640 1 --2- 172.21.15.31:0/103125299 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3bc0b8be0 0x7fe3bc1e0ee0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:42.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.433+0000 7fe3c3b55640 1 --2- 172.21.15.31:0/103125299 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe3a006b990 0x7fe3a006de50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:42.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.433+0000 7fe3c3b55640 1 --2- 172.21.15.31:0/103125299 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe3bc0b80d0 0x7fe3bc1e06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:42.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.433+0000 7fe3c3b55640 1 -- 172.21.15.31:0/103125299 >> 172.21.15.31:0/103125299 conn(0x7fe3bc0bd020 msgr2=0x7fe3bc09d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:42.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.433+0000 7fe3c3b55640 1 -- 172.21.15.31:0/103125299 shutdown_connections 2024-04-15T00:31:42.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.434+0000 7fe3c3b55640 1 -- 172.21.15.31:0/103125299 wait complete. 2024-04-15T00:31:42.453 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-04-15T00:31:40.530838+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":13436213640,"num_objects":3426,"num_object_clones":0,"num_object_copies":13632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3426,"num_whiteouts":0,"num_read":152,"num_read_kb":172,"num_write":151397,"num_write_kb":13705833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32718,"ondisk_log_size":32718,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":28054680,"kb_used_data":26246872,"kb_used_omap":12,"kb_used_meta":1807731,"kb_avail":726920040,"statfs":{"total":773094113280,"available":744366120960,"internally_reserved":0,"allocated":26876796928,"data_stored":26875380858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1851117105},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,1,2,1,5,2,14,12,20,45,35,61,65],"upper_bound":8192},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":156276,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22670,"num_write_kb":91463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003228"},"pg_stats":[{"pgid":"2.1f","version":"27'5","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:31.459095+0000","last_change":"2024-04-15T00:21:07.577313+0000","last_active":"2024-04-15T00:29:31.459095+0000","last_peered":"2024-04-15T00:29:31.459095+0000","last_clean":"2024-04-15T00:29:31.459095+0000","last_became_active":"2024-04-15T00:21:07.576921+0000","last_became_peered":"2024-04-15T00:21:07.576921+0000","last_unstale":"2024-04-15T00:29:31.459095+0000","last_undegraded":"2024-04-15T00:29:31.459095+0000","last_fullsized":"2024-04-15T00:29:31.459095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:41:31.846500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:11.454463+0000","last_change":"2024-04-15T00:21:08.579912+0000","last_active":"2024-04-15T00:29:11.454463+0000","last_peered":"2024-04-15T00:29:11.454463+0000","last_clean":"2024-04-15T00:29:11.454463+0000","last_became_active":"2024-04-15T00:21:08.579545+0000","last_became_peered":"2024-04-15T00:21:08.579545+0000","last_unstale":"2024-04-15T00:29:11.454463+0000","last_undegraded":"2024-04-15T00:29:11.454463+0000","last_fullsized":"2024-04-15T00:29:11.454463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'1071","reported_seq":1093,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.698383+0000","last_change":"2024-04-15T00:21:12.634366+0000","last_active":"2024-04-15T00:31:32.698383+0000","last_peered":"2024-04-15T00:31:32.698383+0000","last_clean":"2024-04-15T00:31:32.698383+0000","last_became_active":"2024-04-15T00:21:12.633323+0000","last_became_peered":"2024-04-15T00:21:12.633323+0000","last_unstale":"2024-04-15T00:31:32.698383+0000","last_undegraded":"2024-04-15T00:31:32.698383+0000","last_fullsized":"2024-04-15T00:31:32.698383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1071,"log_dups_size":0,"ondisk_log_size":1071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:26:21.575108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444643618,"num_objects":114,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5549,"num_write_kb":456057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:11.454494+0000","last_change":"2024-04-15T00:21:07.569057+0000","last_active":"2024-04-15T00:29:11.454494+0000","last_peered":"2024-04-15T00:29:11.454494+0000","last_clean":"2024-04-15T00:29:11.454494+0000","last_became_active":"2024-04-15T00:21:07.568724+0000","last_became_peered":"2024-04-15T00:21:07.568724+0000","last_unstale":"2024-04-15T00:29:11.454494+0000","last_undegraded":"2024-04-15T00:29:11.454494+0000","last_fullsized":"2024-04-15T00:29:11.454494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:21:35.113136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'6","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:31.459085+0000","last_change":"2024-04-15T00:21:08.598196+0000","last_active":"2024-04-15T00:29:31.459085+0000","last_peered":"2024-04-15T00:29:31.459085+0000","last_clean":"2024-04-15T00:29:31.459085+0000","last_became_active":"2024-04-15T00:21:08.597625+0000","last_became_peered":"2024-04-15T00:21:08.597625+0000","last_unstale":"2024-04-15T00:29:31.459085+0000","last_undegraded":"2024-04-15T00:29:31.459085+0000","last_fullsized":"2024-04-15T00:29:31.459085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'864","reported_seq":886,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.174953+0000","last_change":"2024-04-15T00:21:12.624625+0000","last_active":"2024-04-15T00:31:30.174953+0000","last_peered":"2024-04-15T00:31:30.174953+0000","last_clean":"2024-04-15T00:31:30.174953+0000","last_became_active":"2024-04-15T00:21:12.624222+0000","last_became_peered":"2024-04-15T00:21:12.624222+0000","last_unstale":"2024-04-15T00:31:30.174953+0000","last_undegraded":"2024-04-15T00:31:30.174953+0000","last_fullsized":"2024-04-15T00:31:30.174953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":864,"log_dups_size":0,"ondisk_log_size":864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:28.534842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432116108,"num_objects":108,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4130,"num_write_kb":438054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'7","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:13.937261+0000","last_change":"2024-04-15T00:21:07.576936+0000","last_active":"2024-04-15T00:29:13.937261+0000","last_peered":"2024-04-15T00:29:13.937261+0000","last_clean":"2024-04-15T00:29:13.937261+0000","last_became_active":"2024-04-15T00:21:07.576674+0000","last_became_peered":"2024-04-15T00:21:07.576674+0000","last_unstale":"2024-04-15T00:29:13.937261+0000","last_undegraded":"2024-04-15T00:29:13.937261+0000","last_fullsized":"2024-04-15T00:29:13.937261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:40.459416+0000","last_change":"2024-04-15T00:21:08.587098+0000","last_active":"2024-04-15T00:28:40.459416+0000","last_peered":"2024-04-15T00:28:40.459416+0000","last_clean":"2024-04-15T00:28:40.459416+0000","last_became_active":"2024-04-15T00:21:08.586825+0000","last_became_peered":"2024-04-15T00:21:08.586825+0000","last_unstale":"2024-04-15T00:28:40.459416+0000","last_undegraded":"2024-04-15T00:28:40.459416+0000","last_fullsized":"2024-04-15T00:28:40.459416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:30.470116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'1019","reported_seq":1041,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.357740+0000","last_change":"2024-04-15T00:21:12.619903+0000","last_active":"2024-04-15T00:31:30.357740+0000","last_peered":"2024-04-15T00:31:30.357740+0000","last_clean":"2024-04-15T00:31:30.357740+0000","last_became_active":"2024-04-15T00:21:12.619259+0000","last_became_peered":"2024-04-15T00:21:12.619259+0000","last_unstale":"2024-04-15T00:31:30.357740+0000","last_undegraded":"2024-04-15T00:31:30.357740+0000","last_fullsized":"2024-04-15T00:31:30.357740+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1019,"log_dups_size":0,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:31.463828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411101590,"num_objects":106,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4869,"num_write_kb":420502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'4","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:13.316381+0000","last_change":"2024-04-15T00:21:07.579089+0000","last_active":"2024-04-15T00:29:13.316381+0000","last_peered":"2024-04-15T00:29:13.316381+0000","last_clean":"2024-04-15T00:29:13.316381+0000","last_became_active":"2024-04-15T00:21:07.578733+0000","last_became_peered":"2024-04-15T00:21:07.578733+0000","last_unstale":"2024-04-15T00:29:13.316381+0000","last_undegraded":"2024-04-15T00:29:13.316381+0000","last_fullsized":"2024-04-15T00:29:13.316381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:44:30.015803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:40.459434+0000","last_change":"2024-04-15T00:21:08.588235+0000","last_active":"2024-04-15T00:28:40.459434+0000","last_peered":"2024-04-15T00:28:40.459434+0000","last_clean":"2024-04-15T00:28:40.459434+0000","last_became_active":"2024-04-15T00:21:08.587951+0000","last_became_peered":"2024-04-15T00:21:08.587951+0000","last_unstale":"2024-04-15T00:28:40.459434+0000","last_undegraded":"2024-04-15T00:28:40.459434+0000","last_fullsized":"2024-04-15T00:28:40.459434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:08.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'897","reported_seq":919,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.101297+0000","last_change":"2024-04-15T00:21:12.613395+0000","last_active":"2024-04-15T00:31:30.101297+0000","last_peered":"2024-04-15T00:31:30.101297+0000","last_clean":"2024-04-15T00:31:30.101297+0000","last_became_active":"2024-04-15T00:21:12.612976+0000","last_became_peered":"2024-04-15T00:21:12.612976+0000","last_unstale":"2024-04-15T00:31:30.101297+0000","last_undegraded":"2024-04-15T00:31:30.101297+0000","last_fullsized":"2024-04-15T00:31:30.101297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":897,"log_dups_size":0,"ondisk_log_size":897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:05.044024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360723173,"num_objects":88,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4357,"num_write_kb":369330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:40.453065+0000","last_change":"2024-04-15T00:21:08.585248+0000","last_active":"2024-04-15T00:27:40.453065+0000","last_peered":"2024-04-15T00:27:40.453065+0000","last_clean":"2024-04-15T00:27:40.453065+0000","last_became_active":"2024-04-15T00:21:08.584882+0000","last_became_peered":"2024-04-15T00:21:08.584882+0000","last_unstale":"2024-04-15T00:27:40.453065+0000","last_undegraded":"2024-04-15T00:27:40.453065+0000","last_fullsized":"2024-04-15T00:27:40.453065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:27:41.268464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'848","reported_seq":878,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:31.961219+0000","last_change":"2024-04-15T00:21:07.580541+0000","last_active":"2024-04-15T00:31:31.961219+0000","last_peered":"2024-04-15T00:31:31.961219+0000","last_clean":"2024-04-15T00:31:31.961219+0000","last_became_active":"2024-04-15T00:21:07.580229+0000","last_became_peered":"2024-04-15T00:21:07.580229+0000","last_unstale":"2024-04-15T00:31:31.961219+0000","last_undegraded":"2024-04-15T00:31:31.961219+0000","last_fullsized":"2024-04-15T00:31:31.961219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:34:26.325595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2948310,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":847,"num_write_kb":3058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'817","reported_seq":839,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.023590+0000","last_change":"2024-04-15T00:21:12.624175+0000","last_active":"2024-04-15T00:31:30.023590+0000","last_peered":"2024-04-15T00:31:30.023590+0000","last_clean":"2024-04-15T00:31:30.023590+0000","last_became_active":"2024-04-15T00:21:12.623783+0000","last_became_peered":"2024-04-15T00:21:12.623783+0000","last_unstale":"2024-04-15T00:31:30.023590+0000","last_undegraded":"2024-04-15T00:31:30.023590+0000","last_fullsized":"2024-04-15T00:31:30.023590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:22:04.031788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":419652210,"num_objects":107,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4013,"num_write_kb":425701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'8","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:56.448391+0000","last_change":"2024-04-15T00:21:08.594955+0000","last_active":"2024-04-15T00:27:56.448391+0000","last_peered":"2024-04-15T00:27:56.448391+0000","last_clean":"2024-04-15T00:27:56.448391+0000","last_became_active":"2024-04-15T00:21:08.594535+0000","last_became_peered":"2024-04-15T00:21:08.594535+0000","last_unstale":"2024-04-15T00:27:56.448391+0000","last_undegraded":"2024-04-15T00:27:56.448391+0000","last_fullsized":"2024-04-15T00:27:56.448391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:40.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:40.456499+0000","last_change":"2024-04-15T00:21:07.570862+0000","last_active":"2024-04-15T00:27:40.456499+0000","last_peered":"2024-04-15T00:27:40.456499+0000","last_clean":"2024-04-15T00:27:40.456499+0000","last_became_active":"2024-04-15T00:21:07.570555+0000","last_became_peered":"2024-04-15T00:21:07.570555+0000","last_unstale":"2024-04-15T00:27:40.456499+0000","last_undegraded":"2024-04-15T00:27:40.456499+0000","last_fullsized":"2024-04-15T00:27:40.456499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:54.810223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'900","reported_seq":929,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.386105+0000","last_change":"2024-04-15T00:21:50.135837+0000","last_active":"2024-04-15T00:31:30.386105+0000","last_peered":"2024-04-15T00:31:30.386105+0000","last_clean":"2024-04-15T00:31:30.386105+0000","last_became_active":"2024-04-15T00:21:50.135204+0000","last_became_peered":"2024-04-15T00:21:50.135204+0000","last_unstale":"2024-04-15T00:31:30.386105+0000","last_undegraded":"2024-04-15T00:31:30.386105+0000","last_fullsized":"2024-04-15T00:31:30.386105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:15:08.738300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423642109,"num_objects":107,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4534,"num_write_kb":431423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'8","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:41.447068+0000","last_change":"2024-04-15T00:21:08.574901+0000","last_active":"2024-04-15T00:27:41.447068+0000","last_peered":"2024-04-15T00:27:41.447068+0000","last_clean":"2024-04-15T00:27:41.447068+0000","last_became_active":"2024-04-15T00:21:08.574536+0000","last_became_peered":"2024-04-15T00:21:08.574536+0000","last_unstale":"2024-04-15T00:27:41.447068+0000","last_undegraded":"2024-04-15T00:27:41.447068+0000","last_fullsized":"2024-04-15T00:27:41.447068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:08.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:40.456476+0000","last_change":"2024-04-15T00:21:07.577048+0000","last_active":"2024-04-15T00:27:40.456476+0000","last_peered":"2024-04-15T00:27:40.456476+0000","last_clean":"2024-04-15T00:27:40.456476+0000","last_became_active":"2024-04-15T00:21:07.576739+0000","last_became_peered":"2024-04-15T00:21:07.576739+0000","last_unstale":"2024-04-15T00:27:40.456476+0000","last_undegraded":"2024-04-15T00:27:40.456476+0000","last_fullsized":"2024-04-15T00:27:40.456476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:14.441186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'1173","reported_seq":1195,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.552356+0000","last_change":"2024-04-15T00:21:12.632213+0000","last_active":"2024-04-15T00:31:32.552356+0000","last_peered":"2024-04-15T00:31:32.552356+0000","last_clean":"2024-04-15T00:31:32.552356+0000","last_became_active":"2024-04-15T00:21:12.631900+0000","last_became_peered":"2024-04-15T00:21:12.631900+0000","last_unstale":"2024-04-15T00:31:32.552356+0000","last_undegraded":"2024-04-15T00:31:32.552356+0000","last_fullsized":"2024-04-15T00:31:32.552356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1173,"log_dups_size":0,"ondisk_log_size":1173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:52:31.142377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":507526656,"num_objects":125,"num_object_clones":0,"num_object_copies":500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5839,"num_write_kb":518448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:40.467738+0000","last_change":"2024-04-15T00:21:08.590270+0000","last_active":"2024-04-15T00:27:40.467738+0000","last_peered":"2024-04-15T00:27:40.467738+0000","last_clean":"2024-04-15T00:27:40.467738+0000","last_became_active":"2024-04-15T00:21:08.589960+0000","last_became_peered":"2024-04-15T00:21:08.589960+0000","last_unstale":"2024-04-15T00:27:40.467738+0000","last_undegraded":"2024-04-15T00:27:40.467738+0000","last_fullsized":"2024-04-15T00:27:40.467738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:52.880065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:40.459480+0000","last_change":"2024-04-15T00:21:07.577518+0000","last_active":"2024-04-15T00:27:40.459480+0000","last_peered":"2024-04-15T00:27:40.459480+0000","last_clean":"2024-04-15T00:27:40.459480+0000","last_became_active":"2024-04-15T00:21:07.576961+0000","last_became_peered":"2024-04-15T00:21:07.576961+0000","last_unstale":"2024-04-15T00:27:40.459480+0000","last_undegraded":"2024-04-15T00:27:40.459480+0000","last_fullsized":"2024-04-15T00:27:40.459480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:14.441186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'743","reported_seq":772,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.215032+0000","last_change":"2024-04-15T00:21:50.136014+0000","last_active":"2024-04-15T00:31:30.215032+0000","last_peered":"2024-04-15T00:31:30.215032+0000","last_clean":"2024-04-15T00:31:30.215032+0000","last_became_active":"2024-04-15T00:21:50.135523+0000","last_became_peered":"2024-04-15T00:21:50.135523+0000","last_unstale":"2024-04-15T00:31:30.215032+0000","last_undegraded":"2024-04-15T00:31:30.215032+0000","last_fullsized":"2024-04-15T00:31:30.215032+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:29.469506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373416048,"num_objects":97,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3682,"num_write_kb":379037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'13","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:41.450054+0000","last_change":"2024-04-15T00:21:08.601349+0000","last_active":"2024-04-15T00:27:41.450054+0000","last_peered":"2024-04-15T00:27:41.450054+0000","last_clean":"2024-04-15T00:27:41.450054+0000","last_became_active":"2024-04-15T00:21:08.601048+0000","last_became_peered":"2024-04-15T00:21:08.601048+0000","last_unstale":"2024-04-15T00:27:41.450054+0000","last_undegraded":"2024-04-15T00:27:41.450054+0000","last_fullsized":"2024-04-15T00:27:41.450054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:27:41.268464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'4","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:40.453118+0000","last_change":"2024-04-15T00:21:07.577793+0000","last_active":"2024-04-15T00:27:40.453118+0000","last_peered":"2024-04-15T00:27:40.453118+0000","last_clean":"2024-04-15T00:27:40.453118+0000","last_became_active":"2024-04-15T00:21:07.577472+0000","last_became_peered":"2024-04-15T00:21:07.577472+0000","last_unstale":"2024-04-15T00:27:40.453118+0000","last_undegraded":"2024-04-15T00:27:40.453118+0000","last_fullsized":"2024-04-15T00:27:40.453118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:54.810223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'847","reported_seq":870,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.090056+0000","last_change":"2024-04-15T00:21:12.634814+0000","last_active":"2024-04-15T00:31:30.090056+0000","last_peered":"2024-04-15T00:31:30.090056+0000","last_clean":"2024-04-15T00:31:30.090056+0000","last_became_active":"2024-04-15T00:21:12.633228+0000","last_became_peered":"2024-04-15T00:21:12.633228+0000","last_unstale":"2024-04-15T00:31:30.090056+0000","last_undegraded":"2024-04-15T00:31:30.090056+0000","last_fullsized":"2024-04-15T00:31:30.090056+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:13.312501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411134922,"num_objects":101,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3991,"num_write_kb":416955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'8","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:20.459653+0000","last_change":"2024-04-15T00:21:49.708455+0000","last_active":"2024-04-15T00:28:20.459653+0000","last_peered":"2024-04-15T00:28:20.459653+0000","last_clean":"2024-04-15T00:28:20.459653+0000","last_became_active":"2024-04-15T00:21:49.708106+0000","last_became_peered":"2024-04-15T00:21:49.708106+0000","last_unstale":"2024-04-15T00:28:20.459653+0000","last_undegraded":"2024-04-15T00:28:20.459653+0000","last_fullsized":"2024-04-15T00:28:20.459653+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:04:14.156671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"27'321","reported_seq":351,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:34.662403+0000","last_change":"2024-04-15T00:21:07.573285+0000","last_active":"2024-04-15T00:31:34.662403+0000","last_peered":"2024-04-15T00:31:34.662403+0000","last_clean":"2024-04-15T00:31:34.662403+0000","last_became_active":"2024-04-15T00:21:07.572973+0000","last_became_peered":"2024-04-15T00:21:07.572973+0000","last_unstale":"2024-04-15T00:31:34.662403+0000","last_undegraded":"2024-04-15T00:31:34.662403+0000","last_fullsized":"2024-04-15T00:31:34.662403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":663,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'847","reported_seq":870,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.320976+0000","last_change":"2024-04-15T00:21:12.633602+0000","last_active":"2024-04-15T00:31:32.320976+0000","last_peered":"2024-04-15T00:31:32.320976+0000","last_clean":"2024-04-15T00:31:32.320976+0000","last_became_active":"2024-04-15T00:21:12.633178+0000","last_became_peered":"2024-04-15T00:21:12.633178+0000","last_unstale":"2024-04-15T00:31:32.320976+0000","last_undegraded":"2024-04-15T00:31:32.320976+0000","last_fullsized":"2024-04-15T00:31:32.320976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:01:48.959493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448855783,"num_objects":113,"num_object_clones":0,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4294,"num_write_kb":455043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'5","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.465238+0000","last_change":"2024-04-15T00:21:08.580727+0000","last_active":"2024-04-15T00:29:30.465238+0000","last_peered":"2024-04-15T00:29:30.465238+0000","last_clean":"2024-04-15T00:29:30.465238+0000","last_became_active":"2024-04-15T00:21:08.580418+0000","last_became_peered":"2024-04-15T00:21:08.580418+0000","last_unstale":"2024-04-15T00:29:30.465238+0000","last_undegraded":"2024-04-15T00:29:30.465238+0000","last_fullsized":"2024-04-15T00:29:30.465238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'1","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.470869+0000","last_change":"2024-04-15T00:21:07.575864+0000","last_active":"2024-04-15T00:29:30.470869+0000","last_peered":"2024-04-15T00:29:30.470869+0000","last_clean":"2024-04-15T00:29:30.470869+0000","last_became_active":"2024-04-15T00:21:07.575562+0000","last_became_peered":"2024-04-15T00:21:07.575562+0000","last_unstale":"2024-04-15T00:29:30.470869+0000","last_undegraded":"2024-04-15T00:29:30.470869+0000","last_fullsized":"2024-04-15T00:29:30.470869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:35:39.009511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'992","reported_seq":1014,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.358746+0000","last_change":"2024-04-15T00:21:12.633674+0000","last_active":"2024-04-15T00:31:30.358746+0000","last_peered":"2024-04-15T00:31:30.358746+0000","last_clean":"2024-04-15T00:31:30.358746+0000","last_became_active":"2024-04-15T00:21:12.633277+0000","last_became_peered":"2024-04-15T00:21:12.633277+0000","last_unstale":"2024-04-15T00:31:30.358746+0000","last_undegraded":"2024-04-15T00:31:30.358746+0000","last_fullsized":"2024-04-15T00:31:30.358746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":992,"log_dups_size":0,"ondisk_log_size":992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:49.295552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":382066035,"num_objects":93,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4954,"num_write_kb":392450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'6","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.464590+0000","last_change":"2024-04-15T00:21:08.578321+0000","last_active":"2024-04-15T00:29:30.464590+0000","last_peered":"2024-04-15T00:29:30.464590+0000","last_clean":"2024-04-15T00:29:30.464590+0000","last_became_active":"2024-04-15T00:21:08.578017+0000","last_became_peered":"2024-04-15T00:21:08.578017+0000","last_unstale":"2024-04-15T00:29:30.464590+0000","last_undegraded":"2024-04-15T00:29:30.464590+0000","last_fullsized":"2024-04-15T00:29:30.464590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:40.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.465258+0000","last_change":"2024-04-15T00:21:07.575183+0000","last_active":"2024-04-15T00:29:30.465258+0000","last_peered":"2024-04-15T00:29:30.465258+0000","last_clean":"2024-04-15T00:29:30.465258+0000","last_became_active":"2024-04-15T00:21:07.574822+0000","last_became_peered":"2024-04-15T00:21:07.574822+0000","last_unstale":"2024-04-15T00:29:30.465258+0000","last_undegraded":"2024-04-15T00:29:30.465258+0000","last_fullsized":"2024-04-15T00:29:30.465258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:26:22.612110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'1180","reported_seq":1202,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:33.169343+0000","last_change":"2024-04-15T00:21:12.620150+0000","last_active":"2024-04-15T00:31:33.169343+0000","last_peered":"2024-04-15T00:31:33.169343+0000","last_clean":"2024-04-15T00:31:33.169343+0000","last_became_active":"2024-04-15T00:21:12.619694+0000","last_became_peered":"2024-04-15T00:21:12.619694+0000","last_unstale":"2024-04-15T00:31:33.169343+0000","last_undegraded":"2024-04-15T00:31:33.169343+0000","last_fullsized":"2024-04-15T00:31:33.169343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1180,"log_dups_size":0,"ondisk_log_size":1180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:34.506827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474051932,"num_objects":120,"num_object_clones":0,"num_object_copies":480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":120,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5768,"num_write_kb":485640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'6","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.479223+0000","last_change":"2024-04-15T00:21:08.596959+0000","last_active":"2024-04-15T00:29:30.479223+0000","last_peered":"2024-04-15T00:29:30.479223+0000","last_clean":"2024-04-15T00:29:30.479223+0000","last_became_active":"2024-04-15T00:21:08.596678+0000","last_became_peered":"2024-04-15T00:21:08.596678+0000","last_unstale":"2024-04-15T00:29:30.479223+0000","last_undegraded":"2024-04-15T00:29:30.479223+0000","last_fullsized":"2024-04-15T00:29:30.479223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:35:40.014598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.464535+0000","last_change":"2024-04-15T00:21:07.574514+0000","last_active":"2024-04-15T00:29:30.464535+0000","last_peered":"2024-04-15T00:29:30.464535+0000","last_clean":"2024-04-15T00:29:30.464535+0000","last_became_active":"2024-04-15T00:21:07.574228+0000","last_became_peered":"2024-04-15T00:21:07.574228+0000","last_unstale":"2024-04-15T00:29:30.464535+0000","last_undegraded":"2024-04-15T00:29:30.464535+0000","last_fullsized":"2024-04-15T00:29:30.464535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'1049","reported_seq":1071,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:31.971272+0000","last_change":"2024-04-15T00:21:12.619733+0000","last_active":"2024-04-15T00:31:31.971272+0000","last_peered":"2024-04-15T00:31:31.971272+0000","last_clean":"2024-04-15T00:31:31.971272+0000","last_became_active":"2024-04-15T00:21:12.619307+0000","last_became_peered":"2024-04-15T00:21:12.619307+0000","last_unstale":"2024-04-15T00:31:31.971272+0000","last_undegraded":"2024-04-15T00:31:31.971272+0000","last_fullsized":"2024-04-15T00:31:31.971272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1049,"log_dups_size":0,"ondisk_log_size":1049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:48:00.696018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415249523,"num_objects":103,"num_object_clones":0,"num_object_copies":412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5497,"num_write_kb":427157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'10","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:10.463508+0000","last_change":"2024-04-15T00:21:08.589246+0000","last_active":"2024-04-15T00:29:10.463508+0000","last_peered":"2024-04-15T00:29:10.463508+0000","last_clean":"2024-04-15T00:29:10.463508+0000","last_became_active":"2024-04-15T00:21:08.588920+0000","last_became_peered":"2024-04-15T00:21:08.588920+0000","last_unstale":"2024-04-15T00:29:10.463508+0000","last_undegraded":"2024-04-15T00:29:10.463508+0000","last_fullsized":"2024-04-15T00:29:10.463508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'37","reported_seq":104,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:31.451426+0000","last_change":"2024-04-15T00:21:07.566537+0000","last_active":"2024-04-15T00:29:31.451426+0000","last_peered":"2024-04-15T00:29:31.451426+0000","last_clean":"2024-04-15T00:29:31.451426+0000","last_became_active":"2024-04-15T00:21:07.566240+0000","last_became_peered":"2024-04-15T00:21:07.566240+0000","last_unstale":"2024-04-15T00:29:31.451426+0000","last_undegraded":"2024-04-15T00:29:31.451426+0000","last_fullsized":"2024-04-15T00:29:31.451426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:16:52.647503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50889,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":72,"num_write":36,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'862","reported_seq":884,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.536387+0000","last_change":"2024-04-15T00:21:12.623452+0000","last_active":"2024-04-15T00:31:32.536387+0000","last_peered":"2024-04-15T00:31:32.536387+0000","last_clean":"2024-04-15T00:31:32.536387+0000","last_became_active":"2024-04-15T00:21:12.623066+0000","last_became_peered":"2024-04-15T00:21:12.623066+0000","last_unstale":"2024-04-15T00:31:32.536387+0000","last_undegraded":"2024-04-15T00:31:32.536387+0000","last_fullsized":"2024-04-15T00:31:32.536387+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:11:16.107864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":453040013,"num_objects":117,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4260,"num_write_kb":459037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:31.459038+0000","last_change":"2024-04-15T00:21:08.586376+0000","last_active":"2024-04-15T00:29:31.459038+0000","last_peered":"2024-04-15T00:29:31.459038+0000","last_clean":"2024-04-15T00:29:31.459038+0000","last_became_active":"2024-04-15T00:21:08.586054+0000","last_became_peered":"2024-04-15T00:21:08.586054+0000","last_unstale":"2024-04-15T00:29:31.459038+0000","last_undegraded":"2024-04-15T00:29:31.459038+0000","last_fullsized":"2024-04-15T00:29:31.459038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:02:56.329428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:10.468749+0000","last_change":"2024-04-15T00:21:07.577289+0000","last_active":"2024-04-15T00:29:10.468749+0000","last_peered":"2024-04-15T00:29:10.468749+0000","last_clean":"2024-04-15T00:29:10.468749+0000","last_became_active":"2024-04-15T00:21:07.576602+0000","last_became_peered":"2024-04-15T00:21:07.576602+0000","last_unstale":"2024-04-15T00:29:10.468749+0000","last_undegraded":"2024-04-15T00:29:10.468749+0000","last_fullsized":"2024-04-15T00:29:10.468749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:26:22.612110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'902","reported_seq":924,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.470317+0000","last_change":"2024-04-15T00:21:12.634248+0000","last_active":"2024-04-15T00:31:30.470317+0000","last_peered":"2024-04-15T00:31:30.470317+0000","last_clean":"2024-04-15T00:31:30.470317+0000","last_became_active":"2024-04-15T00:21:12.633239+0000","last_became_peered":"2024-04-15T00:21:12.633239+0000","last_unstale":"2024-04-15T00:31:30.470317+0000","last_undegraded":"2024-04-15T00:31:30.470317+0000","last_fullsized":"2024-04-15T00:31:30.470317+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:52:31.142377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356541982,"num_objects":92,"num_object_clones":0,"num_object_copies":368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4244,"num_write_kb":364740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'4","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:31.462298+0000","last_change":"2024-04-15T00:21:08.591060+0000","last_active":"2024-04-15T00:29:31.462298+0000","last_peered":"2024-04-15T00:29:31.462298+0000","last_clean":"2024-04-15T00:29:31.462298+0000","last_became_active":"2024-04-15T00:21:08.590781+0000","last_became_peered":"2024-04-15T00:21:08.590781+0000","last_unstale":"2024-04-15T00:29:31.462298+0000","last_undegraded":"2024-04-15T00:29:31.462298+0000","last_fullsized":"2024-04-15T00:29:31.462298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.464552+0000","last_change":"2024-04-15T00:21:07.573617+0000","last_active":"2024-04-15T00:29:30.464552+0000","last_peered":"2024-04-15T00:29:30.464552+0000","last_clean":"2024-04-15T00:29:30.464552+0000","last_became_active":"2024-04-15T00:21:07.573308+0000","last_became_peered":"2024-04-15T00:21:07.573308+0000","last_unstale":"2024-04-15T00:29:30.464552+0000","last_undegraded":"2024-04-15T00:29:30.464552+0000","last_fullsized":"2024-04-15T00:29:30.464552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:36:11.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":187,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:00.467601+0000","last_change":"2024-04-15T00:20:57.937516+0000","last_active":"2024-04-15T00:29:00.467601+0000","last_peered":"2024-04-15T00:29:00.467601+0000","last_clean":"2024-04-15T00:29:00.467601+0000","last_became_active":"2024-04-15T00:20:57.936329+0000","last_became_peered":"2024-04-15T00:20:57.936329+0000","last_unstale":"2024-04-15T00:29:00.467601+0000","last_undegraded":"2024-04-15T00:29:00.467601+0000","last_fullsized":"2024-04-15T00:29:00.467601+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:20:56.517419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:20:56.517419+0000","last_clean_scrub_stamp":"2024-04-15T00:20:56.517419+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:07:23.949459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'923","reported_seq":946,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.464035+0000","last_change":"2024-04-15T00:21:12.633530+0000","last_active":"2024-04-15T00:31:30.464035+0000","last_peered":"2024-04-15T00:31:30.464035+0000","last_clean":"2024-04-15T00:31:30.464035+0000","last_became_active":"2024-04-15T00:21:12.633124+0000","last_became_peered":"2024-04-15T00:21:12.633124+0000","last_unstale":"2024-04-15T00:31:30.464035+0000","last_undegraded":"2024-04-15T00:31:30.464035+0000","last_fullsized":"2024-04-15T00:31:30.464035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":923,"log_dups_size":0,"ondisk_log_size":923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:49.295552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406896485,"num_objects":106,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4652,"num_write_kb":415602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:55.460924+0000","last_change":"2024-04-15T00:21:08.583443+0000","last_active":"2024-04-15T00:27:55.460924+0000","last_peered":"2024-04-15T00:27:55.460924+0000","last_clean":"2024-04-15T00:27:55.460924+0000","last_became_active":"2024-04-15T00:21:08.583143+0000","last_became_peered":"2024-04-15T00:21:08.583143+0000","last_unstale":"2024-04-15T00:27:55.460924+0000","last_undegraded":"2024-04-15T00:27:55.460924+0000","last_fullsized":"2024-04-15T00:27:55.460924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:01.007313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:56.444232+0000","last_change":"2024-04-15T00:21:07.579386+0000","last_active":"2024-04-15T00:27:56.444232+0000","last_peered":"2024-04-15T00:27:56.444232+0000","last_clean":"2024-04-15T00:27:56.444232+0000","last_became_active":"2024-04-15T00:21:07.579024+0000","last_became_peered":"2024-04-15T00:21:07.579024+0000","last_unstale":"2024-04-15T00:27:56.444232+0000","last_undegraded":"2024-04-15T00:27:56.444232+0000","last_fullsized":"2024-04-15T00:27:56.444232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:36:11.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'783","reported_seq":805,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.088053+0000","last_change":"2024-04-15T00:21:12.635286+0000","last_active":"2024-04-15T00:31:30.088053+0000","last_peered":"2024-04-15T00:31:30.088053+0000","last_clean":"2024-04-15T00:31:30.088053+0000","last_became_active":"2024-04-15T00:21:12.634689+0000","last_became_peered":"2024-04-15T00:21:12.634689+0000","last_unstale":"2024-04-15T00:31:30.088053+0000","last_undegraded":"2024-04-15T00:31:30.088053+0000","last_fullsized":"2024-04-15T00:31:30.088053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:05.044024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":419485282,"num_objects":105,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3792,"num_write_kb":424412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'7","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:36.447262+0000","last_change":"2024-04-15T00:21:49.708583+0000","last_active":"2024-04-15T00:28:36.447262+0000","last_peered":"2024-04-15T00:28:36.447262+0000","last_clean":"2024-04-15T00:28:36.447262+0000","last_became_active":"2024-04-15T00:21:49.708252+0000","last_became_peered":"2024-04-15T00:21:49.708252+0000","last_unstale":"2024-04-15T00:28:36.447262+0000","last_undegraded":"2024-04-15T00:28:36.447262+0000","last_fullsized":"2024-04-15T00:28:36.447262+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:01.007313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:55.457685+0000","last_change":"2024-04-15T00:21:07.571553+0000","last_active":"2024-04-15T00:27:55.457685+0000","last_peered":"2024-04-15T00:27:55.457685+0000","last_clean":"2024-04-15T00:27:55.457685+0000","last_became_active":"2024-04-15T00:21:07.571238+0000","last_became_peered":"2024-04-15T00:21:07.571238+0000","last_unstale":"2024-04-15T00:27:55.457685+0000","last_undegraded":"2024-04-15T00:27:55.457685+0000","last_fullsized":"2024-04-15T00:27:55.457685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:35:39.009511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'910","reported_seq":932,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.379637+0000","last_change":"2024-04-15T00:21:12.619646+0000","last_active":"2024-04-15T00:31:30.379637+0000","last_peered":"2024-04-15T00:31:30.379637+0000","last_clean":"2024-04-15T00:31:30.379637+0000","last_became_active":"2024-04-15T00:21:12.619263+0000","last_became_peered":"2024-04-15T00:21:12.619263+0000","last_unstale":"2024-04-15T00:31:30.379637+0000","last_undegraded":"2024-04-15T00:31:30.379637+0000","last_fullsized":"2024-04-15T00:31:30.379637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:31.463828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394550963,"num_objects":102,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4303,"num_write_kb":402124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'8","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:55.461007+0000","last_change":"2024-04-15T00:21:08.599410+0000","last_active":"2024-04-15T00:27:55.461007+0000","last_peered":"2024-04-15T00:27:55.461007+0000","last_clean":"2024-04-15T00:27:55.461007+0000","last_became_active":"2024-04-15T00:21:08.599132+0000","last_became_peered":"2024-04-15T00:21:08.599132+0000","last_unstale":"2024-04-15T00:27:55.461007+0000","last_undegraded":"2024-04-15T00:27:55.461007+0000","last_fullsized":"2024-04-15T00:27:55.461007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:47:56.659307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'3","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:56.444256+0000","last_change":"2024-04-15T00:21:07.567917+0000","last_active":"2024-04-15T00:27:56.444256+0000","last_peered":"2024-04-15T00:27:56.444256+0000","last_clean":"2024-04-15T00:27:56.444256+0000","last_became_active":"2024-04-15T00:21:07.567673+0000","last_became_peered":"2024-04-15T00:21:07.567673+0000","last_unstale":"2024-04-15T00:27:56.444256+0000","last_undegraded":"2024-04-15T00:27:56.444256+0000","last_fullsized":"2024-04-15T00:27:56.444256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:54.810223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'711","reported_seq":733,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.109666+0000","last_change":"2024-04-15T00:21:12.632937+0000","last_active":"2024-04-15T00:31:30.109666+0000","last_peered":"2024-04-15T00:31:30.109666+0000","last_clean":"2024-04-15T00:31:30.109666+0000","last_became_active":"2024-04-15T00:21:12.632508+0000","last_became_peered":"2024-04-15T00:21:12.632508+0000","last_unstale":"2024-04-15T00:31:30.109666+0000","last_undegraded":"2024-04-15T00:31:30.109666+0000","last_fullsized":"2024-04-15T00:31:30.109666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:07:36.246879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":385889695,"num_objects":96,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3516,"num_write_kb":390521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:55.460975+0000","last_change":"2024-04-15T00:21:08.600430+0000","last_active":"2024-04-15T00:27:55.460975+0000","last_peered":"2024-04-15T00:27:55.460975+0000","last_clean":"2024-04-15T00:27:55.460975+0000","last_became_active":"2024-04-15T00:21:08.600142+0000","last_became_peered":"2024-04-15T00:21:08.600142+0000","last_unstale":"2024-04-15T00:27:55.460975+0000","last_undegraded":"2024-04-15T00:27:55.460975+0000","last_fullsized":"2024-04-15T00:27:55.460975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:30.470116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:55.469451+0000","last_change":"2024-04-15T00:21:07.576781+0000","last_active":"2024-04-15T00:27:55.469451+0000","last_peered":"2024-04-15T00:27:55.469451+0000","last_clean":"2024-04-15T00:27:55.469451+0000","last_became_active":"2024-04-15T00:21:07.576491+0000","last_became_peered":"2024-04-15T00:21:07.576491+0000","last_unstale":"2024-04-15T00:27:55.469451+0000","last_undegraded":"2024-04-15T00:27:55.469451+0000","last_fullsized":"2024-04-15T00:27:55.469451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:41:31.846500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'793","reported_seq":815,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.146293+0000","last_change":"2024-04-15T00:21:12.620247+0000","last_active":"2024-04-15T00:31:30.146293+0000","last_peered":"2024-04-15T00:31:30.146293+0000","last_clean":"2024-04-15T00:31:30.146293+0000","last_became_active":"2024-04-15T00:21:12.619257+0000","last_became_peered":"2024-04-15T00:21:12.619257+0000","last_unstale":"2024-04-15T00:31:30.146293+0000","last_undegraded":"2024-04-15T00:31:30.146293+0000","last_fullsized":"2024-04-15T00:31:30.146293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:44.287619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398629714,"num_objects":100,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3893,"num_write_kb":404464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'9","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:10.462737+0000","last_change":"2024-04-15T00:21:08.590732+0000","last_active":"2024-04-15T00:28:10.462737+0000","last_peered":"2024-04-15T00:28:10.462737+0000","last_clean":"2024-04-15T00:28:10.462737+0000","last_became_active":"2024-04-15T00:21:08.590450+0000","last_became_peered":"2024-04-15T00:21:08.590450+0000","last_unstale":"2024-04-15T00:28:10.462737+0000","last_undegraded":"2024-04-15T00:28:10.462737+0000","last_fullsized":"2024-04-15T00:28:10.462737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:10:24.477646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'10","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:11.445299+0000","last_change":"2024-04-15T00:21:07.566984+0000","last_active":"2024-04-15T00:28:11.445299+0000","last_peered":"2024-04-15T00:28:11.445299+0000","last_clean":"2024-04-15T00:28:11.445299+0000","last_became_active":"2024-04-15T00:21:07.566681+0000","last_became_peered":"2024-04-15T00:21:07.566681+0000","last_unstale":"2024-04-15T00:28:11.445299+0000","last_undegraded":"2024-04-15T00:28:11.445299+0000","last_fullsized":"2024-04-15T00:28:11.445299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:21:35.113136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'1080","reported_seq":1102,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.437365+0000","last_change":"2024-04-15T00:21:12.615981+0000","last_active":"2024-04-15T00:31:30.437365+0000","last_peered":"2024-04-15T00:31:30.437365+0000","last_clean":"2024-04-15T00:31:30.437365+0000","last_became_active":"2024-04-15T00:21:12.615577+0000","last_became_peered":"2024-04-15T00:21:12.615577+0000","last_unstale":"2024-04-15T00:31:30.437365+0000","last_undegraded":"2024-04-15T00:31:30.437365+0000","last_fullsized":"2024-04-15T00:31:30.437365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1080,"log_dups_size":0,"ondisk_log_size":1080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:52:14.595303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440503524,"num_objects":114,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5539,"num_write_kb":451979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:10.456403+0000","last_change":"2024-04-15T00:21:08.588266+0000","last_active":"2024-04-15T00:28:10.456403+0000","last_peered":"2024-04-15T00:28:10.456403+0000","last_clean":"2024-04-15T00:28:10.456403+0000","last_became_active":"2024-04-15T00:21:08.587962+0000","last_became_peered":"2024-04-15T00:21:08.587962+0000","last_unstale":"2024-04-15T00:28:10.456403+0000","last_undegraded":"2024-04-15T00:28:10.456403+0000","last_fullsized":"2024-04-15T00:28:10.456403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:10.456423+0000","last_change":"2024-04-15T00:21:07.573664+0000","last_active":"2024-04-15T00:28:10.456423+0000","last_peered":"2024-04-15T00:28:10.456423+0000","last_clean":"2024-04-15T00:28:10.456423+0000","last_became_active":"2024-04-15T00:21:07.573325+0000","last_became_peered":"2024-04-15T00:21:07.573325+0000","last_unstale":"2024-04-15T00:28:10.456423+0000","last_undegraded":"2024-04-15T00:28:10.456423+0000","last_fullsized":"2024-04-15T00:28:10.456423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:16:52.647503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'921","reported_seq":950,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.745387+0000","last_change":"2024-04-15T00:21:50.136384+0000","last_active":"2024-04-15T00:31:32.745387+0000","last_peered":"2024-04-15T00:31:32.745387+0000","last_clean":"2024-04-15T00:31:32.745387+0000","last_became_active":"2024-04-15T00:21:50.135899+0000","last_became_peered":"2024-04-15T00:21:50.135899+0000","last_unstale":"2024-04-15T00:31:32.745387+0000","last_undegraded":"2024-04-15T00:31:32.745387+0000","last_fullsized":"2024-04-15T00:31:32.745387+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:16:56.946948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444634187,"num_objects":110,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4674,"num_write_kb":452484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'10","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:10.462759+0000","last_change":"2024-04-15T00:21:08.593412+0000","last_active":"2024-04-15T00:28:10.462759+0000","last_peered":"2024-04-15T00:28:10.462759+0000","last_clean":"2024-04-15T00:28:10.462759+0000","last_became_active":"2024-04-15T00:21:08.593112+0000","last_became_peered":"2024-04-15T00:21:08.593112+0000","last_unstale":"2024-04-15T00:28:10.462759+0000","last_undegraded":"2024-04-15T00:28:10.462759+0000","last_fullsized":"2024-04-15T00:28:10.462759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:45.258841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:10.456433+0000","last_change":"2024-04-15T00:21:07.576800+0000","last_active":"2024-04-15T00:28:10.456433+0000","last_peered":"2024-04-15T00:28:10.456433+0000","last_clean":"2024-04-15T00:28:10.456433+0000","last_became_active":"2024-04-15T00:21:07.576501+0000","last_became_peered":"2024-04-15T00:21:07.576501+0000","last_unstale":"2024-04-15T00:28:10.456433+0000","last_undegraded":"2024-04-15T00:28:10.456433+0000","last_fullsized":"2024-04-15T00:28:10.456433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:54.810223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'976","reported_seq":998,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:33.308898+0000","last_change":"2024-04-15T00:21:12.634065+0000","last_active":"2024-04-15T00:31:33.308898+0000","last_peered":"2024-04-15T00:31:33.308898+0000","last_clean":"2024-04-15T00:31:33.308898+0000","last_became_active":"2024-04-15T00:21:12.633242+0000","last_became_peered":"2024-04-15T00:21:12.633242+0000","last_unstale":"2024-04-15T00:31:33.308898+0000","last_undegraded":"2024-04-15T00:31:33.308898+0000","last_fullsized":"2024-04-15T00:31:33.308898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":976,"log_dups_size":0,"ondisk_log_size":976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:38:32.207334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":453069136,"num_objects":118,"num_object_clones":0,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4842,"num_write_kb":461390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'10","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:51.448456+0000","last_change":"2024-04-15T00:21:49.706390+0000","last_active":"2024-04-15T00:28:51.448456+0000","last_peered":"2024-04-15T00:28:51.448456+0000","last_clean":"2024-04-15T00:28:51.448456+0000","last_became_active":"2024-04-15T00:21:49.705916+0000","last_became_peered":"2024-04-15T00:21:49.705916+0000","last_unstale":"2024-04-15T00:28:51.448456+0000","last_undegraded":"2024-04-15T00:28:51.448456+0000","last_fullsized":"2024-04-15T00:28:51.448456+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:10:24.477646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.13","version":"27'4","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:13.316890+0000","last_change":"2024-04-15T00:21:07.573340+0000","last_active":"2024-04-15T00:29:13.316890+0000","last_peered":"2024-04-15T00:29:13.316890+0000","last_clean":"2024-04-15T00:29:13.316890+0000","last_became_active":"2024-04-15T00:21:07.572749+0000","last_became_peered":"2024-04-15T00:21:07.572749+0000","last_unstale":"2024-04-15T00:29:13.316890+0000","last_undegraded":"2024-04-15T00:29:13.316890+0000","last_fullsized":"2024-04-15T00:29:13.316890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:05:06.225337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'1053","reported_seq":1075,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.353159+0000","last_change":"2024-04-15T00:21:12.632412+0000","last_active":"2024-04-15T00:31:30.353159+0000","last_peered":"2024-04-15T00:31:30.353159+0000","last_clean":"2024-04-15T00:31:30.353159+0000","last_became_active":"2024-04-15T00:21:12.631982+0000","last_became_peered":"2024-04-15T00:21:12.631982+0000","last_unstale":"2024-04-15T00:31:30.353159+0000","last_undegraded":"2024-04-15T00:31:30.353159+0000","last_fullsized":"2024-04-15T00:31:30.353159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1053,"log_dups_size":0,"ondisk_log_size":1053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:11:44.674232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402653184,"num_objects":96,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5184,"num_write_kb":413411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'9","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.464106+0000","last_change":"2024-04-15T00:21:08.582822+0000","last_active":"2024-04-15T00:28:25.464106+0000","last_peered":"2024-04-15T00:28:25.464106+0000","last_clean":"2024-04-15T00:28:25.464106+0000","last_became_active":"2024-04-15T00:21:08.582531+0000","last_became_peered":"2024-04-15T00:21:08.582531+0000","last_unstale":"2024-04-15T00:28:25.464106+0000","last_undegraded":"2024-04-15T00:28:25.464106+0000","last_fullsized":"2024-04-15T00:28:25.464106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:21:59.995077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'287","reported_seq":317,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:11.997546+0000","last_change":"2024-04-15T00:21:07.576694+0000","last_active":"2024-04-15T00:31:11.997546+0000","last_peered":"2024-04-15T00:31:11.997546+0000","last_clean":"2024-04-15T00:31:11.997546+0000","last_became_active":"2024-04-15T00:21:07.576380+0000","last_became_peered":"2024-04-15T00:21:07.576380+0000","last_unstale":"2024-04-15T00:31:11.997546+0000","last_undegraded":"2024-04-15T00:31:11.997546+0000","last_fullsized":"2024-04-15T00:31:11.997546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:36:11.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":4242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'986","reported_seq":1008,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:33.149195+0000","last_change":"2024-04-15T00:21:12.620928+0000","last_active":"2024-04-15T00:31:33.149195+0000","last_peered":"2024-04-15T00:31:33.149195+0000","last_clean":"2024-04-15T00:31:33.149195+0000","last_became_active":"2024-04-15T00:21:12.620536+0000","last_became_peered":"2024-04-15T00:21:12.620536+0000","last_unstale":"2024-04-15T00:31:33.149195+0000","last_undegraded":"2024-04-15T00:31:33.149195+0000","last_fullsized":"2024-04-15T00:31:33.149195+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":986,"log_dups_size":0,"ondisk_log_size":986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:52:14.595303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402669397,"num_objects":101,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4803,"num_write_kb":412051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:10.471091+0000","last_change":"2024-04-15T00:21:08.588132+0000","last_active":"2024-04-15T00:28:10.471091+0000","last_peered":"2024-04-15T00:28:10.471091+0000","last_clean":"2024-04-15T00:28:10.471091+0000","last_became_active":"2024-04-15T00:21:08.587383+0000","last_became_peered":"2024-04-15T00:21:08.587383+0000","last_unstale":"2024-04-15T00:28:10.471091+0000","last_undegraded":"2024-04-15T00:28:10.471091+0000","last_fullsized":"2024-04-15T00:28:10.471091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:15.446273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'21","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:13.316687+0000","last_change":"2024-04-15T00:21:07.574695+0000","last_active":"2024-04-15T00:29:13.316687+0000","last_peered":"2024-04-15T00:29:13.316687+0000","last_clean":"2024-04-15T00:29:13.316687+0000","last_became_active":"2024-04-15T00:21:07.574389+0000","last_became_peered":"2024-04-15T00:21:07.574389+0000","last_unstale":"2024-04-15T00:29:13.316687+0000","last_undegraded":"2024-04-15T00:29:13.316687+0000","last_fullsized":"2024-04-15T00:29:13.316687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:34:26.325595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'1044","reported_seq":1066,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.256686+0000","last_change":"2024-04-15T00:21:12.620255+0000","last_active":"2024-04-15T00:31:30.256686+0000","last_peered":"2024-04-15T00:31:30.256686+0000","last_clean":"2024-04-15T00:31:30.256686+0000","last_became_active":"2024-04-15T00:21:12.619218+0000","last_became_peered":"2024-04-15T00:21:12.619218+0000","last_unstale":"2024-04-15T00:31:30.256686+0000","last_undegraded":"2024-04-15T00:31:30.256686+0000","last_fullsized":"2024-04-15T00:31:30.256686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1044,"log_dups_size":0,"ondisk_log_size":1044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:49.295552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423735680,"num_objects":112,"num_object_clones":0,"num_object_copies":448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5284,"num_write_kb":434520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'9","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:26.453674+0000","last_change":"2024-04-15T00:21:08.597898+0000","last_active":"2024-04-15T00:28:26.453674+0000","last_peered":"2024-04-15T00:28:26.453674+0000","last_clean":"2024-04-15T00:28:26.453674+0000","last_became_active":"2024-04-15T00:21:08.597262+0000","last_became_peered":"2024-04-15T00:21:08.597262+0000","last_unstale":"2024-04-15T00:28:26.453674+0000","last_undegraded":"2024-04-15T00:28:26.453674+0000","last_fullsized":"2024-04-15T00:28:26.453674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.457852+0000","last_change":"2024-04-15T00:21:07.574003+0000","last_active":"2024-04-15T00:28:25.457852+0000","last_peered":"2024-04-15T00:28:25.457852+0000","last_clean":"2024-04-15T00:28:25.457852+0000","last_became_active":"2024-04-15T00:21:07.573469+0000","last_became_peered":"2024-04-15T00:21:07.573469+0000","last_unstale":"2024-04-15T00:28:25.457852+0000","last_undegraded":"2024-04-15T00:28:25.457852+0000","last_fullsized":"2024-04-15T00:28:25.457852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:16:52.647503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'945","reported_seq":967,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.343735+0000","last_change":"2024-04-15T00:21:12.624850+0000","last_active":"2024-04-15T00:31:32.343735+0000","last_peered":"2024-04-15T00:31:32.343735+0000","last_clean":"2024-04-15T00:31:32.343735+0000","last_became_active":"2024-04-15T00:21:12.624484+0000","last_became_peered":"2024-04-15T00:21:12.624484+0000","last_unstale":"2024-04-15T00:31:32.343735+0000","last_undegraded":"2024-04-15T00:31:32.343735+0000","last_fullsized":"2024-04-15T00:31:32.343735+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":945,"log_dups_size":0,"ondisk_log_size":945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:15:08.738300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402666169,"num_objects":101,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4734,"num_write_kb":411824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.457835+0000","last_change":"2024-04-15T00:21:08.591705+0000","last_active":"2024-04-15T00:28:25.457835+0000","last_peered":"2024-04-15T00:28:25.457835+0000","last_clean":"2024-04-15T00:28:25.457835+0000","last_became_active":"2024-04-15T00:21:08.591407+0000","last_became_peered":"2024-04-15T00:21:08.591407+0000","last_unstale":"2024-04-15T00:28:25.457835+0000","last_undegraded":"2024-04-15T00:28:25.457835+0000","last_fullsized":"2024-04-15T00:28:25.457835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.457818+0000","last_change":"2024-04-15T00:21:07.574971+0000","last_active":"2024-04-15T00:28:25.457818+0000","last_peered":"2024-04-15T00:28:25.457818+0000","last_clean":"2024-04-15T00:28:25.457818+0000","last_became_active":"2024-04-15T00:21:07.574656+0000","last_became_peered":"2024-04-15T00:21:07.574656+0000","last_unstale":"2024-04-15T00:28:25.457818+0000","last_undegraded":"2024-04-15T00:28:25.457818+0000","last_fullsized":"2024-04-15T00:28:25.457818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:21:35.113136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'741","reported_seq":763,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.711934+0000","last_change":"2024-04-15T00:21:12.633646+0000","last_active":"2024-04-15T00:31:32.711934+0000","last_peered":"2024-04-15T00:31:32.711934+0000","last_clean":"2024-04-15T00:31:32.711934+0000","last_became_active":"2024-04-15T00:21:12.633262+0000","last_became_peered":"2024-04-15T00:21:12.633262+0000","last_unstale":"2024-04-15T00:31:32.711934+0000","last_undegraded":"2024-04-15T00:31:32.711934+0000","last_fullsized":"2024-04-15T00:31:32.711934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:26:17.136974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":419466538,"num_objects":105,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3547,"num_write_kb":423381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'1101","reported_seq":1124,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.423734+0000","last_change":"2024-04-15T00:21:12.634552+0000","last_active":"2024-04-15T00:31:30.423734+0000","last_peered":"2024-04-15T00:31:30.423734+0000","last_clean":"2024-04-15T00:31:30.423734+0000","last_became_active":"2024-04-15T00:21:12.633824+0000","last_became_peered":"2024-04-15T00:21:12.633824+0000","last_unstale":"2024-04-15T00:31:30.423734+0000","last_undegraded":"2024-04-15T00:31:30.423734+0000","last_fullsized":"2024-04-15T00:31:30.423734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1101,"log_dups_size":0,"ondisk_log_size":1101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:34.506827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482370782,"num_objects":121,"num_object_clones":0,"num_object_copies":484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5837,"num_write_kb":494050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.460010+0000","last_change":"2024-04-15T00:21:08.577988+0000","last_active":"2024-04-15T00:28:25.460010+0000","last_peered":"2024-04-15T00:28:25.460010+0000","last_clean":"2024-04-15T00:28:25.460010+0000","last_became_active":"2024-04-15T00:21:08.577692+0000","last_became_peered":"2024-04-15T00:21:08.577692+0000","last_unstale":"2024-04-15T00:28:25.460010+0000","last_undegraded":"2024-04-15T00:28:25.460010+0000","last_fullsized":"2024-04-15T00:28:25.460010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.457793+0000","last_change":"2024-04-15T00:21:07.563155+0000","last_active":"2024-04-15T00:28:25.457793+0000","last_peered":"2024-04-15T00:28:25.457793+0000","last_clean":"2024-04-15T00:28:25.457793+0000","last_became_active":"2024-04-15T00:21:07.562747+0000","last_became_peered":"2024-04-15T00:21:07.562747+0000","last_unstale":"2024-04-15T00:28:25.457793+0000","last_undegraded":"2024-04-15T00:28:25.457793+0000","last_fullsized":"2024-04-15T00:28:25.457793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:21:35.113136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'958","reported_seq":981,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.212363+0000","last_change":"2024-04-15T00:21:12.624627+0000","last_active":"2024-04-15T00:31:30.212363+0000","last_peered":"2024-04-15T00:31:30.212363+0000","last_clean":"2024-04-15T00:31:30.212363+0000","last_became_active":"2024-04-15T00:21:12.624245+0000","last_became_peered":"2024-04-15T00:21:12.624245+0000","last_unstale":"2024-04-15T00:31:30.212363+0000","last_undegraded":"2024-04-15T00:31:30.212363+0000","last_fullsized":"2024-04-15T00:31:30.212363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":958,"log_dups_size":0,"ondisk_log_size":958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:31.463828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432096512,"num_objects":111,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4784,"num_write_kb":440700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'14","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:26.450736+0000","last_change":"2024-04-15T00:21:08.590595+0000","last_active":"2024-04-15T00:28:26.450736+0000","last_peered":"2024-04-15T00:28:26.450736+0000","last_clean":"2024-04-15T00:28:26.450736+0000","last_became_active":"2024-04-15T00:21:08.590333+0000","last_became_peered":"2024-04-15T00:21:08.590333+0000","last_unstale":"2024-04-15T00:28:26.450736+0000","last_undegraded":"2024-04-15T00:28:26.450736+0000","last_fullsized":"2024-04-15T00:28:26.450736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:26.450774+0000","last_change":"2024-04-15T00:21:07.576399+0000","last_active":"2024-04-15T00:28:26.450774+0000","last_peered":"2024-04-15T00:28:26.450774+0000","last_clean":"2024-04-15T00:28:26.450774+0000","last_became_active":"2024-04-15T00:21:07.576008+0000","last_became_peered":"2024-04-15T00:21:07.576008+0000","last_unstale":"2024-04-15T00:28:26.450774+0000","last_undegraded":"2024-04-15T00:28:26.450774+0000","last_fullsized":"2024-04-15T00:28:26.450774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:16:52.647503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:40.459371+0000","last_change":"2024-04-15T00:21:07.572597+0000","last_active":"2024-04-15T00:28:40.459371+0000","last_peered":"2024-04-15T00:28:40.459371+0000","last_clean":"2024-04-15T00:28:40.459371+0000","last_became_active":"2024-04-15T00:21:07.572273+0000","last_became_peered":"2024-04-15T00:21:07.572273+0000","last_unstale":"2024-04-15T00:28:40.459371+0000","last_undegraded":"2024-04-15T00:28:40.459371+0000","last_fullsized":"2024-04-15T00:28:40.459371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'8","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:41.454818+0000","last_change":"2024-04-15T00:21:08.587210+0000","last_active":"2024-04-15T00:28:41.454818+0000","last_peered":"2024-04-15T00:28:41.454818+0000","last_clean":"2024-04-15T00:28:41.454818+0000","last_became_active":"2024-04-15T00:21:08.586910+0000","last_became_peered":"2024-04-15T00:21:08.586910+0000","last_unstale":"2024-04-15T00:28:41.454818+0000","last_undegraded":"2024-04-15T00:28:41.454818+0000","last_fullsized":"2024-04-15T00:28:41.454818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'803","reported_seq":825,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.280770+0000","last_change":"2024-04-15T00:21:12.622128+0000","last_active":"2024-04-15T00:31:30.280770+0000","last_peered":"2024-04-15T00:31:30.280770+0000","last_clean":"2024-04-15T00:31:30.280770+0000","last_became_active":"2024-04-15T00:21:12.621682+0000","last_became_peered":"2024-04-15T00:21:12.621682+0000","last_unstale":"2024-04-15T00:31:30.280770+0000","last_undegraded":"2024-04-15T00:31:30.280770+0000","last_fullsized":"2024-04-15T00:31:30.280770+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":803,"log_dups_size":0,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:03:00.366139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":339750667,"num_objects":83,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4004,"num_write_kb":347535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'636","reported_seq":666,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:13.317066+0000","last_change":"2024-04-15T00:21:07.577069+0000","last_active":"2024-04-15T00:29:13.317066+0000","last_peered":"2024-04-15T00:29:13.317066+0000","last_clean":"2024-04-15T00:29:13.317066+0000","last_became_active":"2024-04-15T00:21:07.576791+0000","last_became_peered":"2024-04-15T00:21:07.576791+0000","last_unstale":"2024-04-15T00:29:13.317066+0000","last_undegraded":"2024-04-15T00:29:13.317066+0000","last_fullsized":"2024-04-15T00:29:13.317066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:36:11.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":636,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'9","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:40.474199+0000","last_change":"2024-04-15T00:21:08.584214+0000","last_active":"2024-04-15T00:28:40.474199+0000","last_peered":"2024-04-15T00:28:40.474199+0000","last_clean":"2024-04-15T00:28:40.474199+0000","last_became_active":"2024-04-15T00:21:08.583909+0000","last_became_peered":"2024-04-15T00:21:08.583909+0000","last_unstale":"2024-04-15T00:28:40.474199+0000","last_undegraded":"2024-04-15T00:28:40.474199+0000","last_fullsized":"2024-04-15T00:28:40.474199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:55.815311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'1057","reported_seq":1079,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.450905+0000","last_change":"2024-04-15T00:21:12.624156+0000","last_active":"2024-04-15T00:31:32.450905+0000","last_peered":"2024-04-15T00:31:32.450905+0000","last_clean":"2024-04-15T00:31:32.450905+0000","last_became_active":"2024-04-15T00:21:12.623756+0000","last_became_peered":"2024-04-15T00:21:12.623756+0000","last_unstale":"2024-04-15T00:31:32.450905+0000","last_undegraded":"2024-04-15T00:31:32.450905+0000","last_fullsized":"2024-04-15T00:31:32.450905+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1057,"log_dups_size":0,"ondisk_log_size":1057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:31:33.202296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":461404378,"num_objects":118,"num_object_clones":0,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5333,"num_write_kb":471487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'7","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.464489+0000","last_change":"2024-04-15T00:21:08.588647+0000","last_active":"2024-04-15T00:29:30.464489+0000","last_peered":"2024-04-15T00:29:30.464489+0000","last_clean":"2024-04-15T00:29:30.464489+0000","last_became_active":"2024-04-15T00:21:08.587719+0000","last_became_peered":"2024-04-15T00:21:08.587719+0000","last_unstale":"2024-04-15T00:29:30.464489+0000","last_undegraded":"2024-04-15T00:29:30.464489+0000","last_fullsized":"2024-04-15T00:29:30.464489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:39.454082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'11","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:31.451411+0000","last_change":"2024-04-15T00:21:08.596094+0000","last_active":"2024-04-15T00:29:31.451411+0000","last_peered":"2024-04-15T00:29:31.451411+0000","last_clean":"2024-04-15T00:29:31.451411+0000","last_became_active":"2024-04-15T00:21:08.595790+0000","last_became_peered":"2024-04-15T00:21:08.595790+0000","last_unstale":"2024-04-15T00:29:31.451411+0000","last_undegraded":"2024-04-15T00:29:31.451411+0000","last_fullsized":"2024-04-15T00:29:31.451411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:15.446273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'9","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.464509+0000","last_change":"2024-04-15T00:21:08.583148+0000","last_active":"2024-04-15T00:29:30.464509+0000","last_peered":"2024-04-15T00:29:30.464509+0000","last_clean":"2024-04-15T00:29:30.464509+0000","last_became_active":"2024-04-15T00:21:08.582801+0000","last_became_peered":"2024-04-15T00:21:08.582801+0000","last_unstale":"2024-04-15T00:29:30.464509+0000","last_undegraded":"2024-04-15T00:29:30.464509+0000","last_fullsized":"2024-04-15T00:29:30.464509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:01.007313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'9","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:31.459060+0000","last_change":"2024-04-15T00:21:08.596406+0000","last_active":"2024-04-15T00:29:31.459060+0000","last_peered":"2024-04-15T00:29:31.459060+0000","last_clean":"2024-04-15T00:29:31.459060+0000","last_became_active":"2024-04-15T00:21:08.596144+0000","last_became_peered":"2024-04-15T00:21:08.596144+0000","last_unstale":"2024-04-15T00:29:31.459060+0000","last_undegraded":"2024-04-15T00:29:31.459060+0000","last_fullsized":"2024-04-15T00:29:31.459060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:41.447119+0000","last_change":"2024-04-15T00:21:08.591959+0000","last_active":"2024-04-15T00:27:41.447119+0000","last_peered":"2024-04-15T00:27:41.447119+0000","last_clean":"2024-04-15T00:27:41.447119+0000","last_became_active":"2024-04-15T00:21:08.591479+0000","last_became_peered":"2024-04-15T00:21:08.591479+0000","last_unstale":"2024-04-15T00:27:41.447119+0000","last_undegraded":"2024-04-15T00:27:41.447119+0000","last_fullsized":"2024-04-15T00:27:41.447119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:40.456524+0000","last_change":"2024-04-15T00:21:08.577658+0000","last_active":"2024-04-15T00:27:40.456524+0000","last_peered":"2024-04-15T00:27:40.456524+0000","last_clean":"2024-04-15T00:27:40.456524+0000","last_became_active":"2024-04-15T00:21:08.577358+0000","last_became_peered":"2024-04-15T00:21:08.577358+0000","last_unstale":"2024-04-15T00:27:40.456524+0000","last_undegraded":"2024-04-15T00:27:40.456524+0000","last_fullsized":"2024-04-15T00:27:40.456524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:40.453104+0000","last_change":"2024-04-15T00:21:08.593462+0000","last_active":"2024-04-15T00:27:40.453104+0000","last_peered":"2024-04-15T00:27:40.453104+0000","last_clean":"2024-04-15T00:27:40.453104+0000","last_became_active":"2024-04-15T00:21:08.593174+0000","last_became_peered":"2024-04-15T00:21:08.593174+0000","last_unstale":"2024-04-15T00:27:40.453104+0000","last_undegraded":"2024-04-15T00:27:40.453104+0000","last_fullsized":"2024-04-15T00:27:40.453104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:41.447142+0000","last_change":"2024-04-15T00:21:08.582109+0000","last_active":"2024-04-15T00:27:41.447142+0000","last_peered":"2024-04-15T00:27:41.447142+0000","last_clean":"2024-04-15T00:27:41.447142+0000","last_became_active":"2024-04-15T00:21:08.581828+0000","last_became_peered":"2024-04-15T00:21:08.581828+0000","last_unstale":"2024-04-15T00:27:41.447142+0000","last_undegraded":"2024-04-15T00:27:41.447142+0000","last_fullsized":"2024-04-15T00:27:41.447142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:01.007313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:40.453055+0000","last_change":"2024-04-15T00:21:08.582329+0000","last_active":"2024-04-15T00:27:40.453055+0000","last_peered":"2024-04-15T00:27:40.453055+0000","last_clean":"2024-04-15T00:27:40.453055+0000","last_became_active":"2024-04-15T00:21:08.582011+0000","last_became_peered":"2024-04-15T00:21:08.582011+0000","last_unstale":"2024-04-15T00:27:40.453055+0000","last_undegraded":"2024-04-15T00:27:40.453055+0000","last_fullsized":"2024-04-15T00:27:40.453055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'10","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:56.448358+0000","last_change":"2024-04-15T00:21:08.581215+0000","last_active":"2024-04-15T00:27:56.448358+0000","last_peered":"2024-04-15T00:27:56.448358+0000","last_clean":"2024-04-15T00:27:56.448358+0000","last_became_active":"2024-04-15T00:21:08.579860+0000","last_became_peered":"2024-04-15T00:21:08.579860+0000","last_unstale":"2024-04-15T00:27:56.448358+0000","last_undegraded":"2024-04-15T00:27:56.448358+0000","last_fullsized":"2024-04-15T00:27:56.448358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'8","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:55.454850+0000","last_change":"2024-04-15T00:21:08.592785+0000","last_active":"2024-04-15T00:27:55.454850+0000","last_peered":"2024-04-15T00:27:55.454850+0000","last_clean":"2024-04-15T00:27:55.454850+0000","last_became_active":"2024-04-15T00:21:08.592110+0000","last_became_peered":"2024-04-15T00:21:08.592110+0000","last_unstale":"2024-04-15T00:27:55.454850+0000","last_undegraded":"2024-04-15T00:27:55.454850+0000","last_fullsized":"2024-04-15T00:27:55.454850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:45.258841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'10","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:56.451238+0000","last_change":"2024-04-15T00:21:08.599781+0000","last_active":"2024-04-15T00:27:56.451238+0000","last_peered":"2024-04-15T00:27:56.451238+0000","last_clean":"2024-04-15T00:27:56.451238+0000","last_became_active":"2024-04-15T00:21:08.599460+0000","last_became_peered":"2024-04-15T00:21:08.599460+0000","last_unstale":"2024-04-15T00:27:56.451238+0000","last_undegraded":"2024-04-15T00:27:56.451238+0000","last_fullsized":"2024-04-15T00:27:56.451238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:39.454082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:55.454839+0000","last_change":"2024-04-15T00:21:08.588233+0000","last_active":"2024-04-15T00:27:55.454839+0000","last_peered":"2024-04-15T00:27:55.454839+0000","last_clean":"2024-04-15T00:27:55.454839+0000","last_became_active":"2024-04-15T00:21:08.586235+0000","last_became_peered":"2024-04-15T00:21:08.586235+0000","last_unstale":"2024-04-15T00:27:55.454839+0000","last_undegraded":"2024-04-15T00:27:55.454839+0000","last_fullsized":"2024-04-15T00:27:55.454839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'10","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:55.460955+0000","last_change":"2024-04-15T00:21:08.582000+0000","last_active":"2024-04-15T00:27:55.460955+0000","last_peered":"2024-04-15T00:27:55.460955+0000","last_clean":"2024-04-15T00:27:55.460955+0000","last_became_active":"2024-04-15T00:21:08.581714+0000","last_became_peered":"2024-04-15T00:21:08.581714+0000","last_unstale":"2024-04-15T00:27:55.460955+0000","last_undegraded":"2024-04-15T00:27:55.460955+0000","last_fullsized":"2024-04-15T00:27:55.460955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:27.427117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'11","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:11.445341+0000","last_change":"2024-04-15T00:21:08.582994+0000","last_active":"2024-04-15T00:28:11.445341+0000","last_peered":"2024-04-15T00:28:11.445341+0000","last_clean":"2024-04-15T00:28:11.445341+0000","last_became_active":"2024-04-15T00:21:08.582594+0000","last_became_peered":"2024-04-15T00:21:08.582594+0000","last_unstale":"2024-04-15T00:28:11.445341+0000","last_undegraded":"2024-04-15T00:28:11.445341+0000","last_fullsized":"2024-04-15T00:28:11.445341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:26:23.617197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:10.456477+0000","last_change":"2024-04-15T00:21:08.591937+0000","last_active":"2024-04-15T00:28:10.456477+0000","last_peered":"2024-04-15T00:28:10.456477+0000","last_clean":"2024-04-15T00:28:10.456477+0000","last_became_active":"2024-04-15T00:21:08.591655+0000","last_became_peered":"2024-04-15T00:21:08.591655+0000","last_unstale":"2024-04-15T00:28:10.456477+0000","last_undegraded":"2024-04-15T00:28:10.456477+0000","last_fullsized":"2024-04-15T00:28:10.456477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:21:59.995077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'6","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:51.448433+0000","last_change":"2024-04-15T00:21:49.707724+0000","last_active":"2024-04-15T00:28:51.448433+0000","last_peered":"2024-04-15T00:28:51.448433+0000","last_clean":"2024-04-15T00:28:51.448433+0000","last_became_active":"2024-04-15T00:21:49.707397+0000","last_became_peered":"2024-04-15T00:21:49.707397+0000","last_unstale":"2024-04-15T00:28:51.448433+0000","last_undegraded":"2024-04-15T00:28:51.448433+0000","last_fullsized":"2024-04-15T00:28:51.448433+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:21:59.995077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"27'9","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:10.458822+0000","last_change":"2024-04-15T00:21:08.581452+0000","last_active":"2024-04-15T00:28:10.458822+0000","last_peered":"2024-04-15T00:28:10.458822+0000","last_clean":"2024-04-15T00:28:10.458822+0000","last_became_active":"2024-04-15T00:21:08.580967+0000","last_became_peered":"2024-04-15T00:21:08.580967+0000","last_unstale":"2024-04-15T00:28:10.458822+0000","last_undegraded":"2024-04-15T00:28:10.458822+0000","last_fullsized":"2024-04-15T00:28:10.458822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'9","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:11.452407+0000","last_change":"2024-04-15T00:21:08.587249+0000","last_active":"2024-04-15T00:28:11.452407+0000","last_peered":"2024-04-15T00:28:11.452407+0000","last_clean":"2024-04-15T00:28:11.452407+0000","last_became_active":"2024-04-15T00:21:08.586885+0000","last_became_peered":"2024-04-15T00:21:08.586885+0000","last_unstale":"2024-04-15T00:28:11.452407+0000","last_undegraded":"2024-04-15T00:28:11.452407+0000","last_fullsized":"2024-04-15T00:28:11.452407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:44:31.020890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:26.450795+0000","last_change":"2024-04-15T00:21:08.579970+0000","last_active":"2024-04-15T00:28:26.450795+0000","last_peered":"2024-04-15T00:28:26.450795+0000","last_clean":"2024-04-15T00:28:26.450795+0000","last_became_active":"2024-04-15T00:21:08.579652+0000","last_became_peered":"2024-04-15T00:21:08.579652+0000","last_unstale":"2024-04-15T00:28:26.450795+0000","last_undegraded":"2024-04-15T00:28:26.450795+0000","last_fullsized":"2024-04-15T00:28:26.450795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:10:24.477646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.472704+0000","last_change":"2024-04-15T00:21:08.588376+0000","last_active":"2024-04-15T00:28:25.472704+0000","last_peered":"2024-04-15T00:28:25.472704+0000","last_clean":"2024-04-15T00:28:25.472704+0000","last_became_active":"2024-04-15T00:21:08.587712+0000","last_became_peered":"2024-04-15T00:21:08.587712+0000","last_unstale":"2024-04-15T00:28:25.472704+0000","last_undegraded":"2024-04-15T00:28:25.472704+0000","last_fullsized":"2024-04-15T00:28:25.472704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:34:27.330682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'11","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.457788+0000","last_change":"2024-04-15T00:21:08.597204+0000","last_active":"2024-04-15T00:28:25.457788+0000","last_peered":"2024-04-15T00:28:25.457788+0000","last_clean":"2024-04-15T00:28:25.457788+0000","last_became_active":"2024-04-15T00:21:08.596862+0000","last_became_peered":"2024-04-15T00:21:08.596862+0000","last_unstale":"2024-04-15T00:28:25.457788+0000","last_undegraded":"2024-04-15T00:28:25.457788+0000","last_fullsized":"2024-04-15T00:28:25.457788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'8","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.457806+0000","last_change":"2024-04-15T00:21:08.598199+0000","last_active":"2024-04-15T00:28:25.457806+0000","last_peered":"2024-04-15T00:28:25.457806+0000","last_clean":"2024-04-15T00:28:25.457806+0000","last_became_active":"2024-04-15T00:21:08.597790+0000","last_became_peered":"2024-04-15T00:21:08.597790+0000","last_unstale":"2024-04-15T00:28:25.457806+0000","last_undegraded":"2024-04-15T00:28:25.457806+0000","last_fullsized":"2024-04-15T00:28:25.457806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'10","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.464140+0000","last_change":"2024-04-15T00:21:08.600496+0000","last_active":"2024-04-15T00:28:25.464140+0000","last_peered":"2024-04-15T00:28:25.464140+0000","last_clean":"2024-04-15T00:28:25.464140+0000","last_became_active":"2024-04-15T00:21:08.600121+0000","last_became_peered":"2024-04-15T00:21:08.600121+0000","last_unstale":"2024-04-15T00:28:25.464140+0000","last_undegraded":"2024-04-15T00:28:25.464140+0000","last_fullsized":"2024-04-15T00:28:25.464140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:11:12.071153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:41.452071+0000","last_change":"2024-04-15T00:21:08.583866+0000","last_active":"2024-04-15T00:28:41.452071+0000","last_peered":"2024-04-15T00:28:41.452071+0000","last_clean":"2024-04-15T00:28:41.452071+0000","last_became_active":"2024-04-15T00:21:08.583563+0000","last_became_peered":"2024-04-15T00:21:08.583563+0000","last_unstale":"2024-04-15T00:28:41.452071+0000","last_undegraded":"2024-04-15T00:28:41.452071+0000","last_fullsized":"2024-04-15T00:28:41.452071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:27:41.268464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:40.465745+0000","last_change":"2024-04-15T00:21:08.596983+0000","last_active":"2024-04-15T00:28:40.465745+0000","last_peered":"2024-04-15T00:28:40.465745+0000","last_clean":"2024-04-15T00:28:40.465745+0000","last_became_active":"2024-04-15T00:21:08.596640+0000","last_became_peered":"2024-04-15T00:21:08.596640+0000","last_unstale":"2024-04-15T00:28:40.465745+0000","last_undegraded":"2024-04-15T00:28:40.465745+0000","last_fullsized":"2024-04-15T00:28:40.465745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:40.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'8","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:40.459376+0000","last_change":"2024-04-15T00:21:08.593027+0000","last_active":"2024-04-15T00:28:40.459376+0000","last_peered":"2024-04-15T00:28:40.459376+0000","last_clean":"2024-04-15T00:28:40.459376+0000","last_became_active":"2024-04-15T00:21:08.592476+0000","last_became_peered":"2024-04-15T00:21:08.592476+0000","last_unstale":"2024-04-15T00:28:40.459376+0000","last_undegraded":"2024-04-15T00:28:40.459376+0000","last_fullsized":"2024-04-15T00:28:40.459376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:10:24.477646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:40.465766+0000","last_change":"2024-04-15T00:21:08.591419+0000","last_active":"2024-04-15T00:28:40.465766+0000","last_peered":"2024-04-15T00:28:40.465766+0000","last_clean":"2024-04-15T00:28:40.465766+0000","last_became_active":"2024-04-15T00:21:08.591101+0000","last_became_peered":"2024-04-15T00:21:08.591101+0000","last_unstale":"2024-04-15T00:28:40.465766+0000","last_undegraded":"2024-04-15T00:28:40.465766+0000","last_fullsized":"2024-04-15T00:28:40.465766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:52:10.558592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:10.462657+0000","last_change":"2024-04-15T00:21:08.581621+0000","last_active":"2024-04-15T00:29:10.462657+0000","last_peered":"2024-04-15T00:29:10.462657+0000","last_clean":"2024-04-15T00:29:10.462657+0000","last_became_active":"2024-04-15T00:21:08.581316+0000","last_became_peered":"2024-04-15T00:21:08.581316+0000","last_unstale":"2024-04-15T00:29:10.462657+0000","last_undegraded":"2024-04-15T00:29:10.462657+0000","last_fullsized":"2024-04-15T00:29:10.462657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:27.427117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'7","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:31.459072+0000","last_change":"2024-04-15T00:21:08.590252+0000","last_active":"2024-04-15T00:29:31.459072+0000","last_peered":"2024-04-15T00:29:31.459072+0000","last_clean":"2024-04-15T00:29:31.459072+0000","last_became_active":"2024-04-15T00:21:08.589919+0000","last_became_peered":"2024-04-15T00:21:08.589919+0000","last_unstale":"2024-04-15T00:29:31.459072+0000","last_undegraded":"2024-04-15T00:29:31.459072+0000","last_fullsized":"2024-04-15T00:29:31.459072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:46:53.537904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.465273+0000","last_change":"2024-04-15T00:21:08.588530+0000","last_active":"2024-04-15T00:29:30.465273+0000","last_peered":"2024-04-15T00:29:30.465273+0000","last_clean":"2024-04-15T00:29:30.465273+0000","last_became_active":"2024-04-15T00:21:08.588208+0000","last_became_peered":"2024-04-15T00:21:08.588208+0000","last_unstale":"2024-04-15T00:29:30.465273+0000","last_undegraded":"2024-04-15T00:29:30.465273+0000","last_fullsized":"2024-04-15T00:29:30.465273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:08.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'5","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.470890+0000","last_change":"2024-04-15T00:21:08.588469+0000","last_active":"2024-04-15T00:29:30.470890+0000","last_peered":"2024-04-15T00:29:30.470890+0000","last_clean":"2024-04-15T00:29:30.470890+0000","last_became_active":"2024-04-15T00:21:08.587646+0000","last_became_peered":"2024-04-15T00:21:08.587646+0000","last_unstale":"2024-04-15T00:29:30.470890+0000","last_undegraded":"2024-04-15T00:29:30.470890+0000","last_fullsized":"2024-04-15T00:29:30.470890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:52:27.105666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":13424233995,"num_objects":3390,"num_object_clones":0,"num_object_copies":13560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3390,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148702,"num_write_kb":13691509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26850476032,"data_stored":26850476032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29948,"ondisk_log_size":29948,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":453,"ondisk_log_size":453,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":11389277,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":36,"num_read_kb":72,"num_write":2536,"num_write_kb":11908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":22839296,"data_stored":22778554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2200,"ondisk_log_size":2200,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542276,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4663072,"kb_used_data":4365464,"kb_used_omap":1,"kb_used_meta":297598,"kb_avail":89708768,"statfs":{"total":96636764160,"available":91861778432,"internally_reserved":0,"allocated":4470235136,"data_stored":4470056729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":304740807},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542276,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2797748,"kb_used_data":2626412,"kb_used_omap":1,"kb_used_meta":171326,"kb_avail":91574092,"statfs":{"total":96636764160,"available":93771870208,"internally_reserved":0,"allocated":2689445888,"data_stored":2689275001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":175438277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542276,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3076828,"kb_used_data":2887444,"kb_used_omap":1,"kb_used_meta":189374,"kb_avail":91295012,"statfs":{"total":96636764160,"available":93486092288,"internally_reserved":0,"allocated":2956742656,"data_stored":2956558926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":193919429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574981,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3118448,"kb_used_data":2920744,"kb_used_omap":1,"kb_used_meta":197694,"kb_avail":91253392,"statfs":{"total":96636764160,"available":93443473408,"internally_reserved":0,"allocated":2990841856,"data_stored":2990665452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":202439114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574981,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3681748,"kb_used_data":3443788,"kb_used_omap":1,"kb_used_meta":237950,"kb_avail":90690092,"statfs":{"total":96636764160,"available":92866654208,"internally_reserved":0,"allocated":3526438912,"data_stored":3526262864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":243661254},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574980,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2562512,"kb_used_data":2382856,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":91809328,"statfs":{"total":96636764160,"available":94012751872,"internally_reserved":0,"allocated":2440044544,"data_stored":2439872010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574980,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3506600,"kb_used_data":3268640,"kb_used_omap":1,"kb_used_meta":237950,"kb_avail":90865240,"statfs":{"total":96636764160,"available":93046005760,"internally_reserved":0,"allocated":3347087360,"data_stored":3346905860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243661253},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574980,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4647724,"kb_used_data":4351524,"kb_used_omap":1,"kb_used_meta":296190,"kb_avail":89724116,"statfs":{"total":96636764160,"available":91877494784,"internally_reserved":0,"allocated":4455960576,"data_stored":4455784016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":303299014},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,1,2,1,5,2,14,12,20,45,35,61,65],"upper_bound":8192},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":50889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8450048,"data_stored":8440169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2961408,"data_stored":2948436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7147520,"data_stored":7143196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2955849728,"data_stored":2955849728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4455665664,"data_stored":4455665664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2689105920,"data_stored":2689105920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4461498368,"data_stored":4461498368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3343839232,"data_stored":3343839232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2439753728,"data_stored":2439753728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3521949696,"data_stored":3521949696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2982813696,"data_stored":2982813696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T00:31:42.458 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-15T00:31:42.458 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T00:31:42.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.587+0000 7fbe901b4640 1 Processor -- start 2024-04-15T00:31:42.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.587+0000 7fbe901b4640 1 -- start start 2024-04-15T00:31:42.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.588+0000 7fbe901b4640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbe880b5bb0 0x7fbe880aff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:42.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.588+0000 7fbe901b4640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe88148910 con 0x7fbe880add40 2024-04-15T00:31:42.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.588+0000 7fbe901b4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe880b5f90 con 0x7fbe880ae180 2024-04-15T00:31:42.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.588+0000 7fbe901b4640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fbe880b1290 con 0x7fbe880b5bb0 2024-04-15T00:31:42.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.588+0000 7fbe8df50640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbe880b5bb0 0x7fbe880aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:42.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.588+0000 7fbe8df50640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbe880b5bb0 0x7fbe880aff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57396/0 (socket says 172.21.15.31:57396) 2024-04-15T00:31:42.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.588+0000 7fbe8d74f640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fbe880add40 0x7fbe88147af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56188/0 (socket says 172.21.15.31:56188) 2024-04-15T00:31:42.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.588+0000 7fbe8df50640 1 -- 172.21.15.31:0/4079260916 learned_addr learned my addr 172.21.15.31:0/4079260916 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:42.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.588+0000 7fbe8df50640 1 -- 172.21.15.31:0/4079260916 >> v1:172.21.15.50:6789/0 conn(0x7fbe880ae180 legacy=0x7fbe88148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:42.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.588+0000 7fbe8df50640 1 -- 172.21.15.31:0/4079260916 >> v1:172.21.15.31:6789/0 conn(0x7fbe880add40 legacy=0x7fbe88147af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:42.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.588+0000 7fbe8df50640 1 -- 172.21.15.31:0/4079260916 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe880af120 con 0x7fbe880b5bb0 2024-04-15T00:31:42.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.588+0000 7fbe8cf4e640 1 -- 172.21.15.31:0/4079260916 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2642704180 0 0) 0x7fbe88148910 con 0x7fbe880add40 2024-04-15T00:31:42.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.589+0000 7fbe8df50640 1 --2- 172.21.15.31:0/4079260916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe880b5bb0 0x7fbe880aff50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbe84009870 tx=0x7fbe8402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae0b90653a3e2be9 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:42.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.589+0000 7fbe8cf4e640 1 -- 172.21.15.31:0/4079260916 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8402f840 con 0x7fbe880b5bb0 2024-04-15T00:31:42.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.589+0000 7fbe8cf4e640 1 -- 172.21.15.31:0/4079260916 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe8402f9e0 con 0x7fbe880b5bb0 2024-04-15T00:31:42.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.589+0000 7fbe8cf4e640 1 -- 172.21.15.31:0/4079260916 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8402fdb0 con 0x7fbe880b5bb0 2024-04-15T00:31:42.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.589+0000 7fbe901b4640 1 -- 172.21.15.31:0/4079260916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe880b5bb0 msgr2=0x7fbe880aff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:42.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.589+0000 7fbe901b4640 1 --2- 172.21.15.31:0/4079260916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe880b5bb0 0x7fbe880aff50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbe84009870 tx=0x7fbe8402ba20 comp rx=0 tx=0).stop 2024-04-15T00:31:42.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.590+0000 7fbe901b4640 1 -- 172.21.15.31:0/4079260916 shutdown_connections 2024-04-15T00:31:42.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.590+0000 7fbe901b4640 1 --2- 172.21.15.31:0/4079260916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe880b5bb0 0x7fbe880aff50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:42.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.590+0000 7fbe901b4640 1 -- 172.21.15.31:0/4079260916 >> 172.21.15.31:0/4079260916 conn(0x7fbe8806c470 msgr2=0x7fbe8806c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:42.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.590+0000 7fbe901b4640 1 -- 172.21.15.31:0/4079260916 shutdown_connections 2024-04-15T00:31:42.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.590+0000 7fbe901b4640 1 -- 172.21.15.31:0/4079260916 wait complete. 2024-04-15T00:31:42.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.591+0000 7fbe901b4640 1 Processor -- start 2024-04-15T00:31:42.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.591+0000 7fbe901b4640 1 -- start start 2024-04-15T00:31:42.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.591+0000 7fbe901b4640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbe880add40 0x7fbe88140e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:42.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.591+0000 7fbe901b4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe880ae180 0x7fbe881e0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:42.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.591+0000 7fbe901b4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe880b5bb0 0x7fbe881e0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:42.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.591+0000 7fbe901b4640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbe880afc00 con 0x7fbe880ae180 2024-04-15T00:31:42.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.591+0000 7fbe901b4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbe880af6e0 con 0x7fbe880b5bb0 2024-04-15T00:31:42.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.591+0000 7fbe901b4640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fbe880b0ef0 con 0x7fbe880add40 2024-04-15T00:31:42.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.591+0000 7fbe8d74f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe880ae180 0x7fbe881e0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:42.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.591+0000 7fbe8d74f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe880ae180 0x7fbe881e0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57400/0 (socket says 172.21.15.31:57400) 2024-04-15T00:31:42.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.591+0000 7fbe8d74f640 1 -- 172.21.15.31:0/3044501621 learned_addr learned my addr 172.21.15.31:0/3044501621 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:42.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.592+0000 7fbe8e751640 1 --2- 172.21.15.31:0/3044501621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe880b5bb0 0x7fbe881e0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:42.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.592+0000 7fbe8df50640 1 --2- 172.21.15.31:0/3044501621 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbe880add40 0x7fbe88140e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:42.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.592+0000 7fbe8d74f640 1 -- 172.21.15.31:0/3044501621 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbe880add40 msgr2=0x7fbe88140e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:42.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.592+0000 7fbe8d74f640 1 --2- 172.21.15.31:0/3044501621 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbe880add40 0x7fbe88140e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:42.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.592+0000 7fbe8d74f640 1 -- 172.21.15.31:0/3044501621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe880b5bb0 msgr2=0x7fbe881e0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:42.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.592+0000 7fbe8d74f640 1 --2- 172.21.15.31:0/3044501621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe880b5bb0 0x7fbe881e0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:42.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.592+0000 7fbe8d74f640 1 -- 172.21.15.31:0/3044501621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe881cd990 con 0x7fbe880ae180 2024-04-15T00:31:42.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.592+0000 7fbe8d74f640 1 --2- 172.21.15.31:0/3044501621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe880ae180 0x7fbe881e0ab0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800c4a0 tx=0x7fbe7800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:42.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.592+0000 7fbe7e7fc640 1 -- 172.21.15.31:0/3044501621 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe78018070 con 0x7fbe880ae180 2024-04-15T00:31:42.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.592+0000 7fbe7e7fc640 1 -- 172.21.15.31:0/3044501621 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe780074e0 con 0x7fbe880ae180 2024-04-15T00:31:42.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.592+0000 7fbe901b4640 1 -- 172.21.15.31:0/3044501621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe880b34c0 con 0x7fbe880ae180 2024-04-15T00:31:42.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.592+0000 7fbe7e7fc640 1 -- 172.21.15.31:0/3044501621 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe78004a20 con 0x7fbe880ae180 2024-04-15T00:31:42.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.592+0000 7fbe901b4640 1 -- 172.21.15.31:0/3044501621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe880b4060 con 0x7fbe880ae180 2024-04-15T00:31:42.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.593+0000 7fbe901b4640 1 -- 172.21.15.31:0/3044501621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe880b0cd0 con 0x7fbe880ae180 2024-04-15T00:31:42.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.593+0000 7fbe7e7fc640 1 -- 172.21.15.31:0/3044501621 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fbe7801b070 con 0x7fbe880ae180 2024-04-15T00:31:42.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.594+0000 7fbe7e7fc640 1 --2- 172.21.15.31:0/3044501621 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fbe6c06b990 0x7fbe6c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:42.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.594+0000 7fbe7e7fc640 1 -- 172.21.15.31:0/3044501621 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fbe78089e60 con 0x7fbe880ae180 2024-04-15T00:31:42.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.594+0000 7fbe8df50640 1 --2- 172.21.15.31:0/3044501621 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fbe6c06b990 0x7fbe6c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:42.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.594+0000 7fbe8df50640 1 --2- 172.21.15.31:0/3044501621 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fbe6c06b990 0x7fbe6c06de50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbe84036000 tx=0x7fbe84008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:42.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.598+0000 7fbe7e7fc640 1 -- 172.21.15.31:0/3044501621 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fbe78058700 con 0x7fbe880ae180 2024-04-15T00:31:42.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.775+0000 7fbe901b4640 1 -- 172.21.15.31:0/3044501621 --> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbe8804f620 con 0x7fbe6c06b990 2024-04-15T00:31:42.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.783+0000 7fbe7e7fc640 1 -- 172.21.15.31:0/3044501621 <== mgr.4107 v2:172.21.15.31:6832/915470279 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334269 (secure 0 0 0) 0x7fbe8804f620 con 0x7fbe6c06b990 2024-04-15T00:31:42.794 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:31:42.796 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-15T00:31:42.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.786+0000 7fbe901b4640 1 -- 172.21.15.31:0/3044501621 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fbe6c06b990 msgr2=0x7fbe6c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:42.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.786+0000 7fbe901b4640 1 --2- 172.21.15.31:0/3044501621 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fbe6c06b990 0x7fbe6c06de50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbe84036000 tx=0x7fbe84008030 comp rx=0 tx=0).stop 2024-04-15T00:31:42.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.786+0000 7fbe901b4640 1 -- 172.21.15.31:0/3044501621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe880ae180 msgr2=0x7fbe881e0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:42.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.786+0000 7fbe901b4640 1 --2- 172.21.15.31:0/3044501621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe880ae180 0x7fbe881e0ab0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800c4a0 tx=0x7fbe7800c960 comp rx=0 tx=0).stop 2024-04-15T00:31:42.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.786+0000 7fbe901b4640 1 -- 172.21.15.31:0/3044501621 shutdown_connections 2024-04-15T00:31:42.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.786+0000 7fbe901b4640 1 --2- 172.21.15.31:0/3044501621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe880b5bb0 0x7fbe881e0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:42.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.786+0000 7fbe901b4640 1 --2- 172.21.15.31:0/3044501621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe880ae180 0x7fbe881e0ab0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:42.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.786+0000 7fbe901b4640 1 --2- 172.21.15.31:0/3044501621 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fbe6c06b990 0x7fbe6c06de50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:42.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.786+0000 7fbe901b4640 1 --2- 172.21.15.31:0/3044501621 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fbe880add40 0x7fbe88140e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:42.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.786+0000 7fbe901b4640 1 -- 172.21.15.31:0/3044501621 >> 172.21.15.31:0/3044501621 conn(0x7fbe8806c470 msgr2=0x7fbe88069090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:42.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.786+0000 7fbe901b4640 1 -- 172.21.15.31:0/3044501621 shutdown_connections 2024-04-15T00:31:42.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.786+0000 7fbe901b4640 1 -- 172.21.15.31:0/3044501621 wait complete. 2024-04-15T00:31:42.805 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":344,"stamp":"2024-04-15T00:31:42.531296+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":13436213640,"num_objects":3426,"num_object_clones":0,"num_object_copies":13632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3426,"num_whiteouts":0,"num_read":152,"num_read_kb":172,"num_write":151399,"num_write_kb":13705833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32882,"ondisk_log_size":32882,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":28054680,"kb_used_data":26246872,"kb_used_omap":12,"kb_used_meta":1807731,"kb_avail":726920040,"statfs":{"total":773094113280,"available":744366120960,"internally_reserved":0,"allocated":26876796928,"data_stored":26875380858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1851117105},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":81673,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14614,"num_write_kb":58955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003030"},"pg_stats":[{"pgid":"2.1f","version":"27'5","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:31.459095+0000","last_change":"2024-04-15T00:21:07.577313+0000","last_active":"2024-04-15T00:29:31.459095+0000","last_peered":"2024-04-15T00:29:31.459095+0000","last_clean":"2024-04-15T00:29:31.459095+0000","last_became_active":"2024-04-15T00:21:07.576921+0000","last_became_peered":"2024-04-15T00:21:07.576921+0000","last_unstale":"2024-04-15T00:29:31.459095+0000","last_undegraded":"2024-04-15T00:29:31.459095+0000","last_fullsized":"2024-04-15T00:29:31.459095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:41:31.846500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:11.454463+0000","last_change":"2024-04-15T00:21:08.579912+0000","last_active":"2024-04-15T00:29:11.454463+0000","last_peered":"2024-04-15T00:29:11.454463+0000","last_clean":"2024-04-15T00:29:11.454463+0000","last_became_active":"2024-04-15T00:21:08.579545+0000","last_became_peered":"2024-04-15T00:21:08.579545+0000","last_unstale":"2024-04-15T00:29:11.454463+0000","last_undegraded":"2024-04-15T00:29:11.454463+0000","last_fullsized":"2024-04-15T00:29:11.454463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'1071","reported_seq":1093,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.698383+0000","last_change":"2024-04-15T00:21:12.634366+0000","last_active":"2024-04-15T00:31:32.698383+0000","last_peered":"2024-04-15T00:31:32.698383+0000","last_clean":"2024-04-15T00:31:32.698383+0000","last_became_active":"2024-04-15T00:21:12.633323+0000","last_became_peered":"2024-04-15T00:21:12.633323+0000","last_unstale":"2024-04-15T00:31:32.698383+0000","last_undegraded":"2024-04-15T00:31:32.698383+0000","last_fullsized":"2024-04-15T00:31:32.698383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1071,"log_dups_size":0,"ondisk_log_size":1071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:26:21.575108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444643618,"num_objects":114,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5549,"num_write_kb":456057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:11.454494+0000","last_change":"2024-04-15T00:21:07.569057+0000","last_active":"2024-04-15T00:29:11.454494+0000","last_peered":"2024-04-15T00:29:11.454494+0000","last_clean":"2024-04-15T00:29:11.454494+0000","last_became_active":"2024-04-15T00:21:07.568724+0000","last_became_peered":"2024-04-15T00:21:07.568724+0000","last_unstale":"2024-04-15T00:29:11.454494+0000","last_undegraded":"2024-04-15T00:29:11.454494+0000","last_fullsized":"2024-04-15T00:29:11.454494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:21:35.113136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'12","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.999993+0000","last_change":"2024-04-15T00:21:08.598196+0000","last_active":"2024-04-15T00:31:40.999993+0000","last_peered":"2024-04-15T00:31:40.999993+0000","last_clean":"2024-04-15T00:31:40.999993+0000","last_became_active":"2024-04-15T00:21:08.597625+0000","last_became_peered":"2024-04-15T00:21:08.597625+0000","last_unstale":"2024-04-15T00:31:40.999993+0000","last_undegraded":"2024-04-15T00:31:40.999993+0000","last_fullsized":"2024-04-15T00:31:40.999993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'864","reported_seq":886,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.174953+0000","last_change":"2024-04-15T00:21:12.624625+0000","last_active":"2024-04-15T00:31:30.174953+0000","last_peered":"2024-04-15T00:31:30.174953+0000","last_clean":"2024-04-15T00:31:30.174953+0000","last_became_active":"2024-04-15T00:21:12.624222+0000","last_became_peered":"2024-04-15T00:21:12.624222+0000","last_unstale":"2024-04-15T00:31:30.174953+0000","last_undegraded":"2024-04-15T00:31:30.174953+0000","last_fullsized":"2024-04-15T00:31:30.174953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":864,"log_dups_size":0,"ondisk_log_size":864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:28.534842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432116108,"num_objects":108,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4130,"num_write_kb":438054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'7","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:13.937261+0000","last_change":"2024-04-15T00:21:07.576936+0000","last_active":"2024-04-15T00:29:13.937261+0000","last_peered":"2024-04-15T00:29:13.937261+0000","last_clean":"2024-04-15T00:29:13.937261+0000","last_became_active":"2024-04-15T00:21:07.576674+0000","last_became_peered":"2024-04-15T00:21:07.576674+0000","last_unstale":"2024-04-15T00:29:13.937261+0000","last_undegraded":"2024-04-15T00:29:13.937261+0000","last_fullsized":"2024-04-15T00:29:13.937261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:40.459416+0000","last_change":"2024-04-15T00:21:08.587098+0000","last_active":"2024-04-15T00:28:40.459416+0000","last_peered":"2024-04-15T00:28:40.459416+0000","last_clean":"2024-04-15T00:28:40.459416+0000","last_became_active":"2024-04-15T00:21:08.586825+0000","last_became_peered":"2024-04-15T00:21:08.586825+0000","last_unstale":"2024-04-15T00:28:40.459416+0000","last_undegraded":"2024-04-15T00:28:40.459416+0000","last_fullsized":"2024-04-15T00:28:40.459416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:30.470116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'1019","reported_seq":1041,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.357740+0000","last_change":"2024-04-15T00:21:12.619903+0000","last_active":"2024-04-15T00:31:30.357740+0000","last_peered":"2024-04-15T00:31:30.357740+0000","last_clean":"2024-04-15T00:31:30.357740+0000","last_became_active":"2024-04-15T00:21:12.619259+0000","last_became_peered":"2024-04-15T00:21:12.619259+0000","last_unstale":"2024-04-15T00:31:30.357740+0000","last_undegraded":"2024-04-15T00:31:30.357740+0000","last_fullsized":"2024-04-15T00:31:30.357740+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1019,"log_dups_size":0,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:31.463828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411101590,"num_objects":106,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4869,"num_write_kb":420502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'4","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:13.316381+0000","last_change":"2024-04-15T00:21:07.579089+0000","last_active":"2024-04-15T00:29:13.316381+0000","last_peered":"2024-04-15T00:29:13.316381+0000","last_clean":"2024-04-15T00:29:13.316381+0000","last_became_active":"2024-04-15T00:21:07.578733+0000","last_became_peered":"2024-04-15T00:21:07.578733+0000","last_unstale":"2024-04-15T00:29:13.316381+0000","last_undegraded":"2024-04-15T00:29:13.316381+0000","last_fullsized":"2024-04-15T00:29:13.316381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:44:30.015803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:40.459434+0000","last_change":"2024-04-15T00:21:08.588235+0000","last_active":"2024-04-15T00:28:40.459434+0000","last_peered":"2024-04-15T00:28:40.459434+0000","last_clean":"2024-04-15T00:28:40.459434+0000","last_became_active":"2024-04-15T00:21:08.587951+0000","last_became_peered":"2024-04-15T00:21:08.587951+0000","last_unstale":"2024-04-15T00:28:40.459434+0000","last_undegraded":"2024-04-15T00:28:40.459434+0000","last_fullsized":"2024-04-15T00:28:40.459434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:08.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'897","reported_seq":919,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.101297+0000","last_change":"2024-04-15T00:21:12.613395+0000","last_active":"2024-04-15T00:31:30.101297+0000","last_peered":"2024-04-15T00:31:30.101297+0000","last_clean":"2024-04-15T00:31:30.101297+0000","last_became_active":"2024-04-15T00:21:12.612976+0000","last_became_peered":"2024-04-15T00:21:12.612976+0000","last_unstale":"2024-04-15T00:31:30.101297+0000","last_undegraded":"2024-04-15T00:31:30.101297+0000","last_fullsized":"2024-04-15T00:31:30.101297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":897,"log_dups_size":0,"ondisk_log_size":897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:05.044024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360723173,"num_objects":88,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4357,"num_write_kb":369330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:40.453065+0000","last_change":"2024-04-15T00:21:08.585248+0000","last_active":"2024-04-15T00:27:40.453065+0000","last_peered":"2024-04-15T00:27:40.453065+0000","last_clean":"2024-04-15T00:27:40.453065+0000","last_became_active":"2024-04-15T00:21:08.584882+0000","last_became_peered":"2024-04-15T00:21:08.584882+0000","last_unstale":"2024-04-15T00:27:40.453065+0000","last_undegraded":"2024-04-15T00:27:40.453065+0000","last_fullsized":"2024-04-15T00:27:40.453065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:27:41.268464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'848","reported_seq":878,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:31.961219+0000","last_change":"2024-04-15T00:21:07.580541+0000","last_active":"2024-04-15T00:31:31.961219+0000","last_peered":"2024-04-15T00:31:31.961219+0000","last_clean":"2024-04-15T00:31:31.961219+0000","last_became_active":"2024-04-15T00:21:07.580229+0000","last_became_peered":"2024-04-15T00:21:07.580229+0000","last_unstale":"2024-04-15T00:31:31.961219+0000","last_undegraded":"2024-04-15T00:31:31.961219+0000","last_fullsized":"2024-04-15T00:31:31.961219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:34:26.325595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2948310,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":847,"num_write_kb":3058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'817","reported_seq":839,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.023590+0000","last_change":"2024-04-15T00:21:12.624175+0000","last_active":"2024-04-15T00:31:30.023590+0000","last_peered":"2024-04-15T00:31:30.023590+0000","last_clean":"2024-04-15T00:31:30.023590+0000","last_became_active":"2024-04-15T00:21:12.623783+0000","last_became_peered":"2024-04-15T00:21:12.623783+0000","last_unstale":"2024-04-15T00:31:30.023590+0000","last_undegraded":"2024-04-15T00:31:30.023590+0000","last_fullsized":"2024-04-15T00:31:30.023590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:22:04.031788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":419652210,"num_objects":107,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4013,"num_write_kb":425701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'8","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:56.448391+0000","last_change":"2024-04-15T00:21:08.594955+0000","last_active":"2024-04-15T00:27:56.448391+0000","last_peered":"2024-04-15T00:27:56.448391+0000","last_clean":"2024-04-15T00:27:56.448391+0000","last_became_active":"2024-04-15T00:21:08.594535+0000","last_became_peered":"2024-04-15T00:21:08.594535+0000","last_unstale":"2024-04-15T00:27:56.448391+0000","last_undegraded":"2024-04-15T00:27:56.448391+0000","last_fullsized":"2024-04-15T00:27:56.448391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:40.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:40.456499+0000","last_change":"2024-04-15T00:21:07.570862+0000","last_active":"2024-04-15T00:27:40.456499+0000","last_peered":"2024-04-15T00:27:40.456499+0000","last_clean":"2024-04-15T00:27:40.456499+0000","last_became_active":"2024-04-15T00:21:07.570555+0000","last_became_peered":"2024-04-15T00:21:07.570555+0000","last_unstale":"2024-04-15T00:27:40.456499+0000","last_undegraded":"2024-04-15T00:27:40.456499+0000","last_fullsized":"2024-04-15T00:27:40.456499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:54.810223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'900","reported_seq":929,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.386105+0000","last_change":"2024-04-15T00:21:50.135837+0000","last_active":"2024-04-15T00:31:30.386105+0000","last_peered":"2024-04-15T00:31:30.386105+0000","last_clean":"2024-04-15T00:31:30.386105+0000","last_became_active":"2024-04-15T00:21:50.135204+0000","last_became_peered":"2024-04-15T00:21:50.135204+0000","last_unstale":"2024-04-15T00:31:30.386105+0000","last_undegraded":"2024-04-15T00:31:30.386105+0000","last_fullsized":"2024-04-15T00:31:30.386105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:15:08.738300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423642109,"num_objects":107,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4534,"num_write_kb":431423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'8","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:41.447068+0000","last_change":"2024-04-15T00:21:08.574901+0000","last_active":"2024-04-15T00:27:41.447068+0000","last_peered":"2024-04-15T00:27:41.447068+0000","last_clean":"2024-04-15T00:27:41.447068+0000","last_became_active":"2024-04-15T00:21:08.574536+0000","last_became_peered":"2024-04-15T00:21:08.574536+0000","last_unstale":"2024-04-15T00:27:41.447068+0000","last_undegraded":"2024-04-15T00:27:41.447068+0000","last_fullsized":"2024-04-15T00:27:41.447068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:08.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:40.456476+0000","last_change":"2024-04-15T00:21:07.577048+0000","last_active":"2024-04-15T00:27:40.456476+0000","last_peered":"2024-04-15T00:27:40.456476+0000","last_clean":"2024-04-15T00:27:40.456476+0000","last_became_active":"2024-04-15T00:21:07.576739+0000","last_became_peered":"2024-04-15T00:21:07.576739+0000","last_unstale":"2024-04-15T00:27:40.456476+0000","last_undegraded":"2024-04-15T00:27:40.456476+0000","last_fullsized":"2024-04-15T00:27:40.456476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:14.441186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'1173","reported_seq":1195,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.552356+0000","last_change":"2024-04-15T00:21:12.632213+0000","last_active":"2024-04-15T00:31:32.552356+0000","last_peered":"2024-04-15T00:31:32.552356+0000","last_clean":"2024-04-15T00:31:32.552356+0000","last_became_active":"2024-04-15T00:21:12.631900+0000","last_became_peered":"2024-04-15T00:21:12.631900+0000","last_unstale":"2024-04-15T00:31:32.552356+0000","last_undegraded":"2024-04-15T00:31:32.552356+0000","last_fullsized":"2024-04-15T00:31:32.552356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1173,"log_dups_size":0,"ondisk_log_size":1173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:52:31.142377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":507526656,"num_objects":125,"num_object_clones":0,"num_object_copies":500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5839,"num_write_kb":518448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:40.467738+0000","last_change":"2024-04-15T00:21:08.590270+0000","last_active":"2024-04-15T00:27:40.467738+0000","last_peered":"2024-04-15T00:27:40.467738+0000","last_clean":"2024-04-15T00:27:40.467738+0000","last_became_active":"2024-04-15T00:21:08.589960+0000","last_became_peered":"2024-04-15T00:21:08.589960+0000","last_unstale":"2024-04-15T00:27:40.467738+0000","last_undegraded":"2024-04-15T00:27:40.467738+0000","last_fullsized":"2024-04-15T00:27:40.467738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:52.880065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:40.459480+0000","last_change":"2024-04-15T00:21:07.577518+0000","last_active":"2024-04-15T00:27:40.459480+0000","last_peered":"2024-04-15T00:27:40.459480+0000","last_clean":"2024-04-15T00:27:40.459480+0000","last_became_active":"2024-04-15T00:21:07.576961+0000","last_became_peered":"2024-04-15T00:21:07.576961+0000","last_unstale":"2024-04-15T00:27:40.459480+0000","last_undegraded":"2024-04-15T00:27:40.459480+0000","last_fullsized":"2024-04-15T00:27:40.459480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:14.441186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'743","reported_seq":772,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.215032+0000","last_change":"2024-04-15T00:21:50.136014+0000","last_active":"2024-04-15T00:31:30.215032+0000","last_peered":"2024-04-15T00:31:30.215032+0000","last_clean":"2024-04-15T00:31:30.215032+0000","last_became_active":"2024-04-15T00:21:50.135523+0000","last_became_peered":"2024-04-15T00:21:50.135523+0000","last_unstale":"2024-04-15T00:31:30.215032+0000","last_undegraded":"2024-04-15T00:31:30.215032+0000","last_fullsized":"2024-04-15T00:31:30.215032+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:29.469506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373416048,"num_objects":97,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3682,"num_write_kb":379037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'20","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.998655+0000","last_change":"2024-04-15T00:21:08.601349+0000","last_active":"2024-04-15T00:31:40.998655+0000","last_peered":"2024-04-15T00:31:40.998655+0000","last_clean":"2024-04-15T00:31:40.998655+0000","last_became_active":"2024-04-15T00:21:08.601048+0000","last_became_peered":"2024-04-15T00:21:08.601048+0000","last_unstale":"2024-04-15T00:31:40.998655+0000","last_undegraded":"2024-04-15T00:31:40.998655+0000","last_fullsized":"2024-04-15T00:31:40.998655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:27:41.268464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'4","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:40.453118+0000","last_change":"2024-04-15T00:21:07.577793+0000","last_active":"2024-04-15T00:27:40.453118+0000","last_peered":"2024-04-15T00:27:40.453118+0000","last_clean":"2024-04-15T00:27:40.453118+0000","last_became_active":"2024-04-15T00:21:07.577472+0000","last_became_peered":"2024-04-15T00:21:07.577472+0000","last_unstale":"2024-04-15T00:27:40.453118+0000","last_undegraded":"2024-04-15T00:27:40.453118+0000","last_fullsized":"2024-04-15T00:27:40.453118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:54.810223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'847","reported_seq":870,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.090056+0000","last_change":"2024-04-15T00:21:12.634814+0000","last_active":"2024-04-15T00:31:30.090056+0000","last_peered":"2024-04-15T00:31:30.090056+0000","last_clean":"2024-04-15T00:31:30.090056+0000","last_became_active":"2024-04-15T00:21:12.633228+0000","last_became_peered":"2024-04-15T00:21:12.633228+0000","last_unstale":"2024-04-15T00:31:30.090056+0000","last_undegraded":"2024-04-15T00:31:30.090056+0000","last_fullsized":"2024-04-15T00:31:30.090056+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:13.312501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411134922,"num_objects":101,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3991,"num_write_kb":416955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'13","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.988463+0000","last_change":"2024-04-15T00:21:49.708455+0000","last_active":"2024-04-15T00:31:40.988463+0000","last_peered":"2024-04-15T00:31:40.988463+0000","last_clean":"2024-04-15T00:31:40.988463+0000","last_became_active":"2024-04-15T00:21:49.708106+0000","last_became_peered":"2024-04-15T00:21:49.708106+0000","last_unstale":"2024-04-15T00:31:40.988463+0000","last_undegraded":"2024-04-15T00:31:40.988463+0000","last_fullsized":"2024-04-15T00:31:40.988463+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:04:14.156671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"27'322","reported_seq":352,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:35.662989+0000","last_change":"2024-04-15T00:21:07.573285+0000","last_active":"2024-04-15T00:31:35.662989+0000","last_peered":"2024-04-15T00:31:35.662989+0000","last_clean":"2024-04-15T00:31:35.662989+0000","last_became_active":"2024-04-15T00:21:07.572973+0000","last_became_peered":"2024-04-15T00:21:07.572973+0000","last_unstale":"2024-04-15T00:31:35.662989+0000","last_undegraded":"2024-04-15T00:31:35.662989+0000","last_fullsized":"2024-04-15T00:31:35.662989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":665,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'847","reported_seq":870,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.320976+0000","last_change":"2024-04-15T00:21:12.633602+0000","last_active":"2024-04-15T00:31:32.320976+0000","last_peered":"2024-04-15T00:31:32.320976+0000","last_clean":"2024-04-15T00:31:32.320976+0000","last_became_active":"2024-04-15T00:21:12.633178+0000","last_became_peered":"2024-04-15T00:21:12.633178+0000","last_unstale":"2024-04-15T00:31:32.320976+0000","last_undegraded":"2024-04-15T00:31:32.320976+0000","last_fullsized":"2024-04-15T00:31:32.320976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:01:48.959493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448855783,"num_objects":113,"num_object_clones":0,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4294,"num_write_kb":455043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'14","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.002998+0000","last_change":"2024-04-15T00:21:08.580727+0000","last_active":"2024-04-15T00:31:41.002998+0000","last_peered":"2024-04-15T00:31:41.002998+0000","last_clean":"2024-04-15T00:31:41.002998+0000","last_became_active":"2024-04-15T00:21:08.580418+0000","last_became_peered":"2024-04-15T00:21:08.580418+0000","last_unstale":"2024-04-15T00:31:41.002998+0000","last_undegraded":"2024-04-15T00:31:41.002998+0000","last_fullsized":"2024-04-15T00:31:41.002998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'1","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.470869+0000","last_change":"2024-04-15T00:21:07.575864+0000","last_active":"2024-04-15T00:29:30.470869+0000","last_peered":"2024-04-15T00:29:30.470869+0000","last_clean":"2024-04-15T00:29:30.470869+0000","last_became_active":"2024-04-15T00:21:07.575562+0000","last_became_peered":"2024-04-15T00:21:07.575562+0000","last_unstale":"2024-04-15T00:29:30.470869+0000","last_undegraded":"2024-04-15T00:29:30.470869+0000","last_fullsized":"2024-04-15T00:29:30.470869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:35:39.009511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'992","reported_seq":1015,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.362666+0000","last_change":"2024-04-15T00:21:12.633674+0000","last_active":"2024-04-15T00:31:30.362666+0000","last_peered":"2024-04-15T00:31:30.362666+0000","last_clean":"2024-04-15T00:31:30.362666+0000","last_became_active":"2024-04-15T00:21:12.633277+0000","last_became_peered":"2024-04-15T00:21:12.633277+0000","last_unstale":"2024-04-15T00:31:30.362666+0000","last_undegraded":"2024-04-15T00:31:30.362666+0000","last_fullsized":"2024-04-15T00:31:30.362666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":992,"log_dups_size":0,"ondisk_log_size":992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:49.295552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":382066035,"num_objects":93,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4954,"num_write_kb":392450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'6","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.464590+0000","last_change":"2024-04-15T00:21:08.578321+0000","last_active":"2024-04-15T00:29:30.464590+0000","last_peered":"2024-04-15T00:29:30.464590+0000","last_clean":"2024-04-15T00:29:30.464590+0000","last_became_active":"2024-04-15T00:21:08.578017+0000","last_became_peered":"2024-04-15T00:21:08.578017+0000","last_unstale":"2024-04-15T00:29:30.464590+0000","last_undegraded":"2024-04-15T00:29:30.464590+0000","last_fullsized":"2024-04-15T00:29:30.464590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:40.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.465258+0000","last_change":"2024-04-15T00:21:07.575183+0000","last_active":"2024-04-15T00:29:30.465258+0000","last_peered":"2024-04-15T00:29:30.465258+0000","last_clean":"2024-04-15T00:29:30.465258+0000","last_became_active":"2024-04-15T00:21:07.574822+0000","last_became_peered":"2024-04-15T00:21:07.574822+0000","last_unstale":"2024-04-15T00:29:30.465258+0000","last_undegraded":"2024-04-15T00:29:30.465258+0000","last_fullsized":"2024-04-15T00:29:30.465258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:26:22.612110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'1180","reported_seq":1203,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:33.170887+0000","last_change":"2024-04-15T00:21:12.620150+0000","last_active":"2024-04-15T00:31:33.170887+0000","last_peered":"2024-04-15T00:31:33.170887+0000","last_clean":"2024-04-15T00:31:33.170887+0000","last_became_active":"2024-04-15T00:21:12.619694+0000","last_became_peered":"2024-04-15T00:21:12.619694+0000","last_unstale":"2024-04-15T00:31:33.170887+0000","last_undegraded":"2024-04-15T00:31:33.170887+0000","last_fullsized":"2024-04-15T00:31:33.170887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1180,"log_dups_size":0,"ondisk_log_size":1180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:34.506827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474051932,"num_objects":120,"num_object_clones":0,"num_object_copies":480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":120,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5768,"num_write_kb":485640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'6","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.479223+0000","last_change":"2024-04-15T00:21:08.596959+0000","last_active":"2024-04-15T00:29:30.479223+0000","last_peered":"2024-04-15T00:29:30.479223+0000","last_clean":"2024-04-15T00:29:30.479223+0000","last_became_active":"2024-04-15T00:21:08.596678+0000","last_became_peered":"2024-04-15T00:21:08.596678+0000","last_unstale":"2024-04-15T00:29:30.479223+0000","last_undegraded":"2024-04-15T00:29:30.479223+0000","last_fullsized":"2024-04-15T00:29:30.479223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:35:40.014598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.464535+0000","last_change":"2024-04-15T00:21:07.574514+0000","last_active":"2024-04-15T00:29:30.464535+0000","last_peered":"2024-04-15T00:29:30.464535+0000","last_clean":"2024-04-15T00:29:30.464535+0000","last_became_active":"2024-04-15T00:21:07.574228+0000","last_became_peered":"2024-04-15T00:21:07.574228+0000","last_unstale":"2024-04-15T00:29:30.464535+0000","last_undegraded":"2024-04-15T00:29:30.464535+0000","last_fullsized":"2024-04-15T00:29:30.464535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'1049","reported_seq":1072,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.015692+0000","last_change":"2024-04-15T00:21:12.619733+0000","last_active":"2024-04-15T00:31:32.015692+0000","last_peered":"2024-04-15T00:31:32.015692+0000","last_clean":"2024-04-15T00:31:32.015692+0000","last_became_active":"2024-04-15T00:21:12.619307+0000","last_became_peered":"2024-04-15T00:21:12.619307+0000","last_unstale":"2024-04-15T00:31:32.015692+0000","last_undegraded":"2024-04-15T00:31:32.015692+0000","last_fullsized":"2024-04-15T00:31:32.015692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1049,"log_dups_size":0,"ondisk_log_size":1049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:48:00.696018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415249523,"num_objects":103,"num_object_clones":0,"num_object_copies":412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5497,"num_write_kb":427157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'18","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.997049+0000","last_change":"2024-04-15T00:21:08.589246+0000","last_active":"2024-04-15T00:31:40.997049+0000","last_peered":"2024-04-15T00:31:40.997049+0000","last_clean":"2024-04-15T00:31:40.997049+0000","last_became_active":"2024-04-15T00:21:08.588920+0000","last_became_peered":"2024-04-15T00:21:08.588920+0000","last_unstale":"2024-04-15T00:31:40.997049+0000","last_undegraded":"2024-04-15T00:31:40.997049+0000","last_fullsized":"2024-04-15T00:31:40.997049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'37","reported_seq":104,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:31.451426+0000","last_change":"2024-04-15T00:21:07.566537+0000","last_active":"2024-04-15T00:29:31.451426+0000","last_peered":"2024-04-15T00:29:31.451426+0000","last_clean":"2024-04-15T00:29:31.451426+0000","last_became_active":"2024-04-15T00:21:07.566240+0000","last_became_peered":"2024-04-15T00:21:07.566240+0000","last_unstale":"2024-04-15T00:29:31.451426+0000","last_undegraded":"2024-04-15T00:29:31.451426+0000","last_fullsized":"2024-04-15T00:29:31.451426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:16:52.647503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50889,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":72,"num_write":36,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'862","reported_seq":884,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.536387+0000","last_change":"2024-04-15T00:21:12.623452+0000","last_active":"2024-04-15T00:31:32.536387+0000","last_peered":"2024-04-15T00:31:32.536387+0000","last_clean":"2024-04-15T00:31:32.536387+0000","last_became_active":"2024-04-15T00:21:12.623066+0000","last_became_peered":"2024-04-15T00:21:12.623066+0000","last_unstale":"2024-04-15T00:31:32.536387+0000","last_undegraded":"2024-04-15T00:31:32.536387+0000","last_fullsized":"2024-04-15T00:31:32.536387+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:11:16.107864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":453040013,"num_objects":117,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4260,"num_write_kb":459037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'8","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.991863+0000","last_change":"2024-04-15T00:21:08.586376+0000","last_active":"2024-04-15T00:31:40.991863+0000","last_peered":"2024-04-15T00:31:40.991863+0000","last_clean":"2024-04-15T00:31:40.991863+0000","last_became_active":"2024-04-15T00:21:08.586054+0000","last_became_peered":"2024-04-15T00:21:08.586054+0000","last_unstale":"2024-04-15T00:31:40.991863+0000","last_undegraded":"2024-04-15T00:31:40.991863+0000","last_fullsized":"2024-04-15T00:31:40.991863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:02:56.329428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:10.468749+0000","last_change":"2024-04-15T00:21:07.577289+0000","last_active":"2024-04-15T00:29:10.468749+0000","last_peered":"2024-04-15T00:29:10.468749+0000","last_clean":"2024-04-15T00:29:10.468749+0000","last_became_active":"2024-04-15T00:21:07.576602+0000","last_became_peered":"2024-04-15T00:21:07.576602+0000","last_unstale":"2024-04-15T00:29:10.468749+0000","last_undegraded":"2024-04-15T00:29:10.468749+0000","last_fullsized":"2024-04-15T00:29:10.468749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:26:22.612110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'902","reported_seq":924,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.470317+0000","last_change":"2024-04-15T00:21:12.634248+0000","last_active":"2024-04-15T00:31:30.470317+0000","last_peered":"2024-04-15T00:31:30.470317+0000","last_clean":"2024-04-15T00:31:30.470317+0000","last_became_active":"2024-04-15T00:21:12.633239+0000","last_became_peered":"2024-04-15T00:21:12.633239+0000","last_unstale":"2024-04-15T00:31:30.470317+0000","last_undegraded":"2024-04-15T00:31:30.470317+0000","last_fullsized":"2024-04-15T00:31:30.470317+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:52:31.142377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356541982,"num_objects":92,"num_object_clones":0,"num_object_copies":368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4244,"num_write_kb":364740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'4","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:31.462298+0000","last_change":"2024-04-15T00:21:08.591060+0000","last_active":"2024-04-15T00:29:31.462298+0000","last_peered":"2024-04-15T00:29:31.462298+0000","last_clean":"2024-04-15T00:29:31.462298+0000","last_became_active":"2024-04-15T00:21:08.590781+0000","last_became_peered":"2024-04-15T00:21:08.590781+0000","last_unstale":"2024-04-15T00:29:31.462298+0000","last_undegraded":"2024-04-15T00:29:31.462298+0000","last_fullsized":"2024-04-15T00:29:31.462298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.464552+0000","last_change":"2024-04-15T00:21:07.573617+0000","last_active":"2024-04-15T00:29:30.464552+0000","last_peered":"2024-04-15T00:29:30.464552+0000","last_clean":"2024-04-15T00:29:30.464552+0000","last_became_active":"2024-04-15T00:21:07.573308+0000","last_became_peered":"2024-04-15T00:21:07.573308+0000","last_unstale":"2024-04-15T00:29:30.464552+0000","last_undegraded":"2024-04-15T00:29:30.464552+0000","last_fullsized":"2024-04-15T00:29:30.464552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:36:11.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":187,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:00.467601+0000","last_change":"2024-04-15T00:20:57.937516+0000","last_active":"2024-04-15T00:29:00.467601+0000","last_peered":"2024-04-15T00:29:00.467601+0000","last_clean":"2024-04-15T00:29:00.467601+0000","last_became_active":"2024-04-15T00:20:57.936329+0000","last_became_peered":"2024-04-15T00:20:57.936329+0000","last_unstale":"2024-04-15T00:29:00.467601+0000","last_undegraded":"2024-04-15T00:29:00.467601+0000","last_fullsized":"2024-04-15T00:29:00.467601+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:20:56.517419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:20:56.517419+0000","last_clean_scrub_stamp":"2024-04-15T00:20:56.517419+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:07:23.949459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'923","reported_seq":946,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.464035+0000","last_change":"2024-04-15T00:21:12.633530+0000","last_active":"2024-04-15T00:31:30.464035+0000","last_peered":"2024-04-15T00:31:30.464035+0000","last_clean":"2024-04-15T00:31:30.464035+0000","last_became_active":"2024-04-15T00:21:12.633124+0000","last_became_peered":"2024-04-15T00:21:12.633124+0000","last_unstale":"2024-04-15T00:31:30.464035+0000","last_undegraded":"2024-04-15T00:31:30.464035+0000","last_fullsized":"2024-04-15T00:31:30.464035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":923,"log_dups_size":0,"ondisk_log_size":923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:49.295552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406896485,"num_objects":106,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4652,"num_write_kb":415602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:55.460924+0000","last_change":"2024-04-15T00:21:08.583443+0000","last_active":"2024-04-15T00:27:55.460924+0000","last_peered":"2024-04-15T00:27:55.460924+0000","last_clean":"2024-04-15T00:27:55.460924+0000","last_became_active":"2024-04-15T00:21:08.583143+0000","last_became_peered":"2024-04-15T00:21:08.583143+0000","last_unstale":"2024-04-15T00:27:55.460924+0000","last_undegraded":"2024-04-15T00:27:55.460924+0000","last_fullsized":"2024-04-15T00:27:55.460924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:01.007313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:56.444232+0000","last_change":"2024-04-15T00:21:07.579386+0000","last_active":"2024-04-15T00:27:56.444232+0000","last_peered":"2024-04-15T00:27:56.444232+0000","last_clean":"2024-04-15T00:27:56.444232+0000","last_became_active":"2024-04-15T00:21:07.579024+0000","last_became_peered":"2024-04-15T00:21:07.579024+0000","last_unstale":"2024-04-15T00:27:56.444232+0000","last_undegraded":"2024-04-15T00:27:56.444232+0000","last_fullsized":"2024-04-15T00:27:56.444232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:36:11.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'783","reported_seq":805,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.088053+0000","last_change":"2024-04-15T00:21:12.635286+0000","last_active":"2024-04-15T00:31:30.088053+0000","last_peered":"2024-04-15T00:31:30.088053+0000","last_clean":"2024-04-15T00:31:30.088053+0000","last_became_active":"2024-04-15T00:21:12.634689+0000","last_became_peered":"2024-04-15T00:21:12.634689+0000","last_unstale":"2024-04-15T00:31:30.088053+0000","last_undegraded":"2024-04-15T00:31:30.088053+0000","last_fullsized":"2024-04-15T00:31:30.088053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:05.044024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":419485282,"num_objects":105,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3792,"num_write_kb":424412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'13","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.005678+0000","last_change":"2024-04-15T00:21:49.708583+0000","last_active":"2024-04-15T00:31:41.005678+0000","last_peered":"2024-04-15T00:31:41.005678+0000","last_clean":"2024-04-15T00:31:41.005678+0000","last_became_active":"2024-04-15T00:21:49.708252+0000","last_became_peered":"2024-04-15T00:21:49.708252+0000","last_unstale":"2024-04-15T00:31:41.005678+0000","last_undegraded":"2024-04-15T00:31:41.005678+0000","last_fullsized":"2024-04-15T00:31:41.005678+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:01.007313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:55.457685+0000","last_change":"2024-04-15T00:21:07.571553+0000","last_active":"2024-04-15T00:27:55.457685+0000","last_peered":"2024-04-15T00:27:55.457685+0000","last_clean":"2024-04-15T00:27:55.457685+0000","last_became_active":"2024-04-15T00:21:07.571238+0000","last_became_peered":"2024-04-15T00:21:07.571238+0000","last_unstale":"2024-04-15T00:27:55.457685+0000","last_undegraded":"2024-04-15T00:27:55.457685+0000","last_fullsized":"2024-04-15T00:27:55.457685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:35:39.009511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'910","reported_seq":932,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.379637+0000","last_change":"2024-04-15T00:21:12.619646+0000","last_active":"2024-04-15T00:31:30.379637+0000","last_peered":"2024-04-15T00:31:30.379637+0000","last_clean":"2024-04-15T00:31:30.379637+0000","last_became_active":"2024-04-15T00:21:12.619263+0000","last_became_peered":"2024-04-15T00:21:12.619263+0000","last_unstale":"2024-04-15T00:31:30.379637+0000","last_undegraded":"2024-04-15T00:31:30.379637+0000","last_fullsized":"2024-04-15T00:31:30.379637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:31.463828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394550963,"num_objects":102,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4303,"num_write_kb":402124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'8","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:55.461007+0000","last_change":"2024-04-15T00:21:08.599410+0000","last_active":"2024-04-15T00:27:55.461007+0000","last_peered":"2024-04-15T00:27:55.461007+0000","last_clean":"2024-04-15T00:27:55.461007+0000","last_became_active":"2024-04-15T00:21:08.599132+0000","last_became_peered":"2024-04-15T00:21:08.599132+0000","last_unstale":"2024-04-15T00:27:55.461007+0000","last_undegraded":"2024-04-15T00:27:55.461007+0000","last_fullsized":"2024-04-15T00:27:55.461007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:47:56.659307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'3","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:56.444256+0000","last_change":"2024-04-15T00:21:07.567917+0000","last_active":"2024-04-15T00:27:56.444256+0000","last_peered":"2024-04-15T00:27:56.444256+0000","last_clean":"2024-04-15T00:27:56.444256+0000","last_became_active":"2024-04-15T00:21:07.567673+0000","last_became_peered":"2024-04-15T00:21:07.567673+0000","last_unstale":"2024-04-15T00:27:56.444256+0000","last_undegraded":"2024-04-15T00:27:56.444256+0000","last_fullsized":"2024-04-15T00:27:56.444256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:54.810223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'711","reported_seq":733,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.109666+0000","last_change":"2024-04-15T00:21:12.632937+0000","last_active":"2024-04-15T00:31:30.109666+0000","last_peered":"2024-04-15T00:31:30.109666+0000","last_clean":"2024-04-15T00:31:30.109666+0000","last_became_active":"2024-04-15T00:21:12.632508+0000","last_became_peered":"2024-04-15T00:21:12.632508+0000","last_unstale":"2024-04-15T00:31:30.109666+0000","last_undegraded":"2024-04-15T00:31:30.109666+0000","last_fullsized":"2024-04-15T00:31:30.109666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:07:36.246879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":385889695,"num_objects":96,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3516,"num_write_kb":390521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:55.460975+0000","last_change":"2024-04-15T00:21:08.600430+0000","last_active":"2024-04-15T00:27:55.460975+0000","last_peered":"2024-04-15T00:27:55.460975+0000","last_clean":"2024-04-15T00:27:55.460975+0000","last_became_active":"2024-04-15T00:21:08.600142+0000","last_became_peered":"2024-04-15T00:21:08.600142+0000","last_unstale":"2024-04-15T00:27:55.460975+0000","last_undegraded":"2024-04-15T00:27:55.460975+0000","last_fullsized":"2024-04-15T00:27:55.460975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:30.470116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:55.469451+0000","last_change":"2024-04-15T00:21:07.576781+0000","last_active":"2024-04-15T00:27:55.469451+0000","last_peered":"2024-04-15T00:27:55.469451+0000","last_clean":"2024-04-15T00:27:55.469451+0000","last_became_active":"2024-04-15T00:21:07.576491+0000","last_became_peered":"2024-04-15T00:21:07.576491+0000","last_unstale":"2024-04-15T00:27:55.469451+0000","last_undegraded":"2024-04-15T00:27:55.469451+0000","last_fullsized":"2024-04-15T00:27:55.469451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:41:31.846500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'793","reported_seq":815,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.146293+0000","last_change":"2024-04-15T00:21:12.620247+0000","last_active":"2024-04-15T00:31:30.146293+0000","last_peered":"2024-04-15T00:31:30.146293+0000","last_clean":"2024-04-15T00:31:30.146293+0000","last_became_active":"2024-04-15T00:21:12.619257+0000","last_became_peered":"2024-04-15T00:21:12.619257+0000","last_unstale":"2024-04-15T00:31:30.146293+0000","last_undegraded":"2024-04-15T00:31:30.146293+0000","last_fullsized":"2024-04-15T00:31:30.146293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:44.287619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398629714,"num_objects":100,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3893,"num_write_kb":404464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'9","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:10.462737+0000","last_change":"2024-04-15T00:21:08.590732+0000","last_active":"2024-04-15T00:28:10.462737+0000","last_peered":"2024-04-15T00:28:10.462737+0000","last_clean":"2024-04-15T00:28:10.462737+0000","last_became_active":"2024-04-15T00:21:08.590450+0000","last_became_peered":"2024-04-15T00:21:08.590450+0000","last_unstale":"2024-04-15T00:28:10.462737+0000","last_undegraded":"2024-04-15T00:28:10.462737+0000","last_fullsized":"2024-04-15T00:28:10.462737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:10:24.477646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'10","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:11.445299+0000","last_change":"2024-04-15T00:21:07.566984+0000","last_active":"2024-04-15T00:28:11.445299+0000","last_peered":"2024-04-15T00:28:11.445299+0000","last_clean":"2024-04-15T00:28:11.445299+0000","last_became_active":"2024-04-15T00:21:07.566681+0000","last_became_peered":"2024-04-15T00:21:07.566681+0000","last_unstale":"2024-04-15T00:28:11.445299+0000","last_undegraded":"2024-04-15T00:28:11.445299+0000","last_fullsized":"2024-04-15T00:28:11.445299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:21:35.113136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'1080","reported_seq":1102,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.437365+0000","last_change":"2024-04-15T00:21:12.615981+0000","last_active":"2024-04-15T00:31:30.437365+0000","last_peered":"2024-04-15T00:31:30.437365+0000","last_clean":"2024-04-15T00:31:30.437365+0000","last_became_active":"2024-04-15T00:21:12.615577+0000","last_became_peered":"2024-04-15T00:21:12.615577+0000","last_unstale":"2024-04-15T00:31:30.437365+0000","last_undegraded":"2024-04-15T00:31:30.437365+0000","last_fullsized":"2024-04-15T00:31:30.437365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1080,"log_dups_size":0,"ondisk_log_size":1080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:52:14.595303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440503524,"num_objects":114,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5539,"num_write_kb":451979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:10.456403+0000","last_change":"2024-04-15T00:21:08.588266+0000","last_active":"2024-04-15T00:28:10.456403+0000","last_peered":"2024-04-15T00:28:10.456403+0000","last_clean":"2024-04-15T00:28:10.456403+0000","last_became_active":"2024-04-15T00:21:08.587962+0000","last_became_peered":"2024-04-15T00:21:08.587962+0000","last_unstale":"2024-04-15T00:28:10.456403+0000","last_undegraded":"2024-04-15T00:28:10.456403+0000","last_fullsized":"2024-04-15T00:28:10.456403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:10.456423+0000","last_change":"2024-04-15T00:21:07.573664+0000","last_active":"2024-04-15T00:28:10.456423+0000","last_peered":"2024-04-15T00:28:10.456423+0000","last_clean":"2024-04-15T00:28:10.456423+0000","last_became_active":"2024-04-15T00:21:07.573325+0000","last_became_peered":"2024-04-15T00:21:07.573325+0000","last_unstale":"2024-04-15T00:28:10.456423+0000","last_undegraded":"2024-04-15T00:28:10.456423+0000","last_fullsized":"2024-04-15T00:28:10.456423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:16:52.647503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'921","reported_seq":950,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.745387+0000","last_change":"2024-04-15T00:21:50.136384+0000","last_active":"2024-04-15T00:31:32.745387+0000","last_peered":"2024-04-15T00:31:32.745387+0000","last_clean":"2024-04-15T00:31:32.745387+0000","last_became_active":"2024-04-15T00:21:50.135899+0000","last_became_peered":"2024-04-15T00:21:50.135899+0000","last_unstale":"2024-04-15T00:31:32.745387+0000","last_undegraded":"2024-04-15T00:31:32.745387+0000","last_fullsized":"2024-04-15T00:31:32.745387+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:16:56.946948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444634187,"num_objects":110,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4674,"num_write_kb":452484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'10","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:10.462759+0000","last_change":"2024-04-15T00:21:08.593412+0000","last_active":"2024-04-15T00:28:10.462759+0000","last_peered":"2024-04-15T00:28:10.462759+0000","last_clean":"2024-04-15T00:28:10.462759+0000","last_became_active":"2024-04-15T00:21:08.593112+0000","last_became_peered":"2024-04-15T00:21:08.593112+0000","last_unstale":"2024-04-15T00:28:10.462759+0000","last_undegraded":"2024-04-15T00:28:10.462759+0000","last_fullsized":"2024-04-15T00:28:10.462759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:45.258841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:10.456433+0000","last_change":"2024-04-15T00:21:07.576800+0000","last_active":"2024-04-15T00:28:10.456433+0000","last_peered":"2024-04-15T00:28:10.456433+0000","last_clean":"2024-04-15T00:28:10.456433+0000","last_became_active":"2024-04-15T00:21:07.576501+0000","last_became_peered":"2024-04-15T00:21:07.576501+0000","last_unstale":"2024-04-15T00:28:10.456433+0000","last_undegraded":"2024-04-15T00:28:10.456433+0000","last_fullsized":"2024-04-15T00:28:10.456433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:54.810223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'976","reported_seq":998,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:33.308898+0000","last_change":"2024-04-15T00:21:12.634065+0000","last_active":"2024-04-15T00:31:33.308898+0000","last_peered":"2024-04-15T00:31:33.308898+0000","last_clean":"2024-04-15T00:31:33.308898+0000","last_became_active":"2024-04-15T00:21:12.633242+0000","last_became_peered":"2024-04-15T00:21:12.633242+0000","last_unstale":"2024-04-15T00:31:33.308898+0000","last_undegraded":"2024-04-15T00:31:33.308898+0000","last_fullsized":"2024-04-15T00:31:33.308898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":976,"log_dups_size":0,"ondisk_log_size":976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:38:32.207334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":453069136,"num_objects":118,"num_object_clones":0,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4842,"num_write_kb":461390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'19","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.996230+0000","last_change":"2024-04-15T00:21:49.706390+0000","last_active":"2024-04-15T00:31:40.996230+0000","last_peered":"2024-04-15T00:31:40.996230+0000","last_clean":"2024-04-15T00:31:40.996230+0000","last_became_active":"2024-04-15T00:21:49.705916+0000","last_became_peered":"2024-04-15T00:21:49.705916+0000","last_unstale":"2024-04-15T00:31:40.996230+0000","last_undegraded":"2024-04-15T00:31:40.996230+0000","last_fullsized":"2024-04-15T00:31:40.996230+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:10:24.477646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.13","version":"27'4","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:13.316890+0000","last_change":"2024-04-15T00:21:07.573340+0000","last_active":"2024-04-15T00:29:13.316890+0000","last_peered":"2024-04-15T00:29:13.316890+0000","last_clean":"2024-04-15T00:29:13.316890+0000","last_became_active":"2024-04-15T00:21:07.572749+0000","last_became_peered":"2024-04-15T00:21:07.572749+0000","last_unstale":"2024-04-15T00:29:13.316890+0000","last_undegraded":"2024-04-15T00:29:13.316890+0000","last_fullsized":"2024-04-15T00:29:13.316890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:05:06.225337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'1053","reported_seq":1075,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.353159+0000","last_change":"2024-04-15T00:21:12.632412+0000","last_active":"2024-04-15T00:31:30.353159+0000","last_peered":"2024-04-15T00:31:30.353159+0000","last_clean":"2024-04-15T00:31:30.353159+0000","last_became_active":"2024-04-15T00:21:12.631982+0000","last_became_peered":"2024-04-15T00:21:12.631982+0000","last_unstale":"2024-04-15T00:31:30.353159+0000","last_undegraded":"2024-04-15T00:31:30.353159+0000","last_fullsized":"2024-04-15T00:31:30.353159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1053,"log_dups_size":0,"ondisk_log_size":1053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:11:44.674232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402653184,"num_objects":96,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5184,"num_write_kb":413411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'9","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.464106+0000","last_change":"2024-04-15T00:21:08.582822+0000","last_active":"2024-04-15T00:28:25.464106+0000","last_peered":"2024-04-15T00:28:25.464106+0000","last_clean":"2024-04-15T00:28:25.464106+0000","last_became_active":"2024-04-15T00:21:08.582531+0000","last_became_peered":"2024-04-15T00:21:08.582531+0000","last_unstale":"2024-04-15T00:28:25.464106+0000","last_undegraded":"2024-04-15T00:28:25.464106+0000","last_fullsized":"2024-04-15T00:28:25.464106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:21:59.995077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'287","reported_seq":317,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:11.997546+0000","last_change":"2024-04-15T00:21:07.576694+0000","last_active":"2024-04-15T00:31:11.997546+0000","last_peered":"2024-04-15T00:31:11.997546+0000","last_clean":"2024-04-15T00:31:11.997546+0000","last_became_active":"2024-04-15T00:21:07.576380+0000","last_became_peered":"2024-04-15T00:21:07.576380+0000","last_unstale":"2024-04-15T00:31:11.997546+0000","last_undegraded":"2024-04-15T00:31:11.997546+0000","last_fullsized":"2024-04-15T00:31:11.997546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:36:11.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":4242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'986","reported_seq":1008,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:33.149195+0000","last_change":"2024-04-15T00:21:12.620928+0000","last_active":"2024-04-15T00:31:33.149195+0000","last_peered":"2024-04-15T00:31:33.149195+0000","last_clean":"2024-04-15T00:31:33.149195+0000","last_became_active":"2024-04-15T00:21:12.620536+0000","last_became_peered":"2024-04-15T00:21:12.620536+0000","last_unstale":"2024-04-15T00:31:33.149195+0000","last_undegraded":"2024-04-15T00:31:33.149195+0000","last_fullsized":"2024-04-15T00:31:33.149195+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":986,"log_dups_size":0,"ondisk_log_size":986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:52:14.595303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402669397,"num_objects":101,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4803,"num_write_kb":412051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:10.471091+0000","last_change":"2024-04-15T00:21:08.588132+0000","last_active":"2024-04-15T00:28:10.471091+0000","last_peered":"2024-04-15T00:28:10.471091+0000","last_clean":"2024-04-15T00:28:10.471091+0000","last_became_active":"2024-04-15T00:21:08.587383+0000","last_became_peered":"2024-04-15T00:21:08.587383+0000","last_unstale":"2024-04-15T00:28:10.471091+0000","last_undegraded":"2024-04-15T00:28:10.471091+0000","last_fullsized":"2024-04-15T00:28:10.471091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:15.446273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'21","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:13.316687+0000","last_change":"2024-04-15T00:21:07.574695+0000","last_active":"2024-04-15T00:29:13.316687+0000","last_peered":"2024-04-15T00:29:13.316687+0000","last_clean":"2024-04-15T00:29:13.316687+0000","last_became_active":"2024-04-15T00:21:07.574389+0000","last_became_peered":"2024-04-15T00:21:07.574389+0000","last_unstale":"2024-04-15T00:29:13.316687+0000","last_undegraded":"2024-04-15T00:29:13.316687+0000","last_fullsized":"2024-04-15T00:29:13.316687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:34:26.325595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'1044","reported_seq":1066,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.256686+0000","last_change":"2024-04-15T00:21:12.620255+0000","last_active":"2024-04-15T00:31:30.256686+0000","last_peered":"2024-04-15T00:31:30.256686+0000","last_clean":"2024-04-15T00:31:30.256686+0000","last_became_active":"2024-04-15T00:21:12.619218+0000","last_became_peered":"2024-04-15T00:21:12.619218+0000","last_unstale":"2024-04-15T00:31:30.256686+0000","last_undegraded":"2024-04-15T00:31:30.256686+0000","last_fullsized":"2024-04-15T00:31:30.256686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1044,"log_dups_size":0,"ondisk_log_size":1044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:49.295552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423735680,"num_objects":112,"num_object_clones":0,"num_object_copies":448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5284,"num_write_kb":434520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'18","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.991272+0000","last_change":"2024-04-15T00:21:08.597898+0000","last_active":"2024-04-15T00:31:40.991272+0000","last_peered":"2024-04-15T00:31:40.991272+0000","last_clean":"2024-04-15T00:31:40.991272+0000","last_became_active":"2024-04-15T00:21:08.597262+0000","last_became_peered":"2024-04-15T00:21:08.597262+0000","last_unstale":"2024-04-15T00:31:40.991272+0000","last_undegraded":"2024-04-15T00:31:40.991272+0000","last_fullsized":"2024-04-15T00:31:40.991272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.457852+0000","last_change":"2024-04-15T00:21:07.574003+0000","last_active":"2024-04-15T00:28:25.457852+0000","last_peered":"2024-04-15T00:28:25.457852+0000","last_clean":"2024-04-15T00:28:25.457852+0000","last_became_active":"2024-04-15T00:21:07.573469+0000","last_became_peered":"2024-04-15T00:21:07.573469+0000","last_unstale":"2024-04-15T00:28:25.457852+0000","last_undegraded":"2024-04-15T00:28:25.457852+0000","last_fullsized":"2024-04-15T00:28:25.457852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:16:52.647503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'945","reported_seq":967,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.343735+0000","last_change":"2024-04-15T00:21:12.624850+0000","last_active":"2024-04-15T00:31:32.343735+0000","last_peered":"2024-04-15T00:31:32.343735+0000","last_clean":"2024-04-15T00:31:32.343735+0000","last_became_active":"2024-04-15T00:21:12.624484+0000","last_became_peered":"2024-04-15T00:21:12.624484+0000","last_unstale":"2024-04-15T00:31:32.343735+0000","last_undegraded":"2024-04-15T00:31:32.343735+0000","last_fullsized":"2024-04-15T00:31:32.343735+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":945,"log_dups_size":0,"ondisk_log_size":945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:15:08.738300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402666169,"num_objects":101,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4734,"num_write_kb":411824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.457835+0000","last_change":"2024-04-15T00:21:08.591705+0000","last_active":"2024-04-15T00:28:25.457835+0000","last_peered":"2024-04-15T00:28:25.457835+0000","last_clean":"2024-04-15T00:28:25.457835+0000","last_became_active":"2024-04-15T00:21:08.591407+0000","last_became_peered":"2024-04-15T00:21:08.591407+0000","last_unstale":"2024-04-15T00:28:25.457835+0000","last_undegraded":"2024-04-15T00:28:25.457835+0000","last_fullsized":"2024-04-15T00:28:25.457835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.457818+0000","last_change":"2024-04-15T00:21:07.574971+0000","last_active":"2024-04-15T00:28:25.457818+0000","last_peered":"2024-04-15T00:28:25.457818+0000","last_clean":"2024-04-15T00:28:25.457818+0000","last_became_active":"2024-04-15T00:21:07.574656+0000","last_became_peered":"2024-04-15T00:21:07.574656+0000","last_unstale":"2024-04-15T00:28:25.457818+0000","last_undegraded":"2024-04-15T00:28:25.457818+0000","last_fullsized":"2024-04-15T00:28:25.457818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:21:35.113136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'741","reported_seq":763,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.711934+0000","last_change":"2024-04-15T00:21:12.633646+0000","last_active":"2024-04-15T00:31:32.711934+0000","last_peered":"2024-04-15T00:31:32.711934+0000","last_clean":"2024-04-15T00:31:32.711934+0000","last_became_active":"2024-04-15T00:21:12.633262+0000","last_became_peered":"2024-04-15T00:21:12.633262+0000","last_unstale":"2024-04-15T00:31:32.711934+0000","last_undegraded":"2024-04-15T00:31:32.711934+0000","last_fullsized":"2024-04-15T00:31:32.711934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:26:17.136974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":419466538,"num_objects":105,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3547,"num_write_kb":423381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'1101","reported_seq":1124,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.423734+0000","last_change":"2024-04-15T00:21:12.634552+0000","last_active":"2024-04-15T00:31:30.423734+0000","last_peered":"2024-04-15T00:31:30.423734+0000","last_clean":"2024-04-15T00:31:30.423734+0000","last_became_active":"2024-04-15T00:21:12.633824+0000","last_became_peered":"2024-04-15T00:21:12.633824+0000","last_unstale":"2024-04-15T00:31:30.423734+0000","last_undegraded":"2024-04-15T00:31:30.423734+0000","last_fullsized":"2024-04-15T00:31:30.423734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1101,"log_dups_size":0,"ondisk_log_size":1101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:34.506827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482370782,"num_objects":121,"num_object_clones":0,"num_object_copies":484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5837,"num_write_kb":494050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'15","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.007279+0000","last_change":"2024-04-15T00:21:08.577988+0000","last_active":"2024-04-15T00:31:41.007279+0000","last_peered":"2024-04-15T00:31:41.007279+0000","last_clean":"2024-04-15T00:31:41.007279+0000","last_became_active":"2024-04-15T00:21:08.577692+0000","last_became_peered":"2024-04-15T00:21:08.577692+0000","last_unstale":"2024-04-15T00:31:41.007279+0000","last_undegraded":"2024-04-15T00:31:41.007279+0000","last_fullsized":"2024-04-15T00:31:41.007279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.457793+0000","last_change":"2024-04-15T00:21:07.563155+0000","last_active":"2024-04-15T00:28:25.457793+0000","last_peered":"2024-04-15T00:28:25.457793+0000","last_clean":"2024-04-15T00:28:25.457793+0000","last_became_active":"2024-04-15T00:21:07.562747+0000","last_became_peered":"2024-04-15T00:21:07.562747+0000","last_unstale":"2024-04-15T00:28:25.457793+0000","last_undegraded":"2024-04-15T00:28:25.457793+0000","last_fullsized":"2024-04-15T00:28:25.457793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:21:35.113136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'958","reported_seq":981,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.212363+0000","last_change":"2024-04-15T00:21:12.624627+0000","last_active":"2024-04-15T00:31:30.212363+0000","last_peered":"2024-04-15T00:31:30.212363+0000","last_clean":"2024-04-15T00:31:30.212363+0000","last_became_active":"2024-04-15T00:21:12.624245+0000","last_became_peered":"2024-04-15T00:21:12.624245+0000","last_unstale":"2024-04-15T00:31:30.212363+0000","last_undegraded":"2024-04-15T00:31:30.212363+0000","last_fullsized":"2024-04-15T00:31:30.212363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":958,"log_dups_size":0,"ondisk_log_size":958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:31.463828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432096512,"num_objects":111,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4784,"num_write_kb":440700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'14","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:26.450736+0000","last_change":"2024-04-15T00:21:08.590595+0000","last_active":"2024-04-15T00:28:26.450736+0000","last_peered":"2024-04-15T00:28:26.450736+0000","last_clean":"2024-04-15T00:28:26.450736+0000","last_became_active":"2024-04-15T00:21:08.590333+0000","last_became_peered":"2024-04-15T00:21:08.590333+0000","last_unstale":"2024-04-15T00:28:26.450736+0000","last_undegraded":"2024-04-15T00:28:26.450736+0000","last_fullsized":"2024-04-15T00:28:26.450736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:26.450774+0000","last_change":"2024-04-15T00:21:07.576399+0000","last_active":"2024-04-15T00:28:26.450774+0000","last_peered":"2024-04-15T00:28:26.450774+0000","last_clean":"2024-04-15T00:28:26.450774+0000","last_became_active":"2024-04-15T00:21:07.576008+0000","last_became_peered":"2024-04-15T00:21:07.576008+0000","last_unstale":"2024-04-15T00:28:26.450774+0000","last_undegraded":"2024-04-15T00:28:26.450774+0000","last_fullsized":"2024-04-15T00:28:26.450774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:16:52.647503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:40.459371+0000","last_change":"2024-04-15T00:21:07.572597+0000","last_active":"2024-04-15T00:28:40.459371+0000","last_peered":"2024-04-15T00:28:40.459371+0000","last_clean":"2024-04-15T00:28:40.459371+0000","last_became_active":"2024-04-15T00:21:07.572273+0000","last_became_peered":"2024-04-15T00:21:07.572273+0000","last_unstale":"2024-04-15T00:28:40.459371+0000","last_undegraded":"2024-04-15T00:28:40.459371+0000","last_fullsized":"2024-04-15T00:28:40.459371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'16","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.991746+0000","last_change":"2024-04-15T00:21:08.587210+0000","last_active":"2024-04-15T00:31:40.991746+0000","last_peered":"2024-04-15T00:31:40.991746+0000","last_clean":"2024-04-15T00:31:40.991746+0000","last_became_active":"2024-04-15T00:21:08.586910+0000","last_became_peered":"2024-04-15T00:21:08.586910+0000","last_unstale":"2024-04-15T00:31:40.991746+0000","last_undegraded":"2024-04-15T00:31:40.991746+0000","last_fullsized":"2024-04-15T00:31:40.991746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'803","reported_seq":825,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.280770+0000","last_change":"2024-04-15T00:21:12.622128+0000","last_active":"2024-04-15T00:31:30.280770+0000","last_peered":"2024-04-15T00:31:30.280770+0000","last_clean":"2024-04-15T00:31:30.280770+0000","last_became_active":"2024-04-15T00:21:12.621682+0000","last_became_peered":"2024-04-15T00:21:12.621682+0000","last_unstale":"2024-04-15T00:31:30.280770+0000","last_undegraded":"2024-04-15T00:31:30.280770+0000","last_fullsized":"2024-04-15T00:31:30.280770+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":803,"log_dups_size":0,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:03:00.366139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":339750667,"num_objects":83,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4004,"num_write_kb":347535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'636","reported_seq":666,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:13.317066+0000","last_change":"2024-04-15T00:21:07.577069+0000","last_active":"2024-04-15T00:29:13.317066+0000","last_peered":"2024-04-15T00:29:13.317066+0000","last_clean":"2024-04-15T00:29:13.317066+0000","last_became_active":"2024-04-15T00:21:07.576791+0000","last_became_peered":"2024-04-15T00:21:07.576791+0000","last_unstale":"2024-04-15T00:29:13.317066+0000","last_undegraded":"2024-04-15T00:29:13.317066+0000","last_fullsized":"2024-04-15T00:29:13.317066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:36:11.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":636,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'9","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:40.474199+0000","last_change":"2024-04-15T00:21:08.584214+0000","last_active":"2024-04-15T00:28:40.474199+0000","last_peered":"2024-04-15T00:28:40.474199+0000","last_clean":"2024-04-15T00:28:40.474199+0000","last_became_active":"2024-04-15T00:21:08.583909+0000","last_became_peered":"2024-04-15T00:21:08.583909+0000","last_unstale":"2024-04-15T00:28:40.474199+0000","last_undegraded":"2024-04-15T00:28:40.474199+0000","last_fullsized":"2024-04-15T00:28:40.474199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:55.815311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'1057","reported_seq":1079,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.450905+0000","last_change":"2024-04-15T00:21:12.624156+0000","last_active":"2024-04-15T00:31:32.450905+0000","last_peered":"2024-04-15T00:31:32.450905+0000","last_clean":"2024-04-15T00:31:32.450905+0000","last_became_active":"2024-04-15T00:21:12.623756+0000","last_became_peered":"2024-04-15T00:21:12.623756+0000","last_unstale":"2024-04-15T00:31:32.450905+0000","last_undegraded":"2024-04-15T00:31:32.450905+0000","last_fullsized":"2024-04-15T00:31:32.450905+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1057,"log_dups_size":0,"ondisk_log_size":1057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:31:33.202296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":461404378,"num_objects":118,"num_object_clones":0,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5333,"num_write_kb":471487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'7","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.464489+0000","last_change":"2024-04-15T00:21:08.588647+0000","last_active":"2024-04-15T00:29:30.464489+0000","last_peered":"2024-04-15T00:29:30.464489+0000","last_clean":"2024-04-15T00:29:30.464489+0000","last_became_active":"2024-04-15T00:21:08.587719+0000","last_became_peered":"2024-04-15T00:21:08.587719+0000","last_unstale":"2024-04-15T00:29:30.464489+0000","last_undegraded":"2024-04-15T00:29:30.464489+0000","last_fullsized":"2024-04-15T00:29:30.464489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:39.454082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'23","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.996009+0000","last_change":"2024-04-15T00:21:08.596094+0000","last_active":"2024-04-15T00:31:40.996009+0000","last_peered":"2024-04-15T00:31:40.996009+0000","last_clean":"2024-04-15T00:31:40.996009+0000","last_became_active":"2024-04-15T00:21:08.595790+0000","last_became_peered":"2024-04-15T00:21:08.595790+0000","last_unstale":"2024-04-15T00:31:40.996009+0000","last_undegraded":"2024-04-15T00:31:40.996009+0000","last_fullsized":"2024-04-15T00:31:40.996009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:15.446273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'9","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.464509+0000","last_change":"2024-04-15T00:21:08.583148+0000","last_active":"2024-04-15T00:29:30.464509+0000","last_peered":"2024-04-15T00:29:30.464509+0000","last_clean":"2024-04-15T00:29:30.464509+0000","last_became_active":"2024-04-15T00:21:08.582801+0000","last_became_peered":"2024-04-15T00:21:08.582801+0000","last_unstale":"2024-04-15T00:29:30.464509+0000","last_undegraded":"2024-04-15T00:29:30.464509+0000","last_fullsized":"2024-04-15T00:29:30.464509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:01.007313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'16","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.982235+0000","last_change":"2024-04-15T00:21:08.596406+0000","last_active":"2024-04-15T00:31:40.982235+0000","last_peered":"2024-04-15T00:31:40.982235+0000","last_clean":"2024-04-15T00:31:40.982235+0000","last_became_active":"2024-04-15T00:21:08.596144+0000","last_became_peered":"2024-04-15T00:21:08.596144+0000","last_unstale":"2024-04-15T00:31:40.982235+0000","last_undegraded":"2024-04-15T00:31:40.982235+0000","last_fullsized":"2024-04-15T00:31:40.982235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:41.447119+0000","last_change":"2024-04-15T00:21:08.591959+0000","last_active":"2024-04-15T00:27:41.447119+0000","last_peered":"2024-04-15T00:27:41.447119+0000","last_clean":"2024-04-15T00:27:41.447119+0000","last_became_active":"2024-04-15T00:21:08.591479+0000","last_became_peered":"2024-04-15T00:21:08.591479+0000","last_unstale":"2024-04-15T00:27:41.447119+0000","last_undegraded":"2024-04-15T00:27:41.447119+0000","last_fullsized":"2024-04-15T00:27:41.447119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'12","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.006398+0000","last_change":"2024-04-15T00:21:08.577658+0000","last_active":"2024-04-15T00:31:41.006398+0000","last_peered":"2024-04-15T00:31:41.006398+0000","last_clean":"2024-04-15T00:31:41.006398+0000","last_became_active":"2024-04-15T00:21:08.577358+0000","last_became_peered":"2024-04-15T00:21:08.577358+0000","last_unstale":"2024-04-15T00:31:41.006398+0000","last_undegraded":"2024-04-15T00:31:41.006398+0000","last_fullsized":"2024-04-15T00:31:41.006398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:40.453104+0000","last_change":"2024-04-15T00:21:08.593462+0000","last_active":"2024-04-15T00:27:40.453104+0000","last_peered":"2024-04-15T00:27:40.453104+0000","last_clean":"2024-04-15T00:27:40.453104+0000","last_became_active":"2024-04-15T00:21:08.593174+0000","last_became_peered":"2024-04-15T00:21:08.593174+0000","last_unstale":"2024-04-15T00:27:40.453104+0000","last_undegraded":"2024-04-15T00:27:40.453104+0000","last_fullsized":"2024-04-15T00:27:40.453104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:41.447142+0000","last_change":"2024-04-15T00:21:08.582109+0000","last_active":"2024-04-15T00:27:41.447142+0000","last_peered":"2024-04-15T00:27:41.447142+0000","last_clean":"2024-04-15T00:27:41.447142+0000","last_became_active":"2024-04-15T00:21:08.581828+0000","last_became_peered":"2024-04-15T00:21:08.581828+0000","last_unstale":"2024-04-15T00:27:41.447142+0000","last_undegraded":"2024-04-15T00:27:41.447142+0000","last_fullsized":"2024-04-15T00:27:41.447142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:01.007313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:40.453055+0000","last_change":"2024-04-15T00:21:08.582329+0000","last_active":"2024-04-15T00:27:40.453055+0000","last_peered":"2024-04-15T00:27:40.453055+0000","last_clean":"2024-04-15T00:27:40.453055+0000","last_became_active":"2024-04-15T00:21:08.582011+0000","last_became_peered":"2024-04-15T00:21:08.582011+0000","last_unstale":"2024-04-15T00:27:40.453055+0000","last_undegraded":"2024-04-15T00:27:40.453055+0000","last_fullsized":"2024-04-15T00:27:40.453055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'10","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:56.448358+0000","last_change":"2024-04-15T00:21:08.581215+0000","last_active":"2024-04-15T00:27:56.448358+0000","last_peered":"2024-04-15T00:27:56.448358+0000","last_clean":"2024-04-15T00:27:56.448358+0000","last_became_active":"2024-04-15T00:21:08.579860+0000","last_became_peered":"2024-04-15T00:21:08.579860+0000","last_unstale":"2024-04-15T00:27:56.448358+0000","last_undegraded":"2024-04-15T00:27:56.448358+0000","last_fullsized":"2024-04-15T00:27:56.448358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'8","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:55.454850+0000","last_change":"2024-04-15T00:21:08.592785+0000","last_active":"2024-04-15T00:27:55.454850+0000","last_peered":"2024-04-15T00:27:55.454850+0000","last_clean":"2024-04-15T00:27:55.454850+0000","last_became_active":"2024-04-15T00:21:08.592110+0000","last_became_peered":"2024-04-15T00:21:08.592110+0000","last_unstale":"2024-04-15T00:27:55.454850+0000","last_undegraded":"2024-04-15T00:27:55.454850+0000","last_fullsized":"2024-04-15T00:27:55.454850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:45.258841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'21","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.010693+0000","last_change":"2024-04-15T00:21:08.599781+0000","last_active":"2024-04-15T00:31:41.010693+0000","last_peered":"2024-04-15T00:31:41.010693+0000","last_clean":"2024-04-15T00:31:41.010693+0000","last_became_active":"2024-04-15T00:21:08.599460+0000","last_became_peered":"2024-04-15T00:21:08.599460+0000","last_unstale":"2024-04-15T00:31:41.010693+0000","last_undegraded":"2024-04-15T00:31:41.010693+0000","last_fullsized":"2024-04-15T00:31:41.010693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:39.454082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:55.454839+0000","last_change":"2024-04-15T00:21:08.588233+0000","last_active":"2024-04-15T00:27:55.454839+0000","last_peered":"2024-04-15T00:27:55.454839+0000","last_clean":"2024-04-15T00:27:55.454839+0000","last_became_active":"2024-04-15T00:21:08.586235+0000","last_became_peered":"2024-04-15T00:21:08.586235+0000","last_unstale":"2024-04-15T00:27:55.454839+0000","last_undegraded":"2024-04-15T00:27:55.454839+0000","last_fullsized":"2024-04-15T00:27:55.454839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'10","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:55.460955+0000","last_change":"2024-04-15T00:21:08.582000+0000","last_active":"2024-04-15T00:27:55.460955+0000","last_peered":"2024-04-15T00:27:55.460955+0000","last_clean":"2024-04-15T00:27:55.460955+0000","last_became_active":"2024-04-15T00:21:08.581714+0000","last_became_peered":"2024-04-15T00:21:08.581714+0000","last_unstale":"2024-04-15T00:27:55.460955+0000","last_undegraded":"2024-04-15T00:27:55.460955+0000","last_fullsized":"2024-04-15T00:27:55.460955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:27.427117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'21","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.991661+0000","last_change":"2024-04-15T00:21:08.582994+0000","last_active":"2024-04-15T00:31:40.991661+0000","last_peered":"2024-04-15T00:31:40.991661+0000","last_clean":"2024-04-15T00:31:40.991661+0000","last_became_active":"2024-04-15T00:21:08.582594+0000","last_became_peered":"2024-04-15T00:21:08.582594+0000","last_unstale":"2024-04-15T00:31:40.991661+0000","last_undegraded":"2024-04-15T00:31:40.991661+0000","last_fullsized":"2024-04-15T00:31:40.991661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:26:23.617197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:10.456477+0000","last_change":"2024-04-15T00:21:08.591937+0000","last_active":"2024-04-15T00:28:10.456477+0000","last_peered":"2024-04-15T00:28:10.456477+0000","last_clean":"2024-04-15T00:28:10.456477+0000","last_became_active":"2024-04-15T00:21:08.591655+0000","last_became_peered":"2024-04-15T00:21:08.591655+0000","last_unstale":"2024-04-15T00:28:10.456477+0000","last_undegraded":"2024-04-15T00:28:10.456477+0000","last_fullsized":"2024-04-15T00:28:10.456477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:21:59.995077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'15","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.989067+0000","last_change":"2024-04-15T00:21:49.707724+0000","last_active":"2024-04-15T00:31:40.989067+0000","last_peered":"2024-04-15T00:31:40.989067+0000","last_clean":"2024-04-15T00:31:40.989067+0000","last_became_active":"2024-04-15T00:21:49.707397+0000","last_became_peered":"2024-04-15T00:21:49.707397+0000","last_unstale":"2024-04-15T00:31:40.989067+0000","last_undegraded":"2024-04-15T00:31:40.989067+0000","last_fullsized":"2024-04-15T00:31:40.989067+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:21:59.995077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"27'16","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.986058+0000","last_change":"2024-04-15T00:21:08.581452+0000","last_active":"2024-04-15T00:31:40.986058+0000","last_peered":"2024-04-15T00:31:40.986058+0000","last_clean":"2024-04-15T00:31:40.986058+0000","last_became_active":"2024-04-15T00:21:08.580967+0000","last_became_peered":"2024-04-15T00:21:08.580967+0000","last_unstale":"2024-04-15T00:31:40.986058+0000","last_undegraded":"2024-04-15T00:31:40.986058+0000","last_fullsized":"2024-04-15T00:31:40.986058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'16","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.999173+0000","last_change":"2024-04-15T00:21:08.587249+0000","last_active":"2024-04-15T00:31:40.999173+0000","last_peered":"2024-04-15T00:31:40.999173+0000","last_clean":"2024-04-15T00:31:40.999173+0000","last_became_active":"2024-04-15T00:21:08.586885+0000","last_became_peered":"2024-04-15T00:21:08.586885+0000","last_unstale":"2024-04-15T00:31:40.999173+0000","last_undegraded":"2024-04-15T00:31:40.999173+0000","last_fullsized":"2024-04-15T00:31:40.999173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:44:31.020890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:26.450795+0000","last_change":"2024-04-15T00:21:08.579970+0000","last_active":"2024-04-15T00:28:26.450795+0000","last_peered":"2024-04-15T00:28:26.450795+0000","last_clean":"2024-04-15T00:28:26.450795+0000","last_became_active":"2024-04-15T00:21:08.579652+0000","last_became_peered":"2024-04-15T00:21:08.579652+0000","last_unstale":"2024-04-15T00:28:26.450795+0000","last_undegraded":"2024-04-15T00:28:26.450795+0000","last_fullsized":"2024-04-15T00:28:26.450795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:10:24.477646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.472704+0000","last_change":"2024-04-15T00:21:08.588376+0000","last_active":"2024-04-15T00:28:25.472704+0000","last_peered":"2024-04-15T00:28:25.472704+0000","last_clean":"2024-04-15T00:28:25.472704+0000","last_became_active":"2024-04-15T00:21:08.587712+0000","last_became_peered":"2024-04-15T00:21:08.587712+0000","last_unstale":"2024-04-15T00:28:25.472704+0000","last_undegraded":"2024-04-15T00:28:25.472704+0000","last_fullsized":"2024-04-15T00:28:25.472704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:34:27.330682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'11","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.457788+0000","last_change":"2024-04-15T00:21:08.597204+0000","last_active":"2024-04-15T00:28:25.457788+0000","last_peered":"2024-04-15T00:28:25.457788+0000","last_clean":"2024-04-15T00:28:25.457788+0000","last_became_active":"2024-04-15T00:21:08.596862+0000","last_became_peered":"2024-04-15T00:21:08.596862+0000","last_unstale":"2024-04-15T00:28:25.457788+0000","last_undegraded":"2024-04-15T00:28:25.457788+0000","last_fullsized":"2024-04-15T00:28:25.457788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'8","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.457806+0000","last_change":"2024-04-15T00:21:08.598199+0000","last_active":"2024-04-15T00:28:25.457806+0000","last_peered":"2024-04-15T00:28:25.457806+0000","last_clean":"2024-04-15T00:28:25.457806+0000","last_became_active":"2024-04-15T00:21:08.597790+0000","last_became_peered":"2024-04-15T00:21:08.597790+0000","last_unstale":"2024-04-15T00:28:25.457806+0000","last_undegraded":"2024-04-15T00:28:25.457806+0000","last_fullsized":"2024-04-15T00:28:25.457806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'10","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.464140+0000","last_change":"2024-04-15T00:21:08.600496+0000","last_active":"2024-04-15T00:28:25.464140+0000","last_peered":"2024-04-15T00:28:25.464140+0000","last_clean":"2024-04-15T00:28:25.464140+0000","last_became_active":"2024-04-15T00:21:08.600121+0000","last_became_peered":"2024-04-15T00:21:08.600121+0000","last_unstale":"2024-04-15T00:28:25.464140+0000","last_undegraded":"2024-04-15T00:28:25.464140+0000","last_fullsized":"2024-04-15T00:28:25.464140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:11:12.071153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:41.452071+0000","last_change":"2024-04-15T00:21:08.583866+0000","last_active":"2024-04-15T00:28:41.452071+0000","last_peered":"2024-04-15T00:28:41.452071+0000","last_clean":"2024-04-15T00:28:41.452071+0000","last_became_active":"2024-04-15T00:21:08.583563+0000","last_became_peered":"2024-04-15T00:21:08.583563+0000","last_unstale":"2024-04-15T00:28:41.452071+0000","last_undegraded":"2024-04-15T00:28:41.452071+0000","last_fullsized":"2024-04-15T00:28:41.452071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:27:41.268464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:40.465745+0000","last_change":"2024-04-15T00:21:08.596983+0000","last_active":"2024-04-15T00:28:40.465745+0000","last_peered":"2024-04-15T00:28:40.465745+0000","last_clean":"2024-04-15T00:28:40.465745+0000","last_became_active":"2024-04-15T00:21:08.596640+0000","last_became_peered":"2024-04-15T00:21:08.596640+0000","last_unstale":"2024-04-15T00:28:40.465745+0000","last_undegraded":"2024-04-15T00:28:40.465745+0000","last_fullsized":"2024-04-15T00:28:40.465745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:40.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'8","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:40.459376+0000","last_change":"2024-04-15T00:21:08.593027+0000","last_active":"2024-04-15T00:28:40.459376+0000","last_peered":"2024-04-15T00:28:40.459376+0000","last_clean":"2024-04-15T00:28:40.459376+0000","last_became_active":"2024-04-15T00:21:08.592476+0000","last_became_peered":"2024-04-15T00:21:08.592476+0000","last_unstale":"2024-04-15T00:28:40.459376+0000","last_undegraded":"2024-04-15T00:28:40.459376+0000","last_fullsized":"2024-04-15T00:28:40.459376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:10:24.477646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:40.465766+0000","last_change":"2024-04-15T00:21:08.591419+0000","last_active":"2024-04-15T00:28:40.465766+0000","last_peered":"2024-04-15T00:28:40.465766+0000","last_clean":"2024-04-15T00:28:40.465766+0000","last_became_active":"2024-04-15T00:21:08.591101+0000","last_became_peered":"2024-04-15T00:21:08.591101+0000","last_unstale":"2024-04-15T00:28:40.465766+0000","last_undegraded":"2024-04-15T00:28:40.465766+0000","last_fullsized":"2024-04-15T00:28:40.465766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:52:10.558592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:10.462657+0000","last_change":"2024-04-15T00:21:08.581621+0000","last_active":"2024-04-15T00:29:10.462657+0000","last_peered":"2024-04-15T00:29:10.462657+0000","last_clean":"2024-04-15T00:29:10.462657+0000","last_became_active":"2024-04-15T00:21:08.581316+0000","last_became_peered":"2024-04-15T00:21:08.581316+0000","last_unstale":"2024-04-15T00:29:10.462657+0000","last_undegraded":"2024-04-15T00:29:10.462657+0000","last_fullsized":"2024-04-15T00:29:10.462657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:27.427117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'14","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.995218+0000","last_change":"2024-04-15T00:21:08.590252+0000","last_active":"2024-04-15T00:31:40.995218+0000","last_peered":"2024-04-15T00:31:40.995218+0000","last_clean":"2024-04-15T00:31:40.995218+0000","last_became_active":"2024-04-15T00:21:08.589919+0000","last_became_peered":"2024-04-15T00:21:08.589919+0000","last_unstale":"2024-04-15T00:31:40.995218+0000","last_undegraded":"2024-04-15T00:31:40.995218+0000","last_fullsized":"2024-04-15T00:31:40.995218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:46:53.537904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'6","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.995528+0000","last_change":"2024-04-15T00:21:08.588530+0000","last_active":"2024-04-15T00:31:40.995528+0000","last_peered":"2024-04-15T00:31:40.995528+0000","last_clean":"2024-04-15T00:31:40.995528+0000","last_became_active":"2024-04-15T00:21:08.588208+0000","last_became_peered":"2024-04-15T00:21:08.588208+0000","last_unstale":"2024-04-15T00:31:40.995528+0000","last_undegraded":"2024-04-15T00:31:40.995528+0000","last_fullsized":"2024-04-15T00:31:40.995528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:08.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'5","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.470890+0000","last_change":"2024-04-15T00:21:08.588469+0000","last_active":"2024-04-15T00:29:30.470890+0000","last_peered":"2024-04-15T00:29:30.470890+0000","last_clean":"2024-04-15T00:29:30.470890+0000","last_became_active":"2024-04-15T00:21:08.587646+0000","last_became_peered":"2024-04-15T00:21:08.587646+0000","last_unstale":"2024-04-15T00:29:30.470890+0000","last_undegraded":"2024-04-15T00:29:30.470890+0000","last_fullsized":"2024-04-15T00:29:30.470890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:52:27.105666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":13424233995,"num_objects":3390,"num_object_clones":0,"num_object_copies":13560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3390,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148702,"num_write_kb":13691509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26850476032,"data_stored":26850476032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29948,"ondisk_log_size":29948,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":616,"ondisk_log_size":616,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":11389277,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":36,"num_read_kb":72,"num_write":2538,"num_write_kb":11908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":22839296,"data_stored":22778554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2201,"ondisk_log_size":2201,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542276,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4663072,"kb_used_data":4365464,"kb_used_omap":1,"kb_used_meta":297598,"kb_avail":89708768,"statfs":{"total":96636764160,"available":91861778432,"internally_reserved":0,"allocated":4470235136,"data_stored":4470056729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":304740807},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542277,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2797748,"kb_used_data":2626412,"kb_used_omap":1,"kb_used_meta":171326,"kb_avail":91574092,"statfs":{"total":96636764160,"available":93771870208,"internally_reserved":0,"allocated":2689445888,"data_stored":2689275001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":175438277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542277,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3076828,"kb_used_data":2887444,"kb_used_omap":1,"kb_used_meta":189374,"kb_avail":91295012,"statfs":{"total":96636764160,"available":93486092288,"internally_reserved":0,"allocated":2956742656,"data_stored":2956558926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":193919429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574981,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3118448,"kb_used_data":2920744,"kb_used_omap":1,"kb_used_meta":197694,"kb_avail":91253392,"statfs":{"total":96636764160,"available":93443473408,"internally_reserved":0,"allocated":2990841856,"data_stored":2990665452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":202439114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574981,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3681748,"kb_used_data":3443788,"kb_used_omap":1,"kb_used_meta":237950,"kb_avail":90690092,"statfs":{"total":96636764160,"available":92866654208,"internally_reserved":0,"allocated":3526438912,"data_stored":3526262864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":243661254},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574980,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2562512,"kb_used_data":2382856,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":91809328,"statfs":{"total":96636764160,"available":94012751872,"internally_reserved":0,"allocated":2440044544,"data_stored":2439872010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574980,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3506600,"kb_used_data":3268640,"kb_used_omap":1,"kb_used_meta":237950,"kb_avail":90865240,"statfs":{"total":96636764160,"available":93046005760,"internally_reserved":0,"allocated":3347087360,"data_stored":3346905860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243661253},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574981,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4647724,"kb_used_data":4351524,"kb_used_omap":1,"kb_used_meta":296190,"kb_avail":89724116,"statfs":{"total":96636764160,"available":91877494784,"internally_reserved":0,"allocated":4455960576,"data_stored":4455784016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":303299014},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":50889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8450048,"data_stored":8440169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2961408,"data_stored":2948436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7147520,"data_stored":7143196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2955849728,"data_stored":2955849728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4455665664,"data_stored":4455665664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2689105920,"data_stored":2689105920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4461498368,"data_stored":4461498368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3343839232,"data_stored":3343839232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2439753728,"data_stored":2439753728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3521949696,"data_stored":3521949696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2982813696,"data_stored":2982813696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T00:31:42.810 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:31:42.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.940+0000 7f38a9ed5640 1 Processor -- start 2024-04-15T00:31:42.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.940+0000 7f38a9ed5640 1 -- start start 2024-04-15T00:31:42.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.940+0000 7f38a9ed5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f38a41446d0 0x7f38a40b3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:42.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.940+0000 7f38a9ed5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f38a40b2480 0x7f38a40b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:42.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.940+0000 7f38a9ed5640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38a4143c60 con 0x7f38a40af260 2024-04-15T00:31:42.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.940+0000 7f38a9ed5640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f38a4072f80 con 0x7f38a41446d0 2024-04-15T00:31:42.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.940+0000 7f38a9ed5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f38a40b0a40 con 0x7f38a40b2480 2024-04-15T00:31:42.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.940+0000 7f38a2ffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f38a41446d0 0x7f38a40b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:42.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.940+0000 7f38a37fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f38a40af260 0x7f38a40af640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56200/0 (socket says 172.21.15.31:56200) 2024-04-15T00:31:42.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.940+0000 7f38a37fe640 1 -- 172.21.15.31:0/92829423 learned_addr learned my addr 172.21.15.31:0/92829423 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:31:42.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.941+0000 7f38a3fff640 1 --2- 172.21.15.31:0/92829423 >> v2:172.21.15.50:3300/0 conn(0x7f38a40b2480 0x7f38a40b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:42.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.941+0000 7f38a2ffd640 1 -- 172.21.15.31:0/92829423 >> v2:172.21.15.50:3300/0 conn(0x7f38a40b2480 msgr2=0x7f38a40b28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:42.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.941+0000 7f38a2ffd640 1 --2- 172.21.15.31:0/92829423 >> v2:172.21.15.50:3300/0 conn(0x7f38a40b2480 0x7f38a40b28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:42.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.941+0000 7f38a2ffd640 1 -- 172.21.15.31:0/92829423 >> v1:172.21.15.31:6789/0 conn(0x7f38a40af260 legacy=0x7f38a40af640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:42.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.941+0000 7f38a27fc640 1 -- 172.21.15.31:0/92829423 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 849158417 0 0) 0x7f38a4143c60 con 0x7f38a40af260 2024-04-15T00:31:42.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.941+0000 7f38a2ffd640 1 -- 172.21.15.31:0/92829423 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38a40add40 con 0x7f38a41446d0 2024-04-15T00:31:42.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.941+0000 7f38a2ffd640 1 --2- 172.21.15.31:0/92829423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38a41446d0 0x7f38a40b3450 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f38a4143b50 tx=0x7f389802b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd4af23e11d7e63 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:42.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.942+0000 7f38a27fc640 1 -- 172.21.15.31:0/92829423 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3898038070 con 0x7f38a41446d0 2024-04-15T00:31:42.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.942+0000 7f38a27fc640 1 -- 172.21.15.31:0/92829423 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3898031710 con 0x7f38a41446d0 2024-04-15T00:31:42.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.942+0000 7f38a27fc640 1 -- 172.21.15.31:0/92829423 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3898031ae0 con 0x7f38a41446d0 2024-04-15T00:31:42.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.942+0000 7f38a9ed5640 1 -- 172.21.15.31:0/92829423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38a41446d0 msgr2=0x7f38a40b3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:42.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.942+0000 7f38a9ed5640 1 --2- 172.21.15.31:0/92829423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38a41446d0 0x7f38a40b3450 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f38a4143b50 tx=0x7f389802b7b0 comp rx=0 tx=0).stop 2024-04-15T00:31:42.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.942+0000 7f38a9ed5640 1 -- 172.21.15.31:0/92829423 shutdown_connections 2024-04-15T00:31:42.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.942+0000 7f38a9ed5640 1 --2- 172.21.15.31:0/92829423 >> v2:172.21.15.50:3300/0 conn(0x7f38a40b2480 0x7f38a40b28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:42.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.942+0000 7f38a9ed5640 1 --2- 172.21.15.31:0/92829423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38a41446d0 0x7f38a40b3450 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:42.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.942+0000 7f38a9ed5640 1 -- 172.21.15.31:0/92829423 >> 172.21.15.31:0/92829423 conn(0x7f38a406c470 msgr2=0x7f38a406c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:42.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.942+0000 7f38a9ed5640 1 -- 172.21.15.31:0/92829423 shutdown_connections 2024-04-15T00:31:42.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.942+0000 7f38a9ed5640 1 -- 172.21.15.31:0/92829423 wait complete. 2024-04-15T00:31:42.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.943+0000 7f38a9ed5640 1 Processor -- start 2024-04-15T00:31:42.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.943+0000 7f38a9ed5640 1 -- start start 2024-04-15T00:31:42.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.944+0000 7f38a9ed5640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38a40af260 0x7f38a413a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:42.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.944+0000 7f38a9ed5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38a40b2480 0x7f38a41395d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:42.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.944+0000 7f38a9ed5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38a41446d0 0x7f38a413f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:42.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.944+0000 7f38a9ed5640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f38a40aeb90 con 0x7f38a40b2480 2024-04-15T00:31:42.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.944+0000 7f38a9ed5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f38a41441b0 con 0x7f38a41446d0 2024-04-15T00:31:42.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.944+0000 7f38a9ed5640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f38a40b2e10 con 0x7f38a40af260 2024-04-15T00:31:42.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.944+0000 7f38a2ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38a40b2480 0x7f38a41395d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:42.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.944+0000 7f38a2ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38a40b2480 0x7f38a41395d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57418/0 (socket says 172.21.15.31:57418) 2024-04-15T00:31:42.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.944+0000 7f38a2ffd640 1 -- 172.21.15.31:0/3310264651 learned_addr learned my addr 172.21.15.31:0/3310264651 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:42.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.944+0000 7f38a2ffd640 1 -- 172.21.15.31:0/3310264651 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38a40af260 msgr2=0x7f38a413a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:42.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.944+0000 7f38a2ffd640 1 --2- 172.21.15.31:0/3310264651 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38a40af260 0x7f38a413a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:42.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.944+0000 7f38a2ffd640 1 -- 172.21.15.31:0/3310264651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38a41446d0 msgr2=0x7f38a413f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:42.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.944+0000 7f38a2ffd640 1 --2- 172.21.15.31:0/3310264651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38a41446d0 0x7f38a413f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:42.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.944+0000 7f38a2ffd640 1 -- 172.21.15.31:0/3310264651 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38a413bb50 con 0x7f38a40b2480 2024-04-15T00:31:42.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.945+0000 7f38a2ffd640 1 --2- 172.21.15.31:0/3310264651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38a40b2480 0x7f38a41395d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3898000c00 tx=0x7f38980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:42.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.945+0000 7f388bfff640 1 -- 172.21.15.31:0/3310264651 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3898042070 con 0x7f38a40b2480 2024-04-15T00:31:42.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.945+0000 7f388bfff640 1 -- 172.21.15.31:0/3310264651 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f389803d870 con 0x7f38a40b2480 2024-04-15T00:31:42.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.945+0000 7f38a9ed5640 1 -- 172.21.15.31:0/3310264651 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38a413aab0 con 0x7f38a40b2480 2024-04-15T00:31:42.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.945+0000 7f388bfff640 1 -- 172.21.15.31:0/3310264651 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3898038040 con 0x7f38a40b2480 2024-04-15T00:31:42.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.945+0000 7f38a9ed5640 1 -- 172.21.15.31:0/3310264651 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38a413bdc0 con 0x7f38a40b2480 2024-04-15T00:31:42.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.946+0000 7f38a9ed5640 1 -- 172.21.15.31:0/3310264651 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38a404f620 con 0x7f38a40b2480 2024-04-15T00:31:42.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.946+0000 7f388bfff640 1 -- 172.21.15.31:0/3310264651 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f3898045070 con 0x7f38a40b2480 2024-04-15T00:31:42.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.947+0000 7f388bfff640 1 --2- 172.21.15.31:0/3310264651 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f389006b990 0x7f389006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:42.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.947+0000 7f388bfff640 1 -- 172.21.15.31:0/3310264651 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f38980ac4c0 con 0x7f38a40b2480 2024-04-15T00:31:42.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.947+0000 7f38a37fe640 1 --2- 172.21.15.31:0/3310264651 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f389006b990 0x7f389006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:42.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.947+0000 7f38a37fe640 1 --2- 172.21.15.31:0/3310264651 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f389006b990 0x7f389006de50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3894007fd0 tx=0x7f3894007920 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:42.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:42.951+0000 7f388bfff640 1 -- 172.21.15.31:0/3310264651 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f389804c070 con 0x7f38a40b2480 2024-04-15T00:31:43.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:43.133+0000 7f38a9ed5640 1 -- 172.21.15.31:0/3310264651 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f38a4141b30 con 0x7f38a40b2480 2024-04-15T00:31:43.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:43.134+0000 7f388bfff640 1 -- 172.21.15.31:0/3310264651 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18841 (secure 0 0 0) 0x7f389807a670 con 0x7f38a40b2480 2024-04-15T00:31:43.142 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:31:43.143 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":27,"fsid":"b57c03ab-2810-4ea5-b233-6164468328c0","created":"2024-04-15T00:20:44.073217+0000","modified":"2024-04-15T00:21:49.696289+0000","last_up_change":"2024-04-15T00:20:55.515596+0000","last_in_change":"2024-04-15T00:20:46.364541+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:20:56.423161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:21:06.436169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:21:06.888505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:21:10.610300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b085a2f4-5565-4ccc-a98e-e56180791550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6817","nonce":2355720818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6819","nonce":2355720818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6823","nonce":2355720818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6821","nonce":2355720818}]},"public_addr":"172.21.15.31:6817/2355720818","cluster_addr":"172.21.15.31:6819/2355720818","heartbeat_back_addr":"172.21.15.31:6823/2355720818","heartbeat_front_addr":"172.21.15.31:6821/2355720818","state":["exists","up"]},{"osd":1,"uuid":"0f751557-3f18-464f-8b78-614d19549f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6809","nonce":2705297130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6811","nonce":2705297130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6815","nonce":2705297130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6813","nonce":2705297130}]},"public_addr":"172.21.15.31:6809/2705297130","cluster_addr":"172.21.15.31:6811/2705297130","heartbeat_back_addr":"172.21.15.31:6815/2705297130","heartbeat_front_addr":"172.21.15.31:6813/2705297130","state":["exists","up"]},{"osd":2,"uuid":"17371b09-2bd7-4ef7-926f-e7706319f064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6801","nonce":225061474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6803","nonce":225061474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6807","nonce":225061474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6805","nonce":225061474}]},"public_addr":"172.21.15.31:6801/225061474","cluster_addr":"172.21.15.31:6803/225061474","heartbeat_back_addr":"172.21.15.31:6807/225061474","heartbeat_front_addr":"172.21.15.31:6805/225061474","state":["exists","up"]},{"osd":3,"uuid":"315b6949-f009-4291-9581-aa4912642dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6825","nonce":3722449780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6827","nonce":3722449780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6831","nonce":3722449780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6829","nonce":3722449780}]},"public_addr":"172.21.15.31:6825/3722449780","cluster_addr":"172.21.15.31:6827/3722449780","heartbeat_back_addr":"172.21.15.31:6831/3722449780","heartbeat_front_addr":"172.21.15.31:6829/3722449780","state":["exists","up"]},{"osd":4,"uuid":"e3659369-cc78-4aa8-bd10-a199d4a1569d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6801","nonce":1279970071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6803","nonce":1279970071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6807","nonce":1279970071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6805","nonce":1279970071}]},"public_addr":"172.21.15.50:6801/1279970071","cluster_addr":"172.21.15.50:6803/1279970071","heartbeat_back_addr":"172.21.15.50:6807/1279970071","heartbeat_front_addr":"172.21.15.50:6805/1279970071","state":["exists","up"]},{"osd":5,"uuid":"35c3a4c0-0b45-45d2-85b9-301c347602f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6809","nonce":1589417182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6811","nonce":1589417182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6815","nonce":1589417182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6813","nonce":1589417182}]},"public_addr":"172.21.15.50:6809/1589417182","cluster_addr":"172.21.15.50:6811/1589417182","heartbeat_back_addr":"172.21.15.50:6815/1589417182","heartbeat_front_addr":"172.21.15.50:6813/1589417182","state":["exists","up"]},{"osd":6,"uuid":"20df7a76-245f-4946-9624-6ca9e949227b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6817","nonce":682288274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6819","nonce":682288274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6823","nonce":682288274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6821","nonce":682288274}]},"public_addr":"172.21.15.50:6817/682288274","cluster_addr":"172.21.15.50:6819/682288274","heartbeat_back_addr":"172.21.15.50:6823/682288274","heartbeat_front_addr":"172.21.15.50:6821/682288274","state":["exists","up"]},{"osd":7,"uuid":"95a504b7-e13a-49e6-8484-9dff4d5fc048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6825","nonce":4129060906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6827","nonce":4129060906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6831","nonce":4129060906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6829","nonce":4129060906}]},"public_addr":"172.21.15.50:6825/4129060906","cluster_addr":"172.21.15.50:6827/4129060906","heartbeat_back_addr":"172.21.15.50:6831/4129060906","heartbeat_front_addr":"172.21.15.50:6829/4129060906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.501980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.529961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.540913+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.521396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.448364+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.514136+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.527229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.508950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:31:43.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:43.136+0000 7f38a9ed5640 1 -- 172.21.15.31:0/3310264651 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f389006b990 msgr2=0x7f389006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:43.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:43.136+0000 7f38a9ed5640 1 --2- 172.21.15.31:0/3310264651 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f389006b990 0x7f389006de50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3894007fd0 tx=0x7f3894007920 comp rx=0 tx=0).stop 2024-04-15T00:31:43.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:43.136+0000 7f38a9ed5640 1 -- 172.21.15.31:0/3310264651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38a40b2480 msgr2=0x7f38a41395d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:43.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:43.136+0000 7f38a9ed5640 1 --2- 172.21.15.31:0/3310264651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38a40b2480 0x7f38a41395d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3898000c00 tx=0x7f38980046c0 comp rx=0 tx=0).stop 2024-04-15T00:31:43.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:43.136+0000 7f38a9ed5640 1 -- 172.21.15.31:0/3310264651 shutdown_connections 2024-04-15T00:31:43.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:43.136+0000 7f38a9ed5640 1 --2- 172.21.15.31:0/3310264651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38a41446d0 0x7f38a413f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:43.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:43.136+0000 7f38a9ed5640 1 --2- 172.21.15.31:0/3310264651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38a40b2480 0x7f38a41395d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:43.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:43.136+0000 7f38a9ed5640 1 --2- 172.21.15.31:0/3310264651 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f389006b990 0x7f389006de50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:43.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:43.136+0000 7f38a9ed5640 1 --2- 172.21.15.31:0/3310264651 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f38a40af260 0x7f38a413a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:43.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:43.136+0000 7f38a9ed5640 1 -- 172.21.15.31:0/3310264651 >> 172.21.15.31:0/3310264651 conn(0x7f38a406c470 msgr2=0x7f38a40b5910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:43.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:43.136+0000 7f38a9ed5640 1 -- 172.21.15.31:0/3310264651 shutdown_connections 2024-04-15T00:31:43.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:43.136+0000 7f38a9ed5640 1 -- 172.21.15.31:0/3310264651 wait complete. 2024-04-15T00:31:43.366 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:31:43.369 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:31:44.156 INFO:tasks.ceph:Scrubbing osd.0 2024-04-15T00:31:44.157 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-15T00:31:44.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.266+0000 7f69b391e640 1 Processor -- start 2024-04-15T00:31:44.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.267+0000 7f69b391e640 1 -- start start 2024-04-15T00:31:44.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.267+0000 7f69b391e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f69ac144c30 0x7f69ac14fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:44.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.267+0000 7f69b391e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69ac074a60 con 0x7f69ac074680 2024-04-15T00:31:44.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.267+0000 7f69b391e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69ac0afd90 con 0x7f69ac0b0220 2024-04-15T00:31:44.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.267+0000 7f69b391e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f69ac0ae280 con 0x7f69ac144c30 2024-04-15T00:31:44.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.268+0000 7f69b16ba640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f69ac074680 0x7f69ac141710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56210/0 (socket says 172.21.15.31:56210) 2024-04-15T00:31:44.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.268+0000 7f69b16ba640 1 -- 172.21.15.31:0/1341015240 learned_addr learned my addr 172.21.15.31:0/1341015240 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:31:44.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.268+0000 7f69b1ebb640 1 --2- 172.21.15.31:0/1341015240 >> v2:172.21.15.50:3300/0 conn(0x7f69ac144c30 0x7f69ac14fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:44.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.268+0000 7f69a3fff640 1 -- 172.21.15.31:0/1341015240 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 412168860 0 0) 0x7f69ac074a60 con 0x7f69ac074680 2024-04-15T00:31:44.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.268+0000 7f69a3fff640 1 -- 172.21.15.31:0/1341015240 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6998003520 con 0x7f69ac074680 2024-04-15T00:31:44.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.268+0000 7f69a3fff640 1 -- 172.21.15.31:0/1341015240 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1492543256 0 0) 0x7f6998003520 con 0x7f69ac074680 2024-04-15T00:31:44.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.268+0000 7f69a3fff640 1 -- 172.21.15.31:0/1341015240 >> v2:172.21.15.50:3300/0 conn(0x7f69ac144c30 msgr2=0x7f69ac14fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:44.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.268+0000 7f69a3fff640 1 --2- 172.21.15.31:0/1341015240 >> v2:172.21.15.50:3300/0 conn(0x7f69ac144c30 0x7f69ac14fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:44.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.268+0000 7f69a3fff640 1 -- 172.21.15.31:0/1341015240 >> v1:172.21.15.50:6789/0 conn(0x7f69ac0b0220 legacy=0x7f69ac144520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:44.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.268+0000 7f69a3fff640 1 -- 172.21.15.31:0/1341015240 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69ac0ae4d0 con 0x7f69ac074680 2024-04-15T00:31:44.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.268+0000 7f69a3fff640 1 -- 172.21.15.31:0/1341015240 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 697057150 0 0) 0x7f69a8001670 con 0x7f69ac074680 2024-04-15T00:31:44.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.268+0000 7f69a3fff640 1 -- 172.21.15.31:0/1341015240 >> v1:172.21.15.31:6789/0 conn(0x7f69ac074680 legacy=0x7f69ac141710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:44.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.268+0000 7f69a3fff640 1 --2- 172.21.15.31:0/1341015240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69980039b0 0x7f6998003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:44.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.268+0000 7f69a3fff640 1 --2- 172.21.15.31:0/1341015240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6998004800 0x7f6998004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:44.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.268+0000 7f69a3fff640 1 --2- 172.21.15.31:0/1341015240 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f69980051c0 0x7f699800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:44.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.268+0000 7f69a3fff640 1 -- 172.21.15.31:0/1341015240 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f69ac0ae280 con 0x7f69980039b0 2024-04-15T00:31:44.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.268+0000 7f69a3fff640 1 -- 172.21.15.31:0/1341015240 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f699800c060 con 0x7f6998004800 2024-04-15T00:31:44.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.268+0000 7f69a3fff640 1 -- 172.21.15.31:0/1341015240 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f699800c260 con 0x7f69980051c0 2024-04-15T00:31:44.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.268+0000 7f69b16ba640 1 --2- 172.21.15.31:0/1341015240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69980039b0 0x7f6998003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:44.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.268+0000 7f69b0eb9640 1 --2- 172.21.15.31:0/1341015240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6998004800 0x7f6998004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:44.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.268+0000 7f69b1ebb640 1 --2- 172.21.15.31:0/1341015240 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f69980051c0 0x7f699800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:44.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.269+0000 7f69b16ba640 1 -- 172.21.15.31:0/1341015240 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f69980051c0 msgr2=0x7f699800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:44.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.269+0000 7f69b16ba640 1 --2- 172.21.15.31:0/1341015240 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f69980051c0 0x7f699800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:44.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.269+0000 7f69b16ba640 1 -- 172.21.15.31:0/1341015240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6998004800 msgr2=0x7f6998004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:44.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.269+0000 7f69b16ba640 1 --2- 172.21.15.31:0/1341015240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6998004800 0x7f6998004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:44.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.269+0000 7f69b16ba640 1 -- 172.21.15.31:0/1341015240 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6998003520 con 0x7f69980039b0 2024-04-15T00:31:44.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.269+0000 7f69b1ebb640 1 -- 172.21.15.31:0/1341015240 reap_dead start 2024-04-15T00:31:44.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.269+0000 7f69b16ba640 1 --2- 172.21.15.31:0/1341015240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69980039b0 0x7f6998003dd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f69a800c240 tx=0x7f6998005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f60663d26672eb server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:44.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.270+0000 7f69a3fff640 1 -- 172.21.15.31:0/1341015240 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a8007d10 con 0x7f69980039b0 2024-04-15T00:31:44.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.270+0000 7f69a3fff640 1 -- 172.21.15.31:0/1341015240 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69a8030070 con 0x7f69980039b0 2024-04-15T00:31:44.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.270+0000 7f69a3fff640 1 -- 172.21.15.31:0/1341015240 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a8005d70 con 0x7f69980039b0 2024-04-15T00:31:44.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.270+0000 7f69b391e640 1 -- 172.21.15.31:0/1341015240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69980039b0 msgr2=0x7f6998003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:44.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.270+0000 7f69b391e640 1 --2- 172.21.15.31:0/1341015240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69980039b0 0x7f6998003dd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f69a800c240 tx=0x7f6998005830 comp rx=0 tx=0).stop 2024-04-15T00:31:44.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.270+0000 7f69b391e640 1 -- 172.21.15.31:0/1341015240 shutdown_connections 2024-04-15T00:31:44.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.270+0000 7f69b391e640 1 --2- 172.21.15.31:0/1341015240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69980039b0 0x7f6998003dd0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:44.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.270+0000 7f69b391e640 1 -- 172.21.15.31:0/1341015240 >> 172.21.15.31:0/1341015240 conn(0x7f69ac0b5d60 msgr2=0x7f69ac0b6170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:44.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.270+0000 7f69b391e640 1 -- 172.21.15.31:0/1341015240 shutdown_connections 2024-04-15T00:31:44.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.270+0000 7f69b391e640 1 -- 172.21.15.31:0/1341015240 wait complete. 2024-04-15T00:31:44.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.271+0000 7f69b391e640 1 Processor -- start 2024-04-15T00:31:44.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.271+0000 7f69b391e640 1 -- start start 2024-04-15T00:31:44.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.272+0000 7f69b391e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69980039b0 0x7f69ac09e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:44.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.272+0000 7f69b391e640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f69ac145530 0x7f69ac1dcf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:44.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.272+0000 7f69b391e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69ac1dd4a0 0x7f69ac1404e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:44.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.272+0000 7f69b391e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f69ac0afab0 con 0x7f69980039b0 2024-04-15T00:31:44.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.272+0000 7f69b391e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f69ac0aeb20 con 0x7f69ac1dd4a0 2024-04-15T00:31:44.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.272+0000 7f69b391e640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f69ac09bc70 con 0x7f69ac145530 2024-04-15T00:31:44.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.272+0000 7f69b16ba640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69980039b0 0x7f69ac09e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:44.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.272+0000 7f69b16ba640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69980039b0 0x7f69ac09e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57436/0 (socket says 172.21.15.31:57436) 2024-04-15T00:31:44.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.272+0000 7f69b16ba640 1 -- 172.21.15.31:0/2099034626 learned_addr learned my addr 172.21.15.31:0/2099034626 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:44.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.272+0000 7f69b0eb9640 1 --2- 172.21.15.31:0/2099034626 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f69ac145530 0x7f69ac1dcf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:44.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.272+0000 7f69b1ebb640 1 --2- 172.21.15.31:0/2099034626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69ac1dd4a0 0x7f69ac1404e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:44.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.272+0000 7f69b16ba640 1 -- 172.21.15.31:0/2099034626 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f69ac145530 msgr2=0x7f69ac1dcf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:44.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.272+0000 7f69b16ba640 1 --2- 172.21.15.31:0/2099034626 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f69ac145530 0x7f69ac1dcf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:44.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.272+0000 7f69b16ba640 1 -- 172.21.15.31:0/2099034626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69ac1dd4a0 msgr2=0x7f69ac1404e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:44.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.272+0000 7f69b16ba640 1 --2- 172.21.15.31:0/2099034626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69ac1dd4a0 0x7f69ac1404e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:44.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.272+0000 7f69b16ba640 1 -- 172.21.15.31:0/2099034626 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69ac146820 con 0x7f69980039b0 2024-04-15T00:31:44.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.272+0000 7f69b1ebb640 1 --2- 172.21.15.31:0/2099034626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69ac1dd4a0 0x7f69ac1404e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:31:44.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.273+0000 7f69b16ba640 1 --2- 172.21.15.31:0/2099034626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69980039b0 0x7f69ac09e300 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f69a800c240 tx=0x7f69a802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:44.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.273+0000 7f69a1ffb640 1 -- 172.21.15.31:0/2099034626 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a8007d10 con 0x7f69980039b0 2024-04-15T00:31:44.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.273+0000 7f69a1ffb640 1 -- 172.21.15.31:0/2099034626 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69a8004bf0 con 0x7f69980039b0 2024-04-15T00:31:44.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.273+0000 7f69b391e640 1 -- 172.21.15.31:0/2099034626 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69ac148800 con 0x7f69980039b0 2024-04-15T00:31:44.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.273+0000 7f69a1ffb640 1 -- 172.21.15.31:0/2099034626 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a8007070 con 0x7f69980039b0 2024-04-15T00:31:44.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.273+0000 7f69b391e640 1 -- 172.21.15.31:0/2099034626 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69ac1dca40 con 0x7f69980039b0 2024-04-15T00:31:44.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.274+0000 7f69b391e640 1 -- 172.21.15.31:0/2099034626 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f69ac1dc830 con 0x7f69980039b0 2024-04-15T00:31:44.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.274+0000 7f69a1ffb640 1 -- 172.21.15.31:0/2099034626 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f69a8007210 con 0x7f69980039b0 2024-04-15T00:31:44.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.275+0000 7f69a1ffb640 1 --2- 172.21.15.31:0/2099034626 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f699006b990 0x7f699006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:44.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.275+0000 7f69a1ffb640 1 -- 172.21.15.31:0/2099034626 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f69a80abdd0 con 0x7f69980039b0 2024-04-15T00:31:44.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.275+0000 7f69b0eb9640 1 --2- 172.21.15.31:0/2099034626 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f699006b990 0x7f699006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:44.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.275+0000 7f69a1ffb640 1 --2- 172.21.15.31:0/2099034626 >> [v2:172.21.15.31:6816/2355720818,v1:172.21.15.31:6817/2355720818] conn(0x7f69900753b0 0x7f6990077850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:44.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.275+0000 7f69a1ffb640 1 -- 172.21.15.31:0/2099034626 --> [v2:172.21.15.31:6816/2355720818,v1:172.21.15.31:6817/2355720818] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f69a802ee50 con 0x7f69900753b0 2024-04-15T00:31:44.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.275+0000 7f69a1ffb640 1 -- 172.21.15.31:0/2099034626 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f69a80af020 con 0x7f69980039b0 2024-04-15T00:31:44.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.275+0000 7f69b1ebb640 1 --2- 172.21.15.31:0/2099034626 >> [v2:172.21.15.31:6816/2355720818,v1:172.21.15.31:6817/2355720818] conn(0x7f69900753b0 0x7f6990077850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:44.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.275+0000 7f69b0eb9640 1 --2- 172.21.15.31:0/2099034626 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f699006b990 0x7f699006de50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f69ac1d0690 tx=0x7f699c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:44.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.276+0000 7f69b1ebb640 1 --2- 172.21.15.31:0/2099034626 >> [v2:172.21.15.31:6816/2355720818,v1:172.21.15.31:6817/2355720818] conn(0x7f69900753b0 0x7f6990077850 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:44.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.276+0000 7f69a1ffb640 1 -- 172.21.15.31:0/2099034626 <== osd.0 v2:172.21.15.31:6816/2355720818 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f69a802ee50 con 0x7f69900753b0 2024-04-15T00:31:44.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.290+0000 7f69b391e640 1 -- 172.21.15.31:0/2099034626 --> [v2:172.21.15.31:6816/2355720818,v1:172.21.15.31:6817/2355720818] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f69ac04f620 con 0x7f69900753b0 2024-04-15T00:31:44.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.290+0000 7f69a1ffb640 1 -- 172.21.15.31:0/2099034626 <== osd.0 v2:172.21.15.31:6816/2355720818 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f69ac04f620 con 0x7f69900753b0 2024-04-15T00:31:44.298 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-15T00:31:44.298 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T00:31:44.298 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-15T00:31:44.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.290+0000 7f69b391e640 1 -- 172.21.15.31:0/2099034626 >> [v2:172.21.15.31:6816/2355720818,v1:172.21.15.31:6817/2355720818] conn(0x7f69900753b0 msgr2=0x7f6990077850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:44.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.290+0000 7f69b391e640 1 --2- 172.21.15.31:0/2099034626 >> [v2:172.21.15.31:6816/2355720818,v1:172.21.15.31:6817/2355720818] conn(0x7f69900753b0 0x7f6990077850 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:44.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.290+0000 7f69b391e640 1 -- 172.21.15.31:0/2099034626 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f699006b990 msgr2=0x7f699006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:44.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.290+0000 7f69b391e640 1 --2- 172.21.15.31:0/2099034626 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f699006b990 0x7f699006de50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f69ac1d0690 tx=0x7f699c009040 comp rx=0 tx=0).stop 2024-04-15T00:31:44.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.290+0000 7f69b391e640 1 -- 172.21.15.31:0/2099034626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69980039b0 msgr2=0x7f69ac09e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:44.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.290+0000 7f69b391e640 1 --2- 172.21.15.31:0/2099034626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69980039b0 0x7f69ac09e300 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f69a800c240 tx=0x7f69a802e070 comp rx=0 tx=0).stop 2024-04-15T00:31:44.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.290+0000 7f69b1ebb640 1 -- 172.21.15.31:0/2099034626 reap_dead start 2024-04-15T00:31:44.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.290+0000 7f69b391e640 1 -- 172.21.15.31:0/2099034626 shutdown_connections 2024-04-15T00:31:44.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.290+0000 7f69b391e640 1 -- 172.21.15.31:0/2099034626 >> 172.21.15.31:0/2099034626 conn(0x7f69ac0b5d60 msgr2=0x7f69ac0b71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:44.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.290+0000 7f69b391e640 1 -- 172.21.15.31:0/2099034626 shutdown_connections 2024-04-15T00:31:44.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.290+0000 7f69b391e640 1 -- 172.21.15.31:0/2099034626 wait complete. 2024-04-15T00:31:44.309 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-15T00:31:44.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.404+0000 7f27a3cc4640 1 Processor -- start 2024-04-15T00:31:44.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.404+0000 7f27a3cc4640 1 -- start start 2024-04-15T00:31:44.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.405+0000 7f27a3cc4640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f279c14b570 0x7f279c1414a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:44.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.405+0000 7f27a3cc4640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f279c072a70 con 0x7f279c06fde0 2024-04-15T00:31:44.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.405+0000 7f27a3cc4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f279c06f1d0 con 0x7f279c072690 2024-04-15T00:31:44.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.405+0000 7f27a3cc4640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f279c06efa0 con 0x7f279c14b570 2024-04-15T00:31:44.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.405+0000 7f27a2261640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f279c06fde0 0x7f279c1419e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56226/0 (socket says 172.21.15.31:56226) 2024-04-15T00:31:44.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.405+0000 7f27a2261640 1 -- 172.21.15.31:0/3171400930 learned_addr learned my addr 172.21.15.31:0/3171400930 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:31:44.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.405+0000 7f27a125f640 1 --2- 172.21.15.31:0/3171400930 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f279c14b570 0x7f279c1414a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:44.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.405+0000 7f27a0a5e640 1 -- 172.21.15.31:0/3171400930 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1930678634 0 0) 0x7f279c072a70 con 0x7f279c06fde0 2024-04-15T00:31:44.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.405+0000 7f27a0a5e640 1 -- 172.21.15.31:0/3171400930 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2788003520 con 0x7f279c06fde0 2024-04-15T00:31:44.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.405+0000 7f27a0a5e640 1 -- 172.21.15.31:0/3171400930 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 780596440 0 0) 0x7f279c06f1d0 con 0x7f279c072690 2024-04-15T00:31:44.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.405+0000 7f27a0a5e640 1 -- 172.21.15.31:0/3171400930 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f279c072a70 con 0x7f279c072690 2024-04-15T00:31:44.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.405+0000 7f27a125f640 1 -- 172.21.15.31:0/3171400930 >> v1:172.21.15.50:6789/0 conn(0x7f279c072690 legacy=0x7f279c14ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:44.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.405+0000 7f27a125f640 1 -- 172.21.15.31:0/3171400930 >> v1:172.21.15.31:6789/0 conn(0x7f279c06fde0 legacy=0x7f279c1419e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:44.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.405+0000 7f27a125f640 1 -- 172.21.15.31:0/3171400930 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f279c06f4b0 con 0x7f279c14b570 2024-04-15T00:31:44.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.406+0000 7f27a125f640 1 --2- 172.21.15.31:0/3171400930 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f279c14b570 0x7f279c1414a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f278c0097d0 tx=0x7f278c02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84861946edb4b55b server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:44.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.406+0000 7f27a0a5e640 1 -- 172.21.15.31:0/3171400930 <== mon.2 v2:172.21.15.50:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278c035020 con 0x7f279c14b570 2024-04-15T00:31:44.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.406+0000 7f27a0a5e640 1 -- 172.21.15.31:0/3171400930 <== mon.2 v2:172.21.15.50:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f278c031890 con 0x7f279c14b570 2024-04-15T00:31:44.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.406+0000 7f27a0a5e640 1 -- 172.21.15.31:0/3171400930 <== mon.2 v2:172.21.15.50:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278c031c40 con 0x7f279c14b570 2024-04-15T00:31:44.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.407+0000 7f27a3cc4640 1 -- 172.21.15.31:0/3171400930 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f279c14b570 msgr2=0x7f279c1414a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:44.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.407+0000 7f27a3cc4640 1 --2- 172.21.15.31:0/3171400930 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f279c14b570 0x7f279c1414a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f278c0097d0 tx=0x7f278c02b930 comp rx=0 tx=0).stop 2024-04-15T00:31:44.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.407+0000 7f27a3cc4640 1 -- 172.21.15.31:0/3171400930 shutdown_connections 2024-04-15T00:31:44.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.407+0000 7f27a3cc4640 1 --2- 172.21.15.31:0/3171400930 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f279c14b570 0x7f279c1414a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:44.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.407+0000 7f27a3cc4640 1 -- 172.21.15.31:0/3171400930 >> 172.21.15.31:0/3171400930 conn(0x7f279c0b7840 msgr2=0x7f279c0b7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:44.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.407+0000 7f27a3cc4640 1 -- 172.21.15.31:0/3171400930 shutdown_connections 2024-04-15T00:31:44.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.407+0000 7f27a3cc4640 1 -- 172.21.15.31:0/3171400930 wait complete. 2024-04-15T00:31:44.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.408+0000 7f27a3cc4640 1 Processor -- start 2024-04-15T00:31:44.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.408+0000 7f27a3cc4640 1 -- start start 2024-04-15T00:31:44.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.408+0000 7f27a3cc4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f279c06fde0 0x7f279c13fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:44.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.408+0000 7f27a3cc4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f279c072690 0x7f279c1471b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:44.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.408+0000 7f27a3cc4640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f279c14b570 0x7f279c1341b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:44.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.408+0000 7f27a3cc4640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f279c0b7620 con 0x7f279c06fde0 2024-04-15T00:31:44.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.408+0000 7f27a3cc4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f279c0b74a0 con 0x7f279c072690 2024-04-15T00:31:44.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.408+0000 7f27a3cc4640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f279c1530c0 con 0x7f279c14b570 2024-04-15T00:31:44.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.408+0000 7f27a1a60640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f279c06fde0 0x7f279c13fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:44.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.408+0000 7f27a1a60640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f279c06fde0 0x7f279c13fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57440/0 (socket says 172.21.15.31:57440) 2024-04-15T00:31:44.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.408+0000 7f27a1a60640 1 -- 172.21.15.31:0/3124619112 learned_addr learned my addr 172.21.15.31:0/3124619112 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:44.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.408+0000 7f27a125f640 1 --2- 172.21.15.31:0/3124619112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f279c072690 0x7f279c1471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:44.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.408+0000 7f27a2261640 1 --2- 172.21.15.31:0/3124619112 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f279c14b570 0x7f279c1341b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:44.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.409+0000 7f27a1a60640 1 -- 172.21.15.31:0/3124619112 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f279c14b570 msgr2=0x7f279c1341b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:44.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.409+0000 7f27a1a60640 1 --2- 172.21.15.31:0/3124619112 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f279c14b570 0x7f279c1341b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:44.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.409+0000 7f27a1a60640 1 -- 172.21.15.31:0/3124619112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f279c072690 msgr2=0x7f279c1471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:44.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.409+0000 7f27a1a60640 1 --2- 172.21.15.31:0/3124619112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f279c072690 0x7f279c1471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:44.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.409+0000 7f27a1a60640 1 -- 172.21.15.31:0/3124619112 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f279c1430d0 con 0x7f279c06fde0 2024-04-15T00:31:44.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.409+0000 7f27a1a60640 1 --2- 172.21.15.31:0/3124619112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f279c06fde0 0x7f279c13fd60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f279800c430 tx=0x7f279800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:44.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.409+0000 7f27927fc640 1 -- 172.21.15.31:0/3124619112 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2798017070 con 0x7f279c06fde0 2024-04-15T00:31:44.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.409+0000 7f27927fc640 1 -- 172.21.15.31:0/3124619112 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27980052f0 con 0x7f279c06fde0 2024-04-15T00:31:44.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.409+0000 7f27a3cc4640 1 -- 172.21.15.31:0/3124619112 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f279c1485b0 con 0x7f279c06fde0 2024-04-15T00:31:44.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.409+0000 7f27927fc640 1 -- 172.21.15.31:0/3124619112 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2798003680 con 0x7f279c06fde0 2024-04-15T00:31:44.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.409+0000 7f27a3cc4640 1 -- 172.21.15.31:0/3124619112 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f279c142df0 con 0x7f279c06fde0 2024-04-15T00:31:44.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.410+0000 7f27a3cc4640 1 -- 172.21.15.31:0/3124619112 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f279c04f620 con 0x7f279c06fde0 2024-04-15T00:31:44.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.410+0000 7f27927fc640 1 -- 172.21.15.31:0/3124619112 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f279801a070 con 0x7f279c06fde0 2024-04-15T00:31:44.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.411+0000 7f27927fc640 1 --2- 172.21.15.31:0/3124619112 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f278006b990 0x7f278006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:44.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.411+0000 7f27927fc640 1 -- 172.21.15.31:0/3124619112 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f2798089fe0 con 0x7f279c06fde0 2024-04-15T00:31:44.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.411+0000 7f27a125f640 1 --2- 172.21.15.31:0/3124619112 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f278006b990 0x7f278006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:44.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.411+0000 7f27a125f640 1 --2- 172.21.15.31:0/3124619112 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f278006b990 0x7f278006de50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f278c036000 tx=0x7f278c03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:44.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.415+0000 7f27927fc640 1 -- 172.21.15.31:0/3124619112 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f27980582f0 con 0x7f279c06fde0 2024-04-15T00:31:44.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.596+0000 7f27a3cc4640 1 -- 172.21.15.31:0/3124619112 --> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f279c06d410 con 0x7f278006b990 2024-04-15T00:31:44.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.597+0000 7f27927fc640 1 -- 172.21.15.31:0/3124619112 <== mgr.4107 v2:172.21.15.31:6832/915470279 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f279c06d410 con 0x7f278006b990 2024-04-15T00:31:44.605 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 0 to deep-scrub 2024-04-15T00:31:44.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.599+0000 7f27a3cc4640 1 -- 172.21.15.31:0/3124619112 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f278006b990 msgr2=0x7f278006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:44.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.599+0000 7f27a3cc4640 1 --2- 172.21.15.31:0/3124619112 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f278006b990 0x7f278006de50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f278c036000 tx=0x7f278c03c040 comp rx=0 tx=0).stop 2024-04-15T00:31:44.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.599+0000 7f27a3cc4640 1 -- 172.21.15.31:0/3124619112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f279c06fde0 msgr2=0x7f279c13fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:44.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.599+0000 7f27a3cc4640 1 --2- 172.21.15.31:0/3124619112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f279c06fde0 0x7f279c13fd60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f279800c430 tx=0x7f279800c8f0 comp rx=0 tx=0).stop 2024-04-15T00:31:44.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.599+0000 7f27a3cc4640 1 -- 172.21.15.31:0/3124619112 shutdown_connections 2024-04-15T00:31:44.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.599+0000 7f27a3cc4640 1 --2- 172.21.15.31:0/3124619112 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f278006b990 0x7f278006de50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:44.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.599+0000 7f27a3cc4640 1 --2- 172.21.15.31:0/3124619112 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f279c14b570 0x7f279c1341b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:44.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.599+0000 7f27a3cc4640 1 --2- 172.21.15.31:0/3124619112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f279c072690 0x7f279c1471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:44.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.599+0000 7f27a3cc4640 1 --2- 172.21.15.31:0/3124619112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f279c06fde0 0x7f279c13fd60 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:44.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.599+0000 7f27a3cc4640 1 -- 172.21.15.31:0/3124619112 >> 172.21.15.31:0/3124619112 conn(0x7f279c0b7840 msgr2=0x7f279c0b5ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:44.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.599+0000 7f27a3cc4640 1 -- 172.21.15.31:0/3124619112 shutdown_connections 2024-04-15T00:31:44.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.599+0000 7f27a3cc4640 1 -- 172.21.15.31:0/3124619112 wait complete. 2024-04-15T00:31:44.618 INFO:tasks.ceph:Scrubbing osd.1 2024-04-15T00:31:44.618 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-15T00:31:44.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.717+0000 7f86e557b640 1 Processor -- start 2024-04-15T00:31:44.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.717+0000 7f86e557b640 1 -- start start 2024-04-15T00:31:44.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.718+0000 7f86e557b640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f86e0072820 0x7f86e00b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:44.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.718+0000 7f86e557b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f86e00b8a80 0x7f86e0152000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:44.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.718+0000 7f86e557b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86e0072c00 con 0x7f86e00b77e0 2024-04-15T00:31:44.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.718+0000 7f86e557b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f86e009c400 con 0x7f86e00b8a80 2024-04-15T00:31:44.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.718+0000 7f86e557b640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f86e00b8560 con 0x7f86e0072820 2024-04-15T00:31:44.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.718+0000 7f86de7fc640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f86e00b77e0 0x7f86e0141690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56232/0 (socket says 172.21.15.31:56232) 2024-04-15T00:31:44.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.718+0000 7f86de7fc640 1 -- 172.21.15.31:0/3187386048 learned_addr learned my addr 172.21.15.31:0/3187386048 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:31:44.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.718+0000 7f86df7fe640 1 --2- 172.21.15.31:0/3187386048 >> v2:172.21.15.50:3300/0 conn(0x7f86e00b8a80 0x7f86e0152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:44.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.718+0000 7f86deffd640 1 --2- 172.21.15.31:0/3187386048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f86e0072820 0x7f86e00b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:44.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.718+0000 7f86ddffb640 1 -- 172.21.15.31:0/3187386048 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3252429754 0 0) 0x7f86e0072c00 con 0x7f86e00b77e0 2024-04-15T00:31:44.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.718+0000 7f86ddffb640 1 -- 172.21.15.31:0/3187386048 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86cc003520 con 0x7f86e00b77e0 2024-04-15T00:31:44.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.718+0000 7f86ddffb640 1 -- 172.21.15.31:0/3187386048 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2443308491 0 0) 0x7f86cc003520 con 0x7f86e00b77e0 2024-04-15T00:31:44.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.719+0000 7f86ddffb640 1 -- 172.21.15.31:0/3187386048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f86e0072820 msgr2=0x7f86e00b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:44.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.719+0000 7f86ddffb640 1 --2- 172.21.15.31:0/3187386048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f86e0072820 0x7f86e00b2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:44.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.719+0000 7f86ddffb640 1 -- 172.21.15.31:0/3187386048 >> v2:172.21.15.50:3300/0 conn(0x7f86e00b8a80 msgr2=0x7f86e0152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:44.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.719+0000 7f86ddffb640 1 --2- 172.21.15.31:0/3187386048 >> v2:172.21.15.50:3300/0 conn(0x7f86e00b8a80 0x7f86e0152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:44.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.719+0000 7f86ddffb640 1 -- 172.21.15.31:0/3187386048 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e00b3b70 con 0x7f86e00b77e0 2024-04-15T00:31:44.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.719+0000 7f86ddffb640 1 -- 172.21.15.31:0/3187386048 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 697057150 0 0) 0x7f86c8001670 con 0x7f86e00b77e0 2024-04-15T00:31:44.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.719+0000 7f86ddffb640 1 -- 172.21.15.31:0/3187386048 >> v1:172.21.15.31:6789/0 conn(0x7f86e00b77e0 legacy=0x7f86e0141690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:44.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.719+0000 7f86ddffb640 1 --2- 172.21.15.31:0/3187386048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86cc0039b0 0x7f86cc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:44.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.719+0000 7f86ddffb640 1 --2- 172.21.15.31:0/3187386048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f86e0072820 0x7f86cc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:44.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.719+0000 7f86ddffb640 1 --2- 172.21.15.31:0/3187386048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86cc004d40 0x7f86cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:44.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.719+0000 7f86ddffb640 1 -- 172.21.15.31:0/3187386048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f86e009c400 con 0x7f86cc0039b0 2024-04-15T00:31:44.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.719+0000 7f86ddffb640 1 -- 172.21.15.31:0/3187386048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f86e00b8560 con 0x7f86cc004d40 2024-04-15T00:31:44.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.719+0000 7f86ddffb640 1 -- 172.21.15.31:0/3187386048 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f86cc00b9c0 con 0x7f86e0072820 2024-04-15T00:31:44.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.719+0000 7f86deffd640 1 --2- 172.21.15.31:0/3187386048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86cc0039b0 0x7f86cc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:44.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.719+0000 7f86df7fe640 1 --2- 172.21.15.31:0/3187386048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86cc004d40 0x7f86cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:44.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.719+0000 7f86de7fc640 1 --2- 172.21.15.31:0/3187386048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f86e0072820 0x7f86cc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:44.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.719+0000 7f86deffd640 1 -- 172.21.15.31:0/3187386048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f86e0072820 msgr2=0x7f86cc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:44.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.719+0000 7f86deffd640 1 --2- 172.21.15.31:0/3187386048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f86e0072820 0x7f86cc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:44.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.719+0000 7f86deffd640 1 -- 172.21.15.31:0/3187386048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86cc004d40 msgr2=0x7f86cc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:44.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.719+0000 7f86deffd640 1 --2- 172.21.15.31:0/3187386048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86cc004d40 0x7f86cc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:44.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.719+0000 7f86deffd640 1 -- 172.21.15.31:0/3187386048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86cc003520 con 0x7f86cc0039b0 2024-04-15T00:31:44.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.719+0000 7f86de7fc640 1 --2- 172.21.15.31:0/3187386048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f86e0072820 0x7f86cc004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:31:44.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.719+0000 7f86df7fe640 1 --2- 172.21.15.31:0/3187386048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86cc004d40 0x7f86cc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:31:44.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.720+0000 7f86deffd640 1 --2- 172.21.15.31:0/3187386048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86cc0039b0 0x7f86cc003dd0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f86d8009ac0 tx=0x7f86cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7015b0b9ffb5fefb server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:44.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.720+0000 7f86ddffb640 1 -- 172.21.15.31:0/3187386048 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d8039070 con 0x7f86cc0039b0 2024-04-15T00:31:44.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.720+0000 7f86ddffb640 1 -- 172.21.15.31:0/3187386048 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86d802c6b0 con 0x7f86cc0039b0 2024-04-15T00:31:44.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.720+0000 7f86ddffb640 1 -- 172.21.15.31:0/3187386048 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d8009690 con 0x7f86cc0039b0 2024-04-15T00:31:44.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.721+0000 7f86e557b640 1 -- 172.21.15.31:0/3187386048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86cc0039b0 msgr2=0x7f86cc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:44.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.721+0000 7f86e557b640 1 --2- 172.21.15.31:0/3187386048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86cc0039b0 0x7f86cc003dd0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f86d8009ac0 tx=0x7f86cc005830 comp rx=0 tx=0).stop 2024-04-15T00:31:44.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.721+0000 7f86df7fe640 1 -- 172.21.15.31:0/3187386048 reap_dead start 2024-04-15T00:31:44.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.721+0000 7f86e557b640 1 -- 172.21.15.31:0/3187386048 shutdown_connections 2024-04-15T00:31:44.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.721+0000 7f86e557b640 1 -- 172.21.15.31:0/3187386048 >> 172.21.15.31:0/3187386048 conn(0x7f86e00bce60 msgr2=0x7f86e00bd270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:44.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.721+0000 7f86e557b640 1 -- 172.21.15.31:0/3187386048 shutdown_connections 2024-04-15T00:31:44.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.721+0000 7f86e557b640 1 -- 172.21.15.31:0/3187386048 wait complete. 2024-04-15T00:31:44.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.722+0000 7f86e557b640 1 Processor -- start 2024-04-15T00:31:44.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.722+0000 7f86e557b640 1 -- start start 2024-04-15T00:31:44.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.722+0000 7f86e557b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86cc0039b0 0x7f86e0145630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:44.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.723+0000 7f86e557b640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f86e0146270 0x7f86e01dd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:44.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.723+0000 7f86e557b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86e01dddb0 0x7f86e013af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:44.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.723+0000 7f86e557b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f86e009c010 con 0x7f86e01dddb0 2024-04-15T00:31:44.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.723+0000 7f86e557b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f86e009be90 con 0x7f86cc0039b0 2024-04-15T00:31:44.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.723+0000 7f86e557b640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f86e009c190 con 0x7f86e0146270 2024-04-15T00:31:44.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.723+0000 7f86df7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86e01dddb0 0x7f86e013af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:44.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.723+0000 7f86df7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86e01dddb0 0x7f86e013af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57458/0 (socket says 172.21.15.31:57458) 2024-04-15T00:31:44.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.723+0000 7f86df7fe640 1 -- 172.21.15.31:0/3729260748 learned_addr learned my addr 172.21.15.31:0/3729260748 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:44.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.723+0000 7f86deffd640 1 --2- 172.21.15.31:0/3729260748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86cc0039b0 0x7f86e0145630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:44.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.723+0000 7f86de7fc640 1 --2- 172.21.15.31:0/3729260748 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f86e0146270 0x7f86e01dd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:44.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.723+0000 7f86df7fe640 1 -- 172.21.15.31:0/3729260748 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f86e0146270 msgr2=0x7f86e01dd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:44.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.723+0000 7f86df7fe640 1 --2- 172.21.15.31:0/3729260748 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f86e0146270 0x7f86e01dd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:44.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.723+0000 7f86df7fe640 1 -- 172.21.15.31:0/3729260748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86cc0039b0 msgr2=0x7f86e0145630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:44.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.723+0000 7f86df7fe640 1 --2- 172.21.15.31:0/3729260748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86cc0039b0 0x7f86e0145630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:44.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.723+0000 7f86df7fe640 1 -- 172.21.15.31:0/3729260748 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e01de230 con 0x7f86e01dddb0 2024-04-15T00:31:44.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.723+0000 7f86df7fe640 1 --2- 172.21.15.31:0/3729260748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86e01dddb0 0x7f86e013af50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f86e00b97d0 tx=0x7f86d0010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:44.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.723+0000 7f86d77fe640 1 -- 172.21.15.31:0/3729260748 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d001a030 con 0x7f86e01dddb0 2024-04-15T00:31:44.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.723+0000 7f86d77fe640 1 -- 172.21.15.31:0/3729260748 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86d0010d80 con 0x7f86e01dddb0 2024-04-15T00:31:44.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.723+0000 7f86e557b640 1 -- 172.21.15.31:0/3729260748 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86e0146940 con 0x7f86e01dddb0 2024-04-15T00:31:44.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.723+0000 7f86d77fe640 1 -- 172.21.15.31:0/3729260748 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d0003bd0 con 0x7f86e01dddb0 2024-04-15T00:31:44.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.723+0000 7f86e557b640 1 -- 172.21.15.31:0/3729260748 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86e0147e40 con 0x7f86e01dddb0 2024-04-15T00:31:44.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.724+0000 7f86e557b640 1 -- 172.21.15.31:0/3729260748 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f86e00b7190 con 0x7f86e01dddb0 2024-04-15T00:31:44.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.725+0000 7f86d77fe640 1 -- 172.21.15.31:0/3729260748 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f86d0005d10 con 0x7f86e01dddb0 2024-04-15T00:31:44.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.725+0000 7f86d77fe640 1 --2- 172.21.15.31:0/3729260748 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f86c006b990 0x7f86c006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:44.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.725+0000 7f86d77fe640 1 -- 172.21.15.31:0/3729260748 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f86d008c280 con 0x7f86e01dddb0 2024-04-15T00:31:44.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.725+0000 7f86deffd640 1 --2- 172.21.15.31:0/3729260748 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f86c006b990 0x7f86c006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:44.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.725+0000 7f86d77fe640 1 --2- 172.21.15.31:0/3729260748 >> [v2:172.21.15.31:6808/2705297130,v1:172.21.15.31:6809/2705297130] conn(0x7f86c00753a0 0x7f86c0077840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:44.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.725+0000 7f86d77fe640 1 -- 172.21.15.31:0/3729260748 --> [v2:172.21.15.31:6808/2705297130,v1:172.21.15.31:6809/2705297130] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f86d0010010 con 0x7f86c00753a0 2024-04-15T00:31:44.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.725+0000 7f86d77fe640 1 -- 172.21.15.31:0/3729260748 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f86d008c710 con 0x7f86e01dddb0 2024-04-15T00:31:44.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.726+0000 7f86de7fc640 1 --2- 172.21.15.31:0/3729260748 >> [v2:172.21.15.31:6808/2705297130,v1:172.21.15.31:6809/2705297130] conn(0x7f86c00753a0 0x7f86c0077840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:44.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.726+0000 7f86deffd640 1 --2- 172.21.15.31:0/3729260748 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f86c006b990 0x7f86c006de50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f86d8036000 tx=0x7f86d8030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:44.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.726+0000 7f86de7fc640 1 --2- 172.21.15.31:0/3729260748 >> [v2:172.21.15.31:6808/2705297130,v1:172.21.15.31:6809/2705297130] conn(0x7f86c00753a0 0x7f86c0077840 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:44.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.727+0000 7f86d77fe640 1 -- 172.21.15.31:0/3729260748 <== osd.1 v2:172.21.15.31:6808/2705297130 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f86d0010010 con 0x7f86c00753a0 2024-04-15T00:31:44.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.740+0000 7f86e557b640 1 -- 172.21.15.31:0/3729260748 --> [v2:172.21.15.31:6808/2705297130,v1:172.21.15.31:6809/2705297130] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f86e00b1ec0 con 0x7f86c00753a0 2024-04-15T00:31:44.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.740+0000 7f86d77fe640 1 -- 172.21.15.31:0/3729260748 <== osd.1 v2:172.21.15.31:6808/2705297130 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f86e00b1ec0 con 0x7f86c00753a0 2024-04-15T00:31:44.750 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-15T00:31:44.750 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T00:31:44.751 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-15T00:31:44.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.740+0000 7f86e557b640 1 -- 172.21.15.31:0/3729260748 >> [v2:172.21.15.31:6808/2705297130,v1:172.21.15.31:6809/2705297130] conn(0x7f86c00753a0 msgr2=0x7f86c0077840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:44.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.740+0000 7f86e557b640 1 --2- 172.21.15.31:0/3729260748 >> [v2:172.21.15.31:6808/2705297130,v1:172.21.15.31:6809/2705297130] conn(0x7f86c00753a0 0x7f86c0077840 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:44.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.740+0000 7f86e557b640 1 -- 172.21.15.31:0/3729260748 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f86c006b990 msgr2=0x7f86c006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:44.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.740+0000 7f86e557b640 1 --2- 172.21.15.31:0/3729260748 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f86c006b990 0x7f86c006de50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f86d8036000 tx=0x7f86d8030000 comp rx=0 tx=0).stop 2024-04-15T00:31:44.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.740+0000 7f86e557b640 1 -- 172.21.15.31:0/3729260748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86e01dddb0 msgr2=0x7f86e013af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:44.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.740+0000 7f86e557b640 1 --2- 172.21.15.31:0/3729260748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86e01dddb0 0x7f86e013af50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f86e00b97d0 tx=0x7f86d0010590 comp rx=0 tx=0).stop 2024-04-15T00:31:44.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.740+0000 7f86df7fe640 1 -- 172.21.15.31:0/3729260748 reap_dead start 2024-04-15T00:31:44.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.740+0000 7f86e557b640 1 -- 172.21.15.31:0/3729260748 shutdown_connections 2024-04-15T00:31:44.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.740+0000 7f86e557b640 1 -- 172.21.15.31:0/3729260748 >> 172.21.15.31:0/3729260748 conn(0x7f86e00bce60 msgr2=0x7f86e013c480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:44.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.740+0000 7f86e557b640 1 -- 172.21.15.31:0/3729260748 shutdown_connections 2024-04-15T00:31:44.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.740+0000 7f86e557b640 1 -- 172.21.15.31:0/3729260748 wait complete. 2024-04-15T00:31:44.759 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-15T00:31:44.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.855+0000 7f77b3cb0640 1 Processor -- start 2024-04-15T00:31:44.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.855+0000 7f77b3cb0640 1 -- start start 2024-04-15T00:31:44.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.855+0000 7f77b3cb0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f77ac14b8e0 0x7f77ac0b9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:44.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.855+0000 7f77b3cb0640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f77ac0b8bf0 0x7f77ac151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:44.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.855+0000 7f77b3cb0640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77ac0bb2d0 con 0x7f77ac0baef0 2024-04-15T00:31:44.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.855+0000 7f77b3cb0640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f77ac14ae00 con 0x7f77ac14b8e0 2024-04-15T00:31:44.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.855+0000 7f77b3cb0640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f77ac14b0e0 con 0x7f77ac0b8bf0 2024-04-15T00:31:44.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.856+0000 7f77b224d640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f77ac0b8bf0 0x7f77ac151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:44.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.856+0000 7f77b124b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f77ac14b8e0 0x7f77ac0b9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:44.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.856+0000 7f77b1a4c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f77ac0baef0 0x7f77ac147670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.31:38304/0 (socket says 172.21.15.31:38304) 2024-04-15T00:31:44.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.856+0000 7f77b224d640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f77ac0b8bf0 0x7f77ac151ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.31:58434/0 (socket says 172.21.15.31:58434) 2024-04-15T00:31:44.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.856+0000 7f77b124b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f77ac14b8e0 0x7f77ac0b9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.31:38330/0 (socket says 172.21.15.31:38330) 2024-04-15T00:31:44.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.856+0000 7f77b1a4c640 1 -- 172.21.15.31:0/1579637000 learned_addr learned my addr 172.21.15.31:0/1579637000 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:31:44.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.856+0000 7f77b124b640 1 -- 172.21.15.31:0/1579637000 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f77ac0b8bf0 msgr2=0x7f77ac151ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:44.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.856+0000 7f77b124b640 1 --2- 172.21.15.31:0/1579637000 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f77ac0b8bf0 0x7f77ac151ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:44.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.856+0000 7f77b124b640 1 -- 172.21.15.31:0/1579637000 >> v1:172.21.15.50:6789/0 conn(0x7f77ac0baef0 legacy=0x7f77ac147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:44.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.856+0000 7f77b124b640 1 -- 172.21.15.31:0/1579637000 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77ac0bcbb0 con 0x7f77ac14b8e0 2024-04-15T00:31:44.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.856+0000 7f77b224d640 1 --2- 172.21.15.31:0/1579637000 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f77ac0b8bf0 0x7f77ac151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:31:44.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.857+0000 7f77b124b640 1 --2- 172.21.15.31:0/1579637000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77ac14b8e0 0x7f77ac0b9a10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f779c0097a0 tx=0x7f779c02b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39d33eaf5024abd8 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:44.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.857+0000 7f77b0a4a640 1 -- 172.21.15.31:0/1579637000 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779c031780 con 0x7f77ac14b8e0 2024-04-15T00:31:44.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.857+0000 7f77b0a4a640 1 -- 172.21.15.31:0/1579637000 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f779c037070 con 0x7f77ac14b8e0 2024-04-15T00:31:44.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.857+0000 7f77b0a4a640 1 -- 172.21.15.31:0/1579637000 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779c031b40 con 0x7f77ac14b8e0 2024-04-15T00:31:44.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.858+0000 7f77b3cb0640 1 -- 172.21.15.31:0/1579637000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77ac14b8e0 msgr2=0x7f77ac0b9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:44.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.858+0000 7f77b3cb0640 1 --2- 172.21.15.31:0/1579637000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77ac14b8e0 0x7f77ac0b9a10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f779c0097a0 tx=0x7f779c02b820 comp rx=0 tx=0).stop 2024-04-15T00:31:44.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.858+0000 7f77b3cb0640 1 -- 172.21.15.31:0/1579637000 shutdown_connections 2024-04-15T00:31:44.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.858+0000 7f77b3cb0640 1 --2- 172.21.15.31:0/1579637000 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f77ac0b8bf0 0x7f77ac151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:44.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.858+0000 7f77b3cb0640 1 --2- 172.21.15.31:0/1579637000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77ac14b8e0 0x7f77ac0b9a10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:44.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.858+0000 7f77b3cb0640 1 -- 172.21.15.31:0/1579637000 >> 172.21.15.31:0/1579637000 conn(0x7f77ac09ed70 msgr2=0x7f77ac09f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:44.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.858+0000 7f77b3cb0640 1 -- 172.21.15.31:0/1579637000 shutdown_connections 2024-04-15T00:31:44.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.858+0000 7f77b3cb0640 1 -- 172.21.15.31:0/1579637000 wait complete. 2024-04-15T00:31:44.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.859+0000 7f77b3cb0640 1 Processor -- start 2024-04-15T00:31:44.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.859+0000 7f77b3cb0640 1 -- start start 2024-04-15T00:31:44.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.860+0000 7f77b3cb0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77ac0b8bf0 0x7f77ac143000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:44.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.860+0000 7f77b3cb0640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f77ac0baef0 0x7f77ac1dda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:44.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.860+0000 7f77b3cb0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77ac14b8e0 0x7f77ac1ddf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:44.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.860+0000 7f77b3cb0640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f77ac0b91c0 con 0x7f77ac14b8e0 2024-04-15T00:31:44.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.860+0000 7f77b3cb0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f77ac0b9040 con 0x7f77ac0b8bf0 2024-04-15T00:31:44.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.860+0000 7f77b3cb0640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f77ac0b9340 con 0x7f77ac0baef0 2024-04-15T00:31:44.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.860+0000 7f77b224d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77ac14b8e0 0x7f77ac1ddf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:44.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.860+0000 7f77b224d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77ac14b8e0 0x7f77ac1ddf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57466/0 (socket says 172.21.15.31:57466) 2024-04-15T00:31:44.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.860+0000 7f77b1a4c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77ac0b8bf0 0x7f77ac143000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:44.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.860+0000 7f77b224d640 1 -- 172.21.15.31:0/4543800 learned_addr learned my addr 172.21.15.31:0/4543800 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:44.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.860+0000 7f77b124b640 1 --2- 172.21.15.31:0/4543800 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f77ac0baef0 0x7f77ac1dda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:44.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.860+0000 7f77b224d640 1 -- 172.21.15.31:0/4543800 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f77ac0baef0 msgr2=0x7f77ac1dda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:44.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.860+0000 7f77b224d640 1 --2- 172.21.15.31:0/4543800 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f77ac0baef0 0x7f77ac1dda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:44.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.860+0000 7f77b224d640 1 -- 172.21.15.31:0/4543800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77ac0b8bf0 msgr2=0x7f77ac143000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:44.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.860+0000 7f77b224d640 1 --2- 172.21.15.31:0/4543800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77ac0b8bf0 0x7f77ac143000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:44.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.860+0000 7f77b224d640 1 -- 172.21.15.31:0/4543800 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77ac1dd530 con 0x7f77ac14b8e0 2024-04-15T00:31:44.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.860+0000 7f77b1a4c640 1 --2- 172.21.15.31:0/4543800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77ac0b8bf0 0x7f77ac143000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:31:44.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.860+0000 7f77b224d640 1 --2- 172.21.15.31:0/4543800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77ac14b8e0 0x7f77ac1ddf70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f77a4009e60 tx=0x7f77a400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:44.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.860+0000 7f77a27fc640 1 -- 172.21.15.31:0/4543800 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a4018030 con 0x7f77ac14b8e0 2024-04-15T00:31:44.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.861+0000 7f77a27fc640 1 -- 172.21.15.31:0/4543800 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77a400cdf0 con 0x7f77ac14b8e0 2024-04-15T00:31:44.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.861+0000 7f77b3cb0640 1 -- 172.21.15.31:0/4543800 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77ac1446a0 con 0x7f77ac14b8e0 2024-04-15T00:31:44.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.861+0000 7f77a27fc640 1 -- 172.21.15.31:0/4543800 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a4003bb0 con 0x7f77ac14b8e0 2024-04-15T00:31:44.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.861+0000 7f77b3cb0640 1 -- 172.21.15.31:0/4543800 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77ac0a05f0 con 0x7f77ac14b8e0 2024-04-15T00:31:44.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.862+0000 7f77b3cb0640 1 -- 172.21.15.31:0/4543800 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77ac04f620 con 0x7f77ac14b8e0 2024-04-15T00:31:44.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.862+0000 7f77a27fc640 1 -- 172.21.15.31:0/4543800 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f77a401b070 con 0x7f77ac14b8e0 2024-04-15T00:31:44.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.862+0000 7f77a27fc640 1 --2- 172.21.15.31:0/4543800 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f779006b990 0x7f779006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:44.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.863+0000 7f77a27fc640 1 -- 172.21.15.31:0/4543800 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f77a408b470 con 0x7f77ac14b8e0 2024-04-15T00:31:44.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.863+0000 7f77b1a4c640 1 --2- 172.21.15.31:0/4543800 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f779006b990 0x7f779006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:44.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.863+0000 7f77b1a4c640 1 --2- 172.21.15.31:0/4543800 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f779006b990 0x7f779006de50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f77a8007fd0 tx=0x7f77a8007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:44.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:44.867+0000 7f77a27fc640 1 -- 172.21.15.31:0/4543800 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f77a4010040 con 0x7f77ac14b8e0 2024-04-15T00:31:45.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.049+0000 7f77b3cb0640 1 -- 172.21.15.31:0/4543800 --> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f77ac149660 con 0x7f779006b990 2024-04-15T00:31:45.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.049+0000 7f77a27fc640 1 -- 172.21.15.31:0/4543800 <== mgr.4107 v2:172.21.15.31:6832/915470279 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f77ac149660 con 0x7f779006b990 2024-04-15T00:31:45.059 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 1 to deep-scrub 2024-04-15T00:31:45.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.052+0000 7f77b3cb0640 1 -- 172.21.15.31:0/4543800 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f779006b990 msgr2=0x7f779006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:45.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.052+0000 7f77b3cb0640 1 --2- 172.21.15.31:0/4543800 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f779006b990 0x7f779006de50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f77a8007fd0 tx=0x7f77a8007e80 comp rx=0 tx=0).stop 2024-04-15T00:31:45.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.052+0000 7f77b3cb0640 1 -- 172.21.15.31:0/4543800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77ac14b8e0 msgr2=0x7f77ac1ddf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:45.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.052+0000 7f77b3cb0640 1 --2- 172.21.15.31:0/4543800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77ac14b8e0 0x7f77ac1ddf70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f77a4009e60 tx=0x7f77a400c490 comp rx=0 tx=0).stop 2024-04-15T00:31:45.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.052+0000 7f77b3cb0640 1 -- 172.21.15.31:0/4543800 shutdown_connections 2024-04-15T00:31:45.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.052+0000 7f77b3cb0640 1 --2- 172.21.15.31:0/4543800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77ac14b8e0 0x7f77ac1ddf70 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.052+0000 7f77b3cb0640 1 --2- 172.21.15.31:0/4543800 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f779006b990 0x7f779006de50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.052+0000 7f77b3cb0640 1 --2- 172.21.15.31:0/4543800 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f77ac0baef0 0x7f77ac1dda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.052+0000 7f77b3cb0640 1 --2- 172.21.15.31:0/4543800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77ac0b8bf0 0x7f77ac143000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.052+0000 7f77b3cb0640 1 -- 172.21.15.31:0/4543800 >> 172.21.15.31:0/4543800 conn(0x7f77ac09ed70 msgr2=0x7f77ac148830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:45.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.052+0000 7f77b3cb0640 1 -- 172.21.15.31:0/4543800 shutdown_connections 2024-04-15T00:31:45.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.052+0000 7f77b3cb0640 1 -- 172.21.15.31:0/4543800 wait complete. 2024-04-15T00:31:45.072 INFO:tasks.ceph:Scrubbing osd.2 2024-04-15T00:31:45.072 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-15T00:31:45.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.170+0000 7ffb62ade640 1 Processor -- start 2024-04-15T00:31:45.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.171+0000 7ffb62ade640 1 -- start start 2024-04-15T00:31:45.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.171+0000 7ffb62ade640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffb5c072820 0x7ffb5c0b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:45.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.171+0000 7ffb62ade640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffb5c0b77e0 0x7ffb5c141690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:45.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.171+0000 7ffb62ade640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb5c072c00 con 0x7ffb5c0b8a80 2024-04-15T00:31:45.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.171+0000 7ffb62ade640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7ffb5c09c400 con 0x7ffb5c0b77e0 2024-04-15T00:31:45.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.171+0000 7ffb62ade640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7ffb5c0b8560 con 0x7ffb5c072820 2024-04-15T00:31:45.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.171+0000 7ffb6087a640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffb5c072820 0x7ffb5c0b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:45.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.171+0000 7ffb5bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffb5c0b77e0 0x7ffb5c141690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:45.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.172+0000 7ffb6087a640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffb5c072820 0x7ffb5c0b2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3301/0 says I am v2:172.21.15.31:58462/0 (socket says 172.21.15.31:58462) 2024-04-15T00:31:45.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.172+0000 7ffb5bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffb5c0b77e0 0x7ffb5c141690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.31:38354/0 (socket says 172.21.15.31:38354) 2024-04-15T00:31:45.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.172+0000 7ffb6107b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ffb5c0b8a80 0x7ffb5c14acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.31:38320/0 (socket says 172.21.15.31:38320) 2024-04-15T00:31:45.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.172+0000 7ffb6087a640 1 -- 172.21.15.31:0/1968796589 learned_addr learned my addr 172.21.15.31:0/1968796589 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:45.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.172+0000 7ffb5bfff640 1 -- 172.21.15.31:0/1968796589 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffb5c072820 msgr2=0x7ffb5c0b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:45.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.172+0000 7ffb5bfff640 1 --2- 172.21.15.31:0/1968796589 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffb5c072820 0x7ffb5c0b2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.172+0000 7ffb5bfff640 1 -- 172.21.15.31:0/1968796589 >> v1:172.21.15.50:6789/0 conn(0x7ffb5c0b8a80 legacy=0x7ffb5c14acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:45.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.172+0000 7ffb5b7fe640 1 -- 172.21.15.31:0/1968796589 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3014027851 0 0) 0x7ffb5c072c00 con 0x7ffb5c0b8a80 2024-04-15T00:31:45.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.172+0000 7ffb5bfff640 1 -- 172.21.15.31:0/1968796589 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb5c0b3b70 con 0x7ffb5c0b77e0 2024-04-15T00:31:45.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.173+0000 7ffb5bfff640 1 --2- 172.21.15.31:0/1968796589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb5c0b77e0 0x7ffb5c141690 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffb480097a0 tx=0x7ffb4802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abfb0ff02fbd28f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:45.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.173+0000 7ffb5b7fe640 1 -- 172.21.15.31:0/1968796589 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb48035020 con 0x7ffb5c0b77e0 2024-04-15T00:31:45.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.173+0000 7ffb5b7fe640 1 -- 172.21.15.31:0/1968796589 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb48031830 con 0x7ffb5c0b77e0 2024-04-15T00:31:45.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.173+0000 7ffb5b7fe640 1 -- 172.21.15.31:0/1968796589 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb48031c00 con 0x7ffb5c0b77e0 2024-04-15T00:31:45.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.173+0000 7ffb62ade640 1 -- 172.21.15.31:0/1968796589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb5c0b77e0 msgr2=0x7ffb5c141690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:45.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.173+0000 7ffb62ade640 1 --2- 172.21.15.31:0/1968796589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb5c0b77e0 0x7ffb5c141690 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffb480097a0 tx=0x7ffb4802b8d0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.173+0000 7ffb62ade640 1 -- 172.21.15.31:0/1968796589 shutdown_connections 2024-04-15T00:31:45.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.173+0000 7ffb62ade640 1 --2- 172.21.15.31:0/1968796589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb5c0b77e0 0x7ffb5c141690 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.173+0000 7ffb62ade640 1 --2- 172.21.15.31:0/1968796589 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffb5c072820 0x7ffb5c0b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.173+0000 7ffb62ade640 1 -- 172.21.15.31:0/1968796589 >> 172.21.15.31:0/1968796589 conn(0x7ffb5c0bce60 msgr2=0x7ffb5c0bd270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:45.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.173+0000 7ffb62ade640 1 -- 172.21.15.31:0/1968796589 shutdown_connections 2024-04-15T00:31:45.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.173+0000 7ffb62ade640 1 -- 172.21.15.31:0/1968796589 wait complete. 2024-04-15T00:31:45.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.174+0000 7ffb62ade640 1 Processor -- start 2024-04-15T00:31:45.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.174+0000 7ffb62ade640 1 -- start start 2024-04-15T00:31:45.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.175+0000 7ffb62ade640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb5c072820 0x7ffb5c0bbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:45.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.175+0000 7ffb62ade640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffb5c0b77e0 0x7ffb5c1e1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:45.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.175+0000 7ffb62ade640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb5c0b8a80 0x7ffb5c1ddc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:45.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.175+0000 7ffb62ade640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5c09c010 con 0x7ffb5c072820 2024-04-15T00:31:45.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.175+0000 7ffb62ade640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5c09be90 con 0x7ffb5c0b8a80 2024-04-15T00:31:45.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.175+0000 7ffb62ade640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7ffb5c09c190 con 0x7ffb5c0b77e0 2024-04-15T00:31:45.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.175+0000 7ffb6087a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb5c072820 0x7ffb5c0bbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:45.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.175+0000 7ffb6087a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb5c072820 0x7ffb5c0bbf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57468/0 (socket says 172.21.15.31:57468) 2024-04-15T00:31:45.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.175+0000 7ffb6087a640 1 -- 172.21.15.31:0/980577048 learned_addr learned my addr 172.21.15.31:0/980577048 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:45.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.176+0000 7ffb6107b640 1 --2- 172.21.15.31:0/980577048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb5c0b8a80 0x7ffb5c1ddc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:45.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.176+0000 7ffb5bfff640 1 --2- 172.21.15.31:0/980577048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffb5c0b77e0 0x7ffb5c1e1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:45.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.176+0000 7ffb6087a640 1 -- 172.21.15.31:0/980577048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffb5c0b77e0 msgr2=0x7ffb5c1e1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:45.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.176+0000 7ffb6087a640 1 --2- 172.21.15.31:0/980577048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffb5c0b77e0 0x7ffb5c1e1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.176+0000 7ffb6087a640 1 -- 172.21.15.31:0/980577048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb5c0b8a80 msgr2=0x7ffb5c1ddc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:45.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.176+0000 7ffb6087a640 1 --2- 172.21.15.31:0/980577048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb5c0b8a80 0x7ffb5c1ddc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.176+0000 7ffb6087a640 1 -- 172.21.15.31:0/980577048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb5c1e0cc0 con 0x7ffb5c072820 2024-04-15T00:31:45.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.176+0000 7ffb5bfff640 1 --2- 172.21.15.31:0/980577048 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ffb5c0b77e0 0x7ffb5c1e1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:31:45.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.176+0000 7ffb6087a640 1 --2- 172.21.15.31:0/980577048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb5c072820 0x7ffb5c0bbf30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ffb50009fd0 tx=0x7ffb5000ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:45.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.176+0000 7ffb597fa640 1 -- 172.21.15.31:0/980577048 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb50017070 con 0x7ffb5c072820 2024-04-15T00:31:45.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.176+0000 7ffb597fa640 1 -- 172.21.15.31:0/980577048 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb5000c940 con 0x7ffb5c072820 2024-04-15T00:31:45.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.176+0000 7ffb597fa640 1 -- 172.21.15.31:0/980577048 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5000cd10 con 0x7ffb5c072820 2024-04-15T00:31:45.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.176+0000 7ffb62ade640 1 -- 172.21.15.31:0/980577048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb5c1433e0 con 0x7ffb5c072820 2024-04-15T00:31:45.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.176+0000 7ffb62ade640 1 -- 172.21.15.31:0/980577048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb5c0bcbb0 con 0x7ffb5c072820 2024-04-15T00:31:45.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.177+0000 7ffb62ade640 1 -- 172.21.15.31:0/980577048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffb5c0b7190 con 0x7ffb5c072820 2024-04-15T00:31:45.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.177+0000 7ffb597fa640 1 -- 172.21.15.31:0/980577048 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7ffb5001a070 con 0x7ffb5c072820 2024-04-15T00:31:45.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.178+0000 7ffb597fa640 1 --2- 172.21.15.31:0/980577048 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7ffb4006b9c0 0x7ffb4006de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:45.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.178+0000 7ffb597fa640 1 -- 172.21.15.31:0/980577048 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ffb5008abd0 con 0x7ffb5c072820 2024-04-15T00:31:45.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.178+0000 7ffb5bfff640 1 --2- 172.21.15.31:0/980577048 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7ffb4006b9c0 0x7ffb4006de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:45.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.178+0000 7ffb597fa640 1 --2- 172.21.15.31:0/980577048 >> [v2:172.21.15.31:6800/225061474,v1:172.21.15.31:6801/225061474] conn(0x7ffb40075450 0x7ffb400778f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:45.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.178+0000 7ffb597fa640 1 -- 172.21.15.31:0/980577048 --> [v2:172.21.15.31:6800/225061474,v1:172.21.15.31:6801/225061474] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffb40077fc0 con 0x7ffb40075450 2024-04-15T00:31:45.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.178+0000 7ffb597fa640 1 -- 172.21.15.31:0/980577048 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ffb5008f280 con 0x7ffb5c072820 2024-04-15T00:31:45.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.178+0000 7ffb6107b640 1 --2- 172.21.15.31:0/980577048 >> [v2:172.21.15.31:6800/225061474,v1:172.21.15.31:6801/225061474] conn(0x7ffb40075450 0x7ffb400778f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:45.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.178+0000 7ffb5bfff640 1 --2- 172.21.15.31:0/980577048 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7ffb4006b9c0 0x7ffb4006de80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ffb48036000 tx=0x7ffb48008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:45.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.178+0000 7ffb6107b640 1 --2- 172.21.15.31:0/980577048 >> [v2:172.21.15.31:6800/225061474,v1:172.21.15.31:6801/225061474] conn(0x7ffb40075450 0x7ffb400778f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:45.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.179+0000 7ffb597fa640 1 -- 172.21.15.31:0/980577048 <== osd.2 v2:172.21.15.31:6800/225061474 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffb40077fc0 con 0x7ffb40075450 2024-04-15T00:31:45.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.192+0000 7ffb62ade640 1 -- 172.21.15.31:0/980577048 --> [v2:172.21.15.31:6800/225061474,v1:172.21.15.31:6801/225061474] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ffb5c1e1080 con 0x7ffb40075450 2024-04-15T00:31:45.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.193+0000 7ffb597fa640 1 -- 172.21.15.31:0/980577048 <== osd.2 v2:172.21.15.31:6800/225061474 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ffb5c1e1080 con 0x7ffb40075450 2024-04-15T00:31:45.204 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-15T00:31:45.204 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T00:31:45.204 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-15T00:31:45.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.193+0000 7ffb62ade640 1 -- 172.21.15.31:0/980577048 >> [v2:172.21.15.31:6800/225061474,v1:172.21.15.31:6801/225061474] conn(0x7ffb40075450 msgr2=0x7ffb400778f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:45.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.193+0000 7ffb62ade640 1 --2- 172.21.15.31:0/980577048 >> [v2:172.21.15.31:6800/225061474,v1:172.21.15.31:6801/225061474] conn(0x7ffb40075450 0x7ffb400778f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.193+0000 7ffb62ade640 1 -- 172.21.15.31:0/980577048 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7ffb4006b9c0 msgr2=0x7ffb4006de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:45.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.193+0000 7ffb62ade640 1 --2- 172.21.15.31:0/980577048 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7ffb4006b9c0 0x7ffb4006de80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ffb48036000 tx=0x7ffb48008030 comp rx=0 tx=0).stop 2024-04-15T00:31:45.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.193+0000 7ffb62ade640 1 -- 172.21.15.31:0/980577048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb5c072820 msgr2=0x7ffb5c0bbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:45.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.193+0000 7ffb62ade640 1 --2- 172.21.15.31:0/980577048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb5c072820 0x7ffb5c0bbf30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ffb50009fd0 tx=0x7ffb5000ed40 comp rx=0 tx=0).stop 2024-04-15T00:31:45.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.193+0000 7ffb6107b640 1 -- 172.21.15.31:0/980577048 reap_dead start 2024-04-15T00:31:45.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.193+0000 7ffb62ade640 1 -- 172.21.15.31:0/980577048 shutdown_connections 2024-04-15T00:31:45.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.193+0000 7ffb62ade640 1 -- 172.21.15.31:0/980577048 >> 172.21.15.31:0/980577048 conn(0x7ffb5c0bce60 msgr2=0x7ffb5c09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:45.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.193+0000 7ffb62ade640 1 -- 172.21.15.31:0/980577048 shutdown_connections 2024-04-15T00:31:45.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.193+0000 7ffb62ade640 1 -- 172.21.15.31:0/980577048 wait complete. 2024-04-15T00:31:45.212 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-15T00:31:45.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.307+0000 7f337e620640 1 Processor -- start 2024-04-15T00:31:45.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.307+0000 7f337e620640 1 -- start start 2024-04-15T00:31:45.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.307+0000 7f337e620640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f33780baef0 0x7f3378147670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:45.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.307+0000 7f337e620640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f337814b8e0 0x7f33780b9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:45.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.307+0000 7f337e620640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f33780b8bf0 0x7f3378072600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:45.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.307+0000 7f337e620640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f33780bb2d0 con 0x7f33780baef0 2024-04-15T00:31:45.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.307+0000 7f337e620640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f3378147bb0 con 0x7f33780b8bf0 2024-04-15T00:31:45.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.307+0000 7f337e620640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f337814ae00 con 0x7f337814b8e0 2024-04-15T00:31:45.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.308+0000 7f3377fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f33780baef0 0x7f3378147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:45.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.308+0000 7f3377fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f33780baef0 0x7f3378147670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57482/0 (socket says 172.21.15.31:57482) 2024-04-15T00:31:45.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.308+0000 7f3377fff640 1 -- 172.21.15.31:0/1101844235 learned_addr learned my addr 172.21.15.31:0/1101844235 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:45.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.308+0000 7f337cbbd640 1 --2- 172.21.15.31:0/1101844235 >> v2:172.21.15.50:3300/0 conn(0x7f33780b8bf0 0x7f3378072600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:45.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.308+0000 7f33777fe640 1 --2- 172.21.15.31:0/1101844235 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f337814b8e0 0x7f33780b9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:45.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.308+0000 7f3377fff640 1 -- 172.21.15.31:0/1101844235 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f337814b8e0 msgr2=0x7f33780b9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:45.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.308+0000 7f3377fff640 1 --2- 172.21.15.31:0/1101844235 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f337814b8e0 0x7f33780b9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.308+0000 7f3377fff640 1 -- 172.21.15.31:0/1101844235 >> v2:172.21.15.50:3300/0 conn(0x7f33780b8bf0 msgr2=0x7f3378072600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:45.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.308+0000 7f3377fff640 1 --2- 172.21.15.31:0/1101844235 >> v2:172.21.15.50:3300/0 conn(0x7f33780b8bf0 0x7f3378072600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.308+0000 7f3377fff640 1 -- 172.21.15.31:0/1101844235 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f337814b0e0 con 0x7f33780baef0 2024-04-15T00:31:45.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.308+0000 7f33777fe640 1 --2- 172.21.15.31:0/1101844235 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f337814b8e0 0x7f33780b9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:31:45.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.309+0000 7f3377fff640 1 --2- 172.21.15.31:0/1101844235 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33780baef0 0x7f3378147670 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3378071df0 tx=0x7f336802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=184e826e33709a07 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:45.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.309+0000 7f3376ffd640 1 -- 172.21.15.31:0/1101844235 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336802e070 con 0x7f33780baef0 2024-04-15T00:31:45.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.309+0000 7f3376ffd640 1 -- 172.21.15.31:0/1101844235 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3368037070 con 0x7f33780baef0 2024-04-15T00:31:45.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.309+0000 7f3376ffd640 1 -- 172.21.15.31:0/1101844235 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3368031a00 con 0x7f33780baef0 2024-04-15T00:31:45.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.309+0000 7f337e620640 1 -- 172.21.15.31:0/1101844235 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33780baef0 msgr2=0x7f3378147670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:45.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.309+0000 7f337e620640 1 --2- 172.21.15.31:0/1101844235 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33780baef0 0x7f3378147670 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3378071df0 tx=0x7f336802b880 comp rx=0 tx=0).stop 2024-04-15T00:31:45.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.309+0000 7f337e620640 1 -- 172.21.15.31:0/1101844235 shutdown_connections 2024-04-15T00:31:45.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.309+0000 7f337e620640 1 --2- 172.21.15.31:0/1101844235 >> v2:172.21.15.50:3300/0 conn(0x7f33780b8bf0 0x7f3378072600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.309+0000 7f337e620640 1 --2- 172.21.15.31:0/1101844235 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f337814b8e0 0x7f33780b9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.309+0000 7f337e620640 1 --2- 172.21.15.31:0/1101844235 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33780baef0 0x7f3378147670 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.309+0000 7f337e620640 1 -- 172.21.15.31:0/1101844235 >> 172.21.15.31:0/1101844235 conn(0x7f337809ed70 msgr2=0x7f337809f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:45.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.309+0000 7f337e620640 1 -- 172.21.15.31:0/1101844235 shutdown_connections 2024-04-15T00:31:45.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.309+0000 7f337e620640 1 -- 172.21.15.31:0/1101844235 wait complete. 2024-04-15T00:31:45.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.310+0000 7f337e620640 1 Processor -- start 2024-04-15T00:31:45.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.310+0000 7f337e620640 1 -- start start 2024-04-15T00:31:45.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.311+0000 7f337e620640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33780b8bf0 0x7f33780a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:45.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.311+0000 7f337e620640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33780baef0 0x7f33781e03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:45.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.311+0000 7f337e620640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f337814b8e0 0x7f33781e0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:45.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.311+0000 7f337e620640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f33780ba0d0 con 0x7f33780b8bf0 2024-04-15T00:31:45.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.311+0000 7f337e620640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f33780b9f50 con 0x7f33780baef0 2024-04-15T00:31:45.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.311+0000 7f337e620640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f33780b9060 con 0x7f337814b8e0 2024-04-15T00:31:45.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.311+0000 7f3377fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33780b8bf0 0x7f33780a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:45.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.311+0000 7f3377fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33780b8bf0 0x7f33780a1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57490/0 (socket says 172.21.15.31:57490) 2024-04-15T00:31:45.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.311+0000 7f3377fff640 1 -- 172.21.15.31:0/1374092515 learned_addr learned my addr 172.21.15.31:0/1374092515 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:45.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.311+0000 7f33777fe640 1 --2- 172.21.15.31:0/1374092515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33780baef0 0x7f33781e03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:45.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.311+0000 7f337cbbd640 1 --2- 172.21.15.31:0/1374092515 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f337814b8e0 0x7f33781e0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:45.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.311+0000 7f3377fff640 1 -- 172.21.15.31:0/1374092515 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f337814b8e0 msgr2=0x7f33781e0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:45.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.311+0000 7f3377fff640 1 --2- 172.21.15.31:0/1374092515 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f337814b8e0 0x7f33781e0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.311+0000 7f3377fff640 1 -- 172.21.15.31:0/1374092515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33780baef0 msgr2=0x7f33781e03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:45.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.311+0000 7f3377fff640 1 --2- 172.21.15.31:0/1374092515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33780baef0 0x7f33781e03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.311+0000 7f3377fff640 1 -- 172.21.15.31:0/1374092515 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33781d16f0 con 0x7f33780b8bf0 2024-04-15T00:31:45.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.311+0000 7f337cbbd640 1 --2- 172.21.15.31:0/1374092515 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f337814b8e0 0x7f33781e0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:31:45.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.312+0000 7f3377fff640 1 --2- 172.21.15.31:0/1374092515 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33780b8bf0 0x7f33780a1a00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3368000c00 tx=0x7f33680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:45.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.312+0000 7f3374ff9640 1 -- 172.21.15.31:0/1374092515 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3368032670 con 0x7f33780b8bf0 2024-04-15T00:31:45.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.312+0000 7f3374ff9640 1 -- 172.21.15.31:0/1374092515 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3368032850 con 0x7f33780b8bf0 2024-04-15T00:31:45.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.312+0000 7f337e620640 1 -- 172.21.15.31:0/1374092515 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3378144b10 con 0x7f33780b8bf0 2024-04-15T00:31:45.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.312+0000 7f3374ff9640 1 -- 172.21.15.31:0/1374092515 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3368032c40 con 0x7f33780b8bf0 2024-04-15T00:31:45.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.312+0000 7f337e620640 1 -- 172.21.15.31:0/1374092515 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33780a2690 con 0x7f33780b8bf0 2024-04-15T00:31:45.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.313+0000 7f337e620640 1 -- 172.21.15.31:0/1374092515 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f337804f620 con 0x7f33780b8bf0 2024-04-15T00:31:45.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.313+0000 7f3374ff9640 1 -- 172.21.15.31:0/1374092515 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f33680453f0 con 0x7f33780b8bf0 2024-04-15T00:31:45.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.314+0000 7f3374ff9640 1 --2- 172.21.15.31:0/1374092515 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f336406b990 0x7f336406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:45.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.314+0000 7f3374ff9640 1 -- 172.21.15.31:0/1374092515 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f33680ac9f0 con 0x7f33780b8bf0 2024-04-15T00:31:45.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.314+0000 7f33777fe640 1 --2- 172.21.15.31:0/1374092515 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f336406b990 0x7f336406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:45.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.314+0000 7f33777fe640 1 --2- 172.21.15.31:0/1374092515 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f336406b990 0x7f336406de50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3378141810 tx=0x7f336c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:45.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.318+0000 7f3374ff9640 1 -- 172.21.15.31:0/1374092515 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f3368040070 con 0x7f33780b8bf0 2024-04-15T00:31:45.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.501+0000 7f337e620640 1 -- 172.21.15.31:0/1374092515 --> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f3378145680 con 0x7f336406b990 2024-04-15T00:31:45.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.501+0000 7f3374ff9640 1 -- 172.21.15.31:0/1374092515 <== mgr.4107 v2:172.21.15.31:6832/915470279 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3378145680 con 0x7f336406b990 2024-04-15T00:31:45.510 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 2 to deep-scrub 2024-04-15T00:31:45.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.503+0000 7f337e620640 1 -- 172.21.15.31:0/1374092515 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f336406b990 msgr2=0x7f336406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:45.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.503+0000 7f337e620640 1 --2- 172.21.15.31:0/1374092515 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f336406b990 0x7f336406de50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3378141810 tx=0x7f336c008040 comp rx=0 tx=0).stop 2024-04-15T00:31:45.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.503+0000 7f337e620640 1 -- 172.21.15.31:0/1374092515 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33780b8bf0 msgr2=0x7f33780a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:45.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.503+0000 7f337e620640 1 --2- 172.21.15.31:0/1374092515 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33780b8bf0 0x7f33780a1a00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3368000c00 tx=0x7f33680046c0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.503+0000 7f337e620640 1 -- 172.21.15.31:0/1374092515 shutdown_connections 2024-04-15T00:31:45.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.503+0000 7f337e620640 1 --2- 172.21.15.31:0/1374092515 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f336406b990 0x7f336406de50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.503+0000 7f337e620640 1 --2- 172.21.15.31:0/1374092515 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f337814b8e0 0x7f33781e0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.503+0000 7f337e620640 1 --2- 172.21.15.31:0/1374092515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33780baef0 0x7f33781e03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.503+0000 7f337e620640 1 --2- 172.21.15.31:0/1374092515 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33780b8bf0 0x7f33780a1a00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.503+0000 7f337e620640 1 -- 172.21.15.31:0/1374092515 >> 172.21.15.31:0/1374092515 conn(0x7f337809ed70 msgr2=0x7f337809b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:45.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.503+0000 7f337e620640 1 -- 172.21.15.31:0/1374092515 shutdown_connections 2024-04-15T00:31:45.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.503+0000 7f337e620640 1 -- 172.21.15.31:0/1374092515 wait complete. 2024-04-15T00:31:45.523 INFO:tasks.ceph:Scrubbing osd.3 2024-04-15T00:31:45.523 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-15T00:31:45.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.620+0000 7f7bfa498640 1 Processor -- start 2024-04-15T00:31:45.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.620+0000 7f7bfa498640 1 -- start start 2024-04-15T00:31:45.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.621+0000 7f7bfa498640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7bf40b77e0 0x7f7bf4141690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:45.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.621+0000 7f7bfa498640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7bf40b8a80 0x7f7bf4152000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:45.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.621+0000 7f7bfa498640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bf4072c00 con 0x7f7bf4072820 2024-04-15T00:31:45.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.621+0000 7f7bfa498640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f7bf40b2d40 con 0x7f7bf40b8a80 2024-04-15T00:31:45.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.621+0000 7f7bfa498640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f7bf409c400 con 0x7f7bf40b77e0 2024-04-15T00:31:45.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.621+0000 7f7bf8a35640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7bf40b8a80 0x7f7bf4152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:45.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.621+0000 7f7bf8a35640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7bf40b8a80 0x7f7bf4152000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57506/0 (socket says 172.21.15.31:57506) 2024-04-15T00:31:45.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.621+0000 7f7bf8a35640 1 -- 172.21.15.31:0/3879809033 learned_addr learned my addr 172.21.15.31:0/3879809033 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:45.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.621+0000 7f7bf37fe640 1 --2- 172.21.15.31:0/3879809033 >> v2:172.21.15.50:3300/0 conn(0x7f7bf40b77e0 0x7f7bf4141690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:45.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.622+0000 7f7bf8a35640 1 -- 172.21.15.31:0/3879809033 >> v2:172.21.15.50:3300/0 conn(0x7f7bf40b77e0 msgr2=0x7f7bf4141690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:45.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.622+0000 7f7bf8a35640 1 --2- 172.21.15.31:0/3879809033 >> v2:172.21.15.50:3300/0 conn(0x7f7bf40b77e0 0x7f7bf4141690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.622+0000 7f7bf8a35640 1 -- 172.21.15.31:0/3879809033 >> v1:172.21.15.50:6789/0 conn(0x7f7bf4072820 legacy=0x7f7bf40b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:45.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.622+0000 7f7bf8a35640 1 -- 172.21.15.31:0/3879809033 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf40b8560 con 0x7f7bf40b8a80 2024-04-15T00:31:45.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.622+0000 7f7bf8a35640 1 --2- 172.21.15.31:0/3879809033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bf40b8a80 0x7f7bf4152000 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4067ed0 tx=0x7f7bec02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15a276be63e6c54 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:45.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.622+0000 7f7bf2ffd640 1 -- 172.21.15.31:0/3879809033 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec02cb20 con 0x7f7bf40b8a80 2024-04-15T00:31:45.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.623+0000 7f7bf2ffd640 1 -- 172.21.15.31:0/3879809033 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bec02ccc0 con 0x7f7bf40b8a80 2024-04-15T00:31:45.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.623+0000 7f7bf2ffd640 1 -- 172.21.15.31:0/3879809033 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec034610 con 0x7f7bf40b8a80 2024-04-15T00:31:45.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.623+0000 7f7bfa498640 1 -- 172.21.15.31:0/3879809033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bf40b8a80 msgr2=0x7f7bf4152000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:45.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.623+0000 7f7bfa498640 1 --2- 172.21.15.31:0/3879809033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bf40b8a80 0x7f7bf4152000 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4067ed0 tx=0x7f7bec02bf80 comp rx=0 tx=0).stop 2024-04-15T00:31:45.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.623+0000 7f7bfa498640 1 -- 172.21.15.31:0/3879809033 shutdown_connections 2024-04-15T00:31:45.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.623+0000 7f7bfa498640 1 --2- 172.21.15.31:0/3879809033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bf40b8a80 0x7f7bf4152000 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.623+0000 7f7bfa498640 1 --2- 172.21.15.31:0/3879809033 >> v2:172.21.15.50:3300/0 conn(0x7f7bf40b77e0 0x7f7bf4141690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.623+0000 7f7bfa498640 1 -- 172.21.15.31:0/3879809033 >> 172.21.15.31:0/3879809033 conn(0x7f7bf40bce60 msgr2=0x7f7bf40bd270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:45.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.623+0000 7f7bfa498640 1 -- 172.21.15.31:0/3879809033 shutdown_connections 2024-04-15T00:31:45.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.623+0000 7f7bfa498640 1 -- 172.21.15.31:0/3879809033 wait complete. 2024-04-15T00:31:45.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.624+0000 7f7bfa498640 1 Processor -- start 2024-04-15T00:31:45.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.624+0000 7f7bfa498640 1 -- start start 2024-04-15T00:31:45.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.625+0000 7f7bfa498640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bf4072820 0x7f7bf41d2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:45.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.625+0000 7f7bfa498640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bf40b77e0 0x7f7bf41452e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:45.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.625+0000 7f7bfa498640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7bf40b8a80 0x7f7bf4145820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:45.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.625+0000 7f7bfa498640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf409c010 con 0x7f7bf4072820 2024-04-15T00:31:45.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.625+0000 7f7bfa498640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf409be90 con 0x7f7bf40b77e0 2024-04-15T00:31:45.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.625+0000 7f7bfa498640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f7bf409c190 con 0x7f7bf40b8a80 2024-04-15T00:31:45.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.625+0000 7f7bf3fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bf4072820 0x7f7bf41d2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:45.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.625+0000 7f7bf3fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bf4072820 0x7f7bf41d2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57520/0 (socket says 172.21.15.31:57520) 2024-04-15T00:31:45.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.625+0000 7f7bf3fff640 1 -- 172.21.15.31:0/741912981 learned_addr learned my addr 172.21.15.31:0/741912981 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:45.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.625+0000 7f7bf37fe640 1 --2- 172.21.15.31:0/741912981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bf40b77e0 0x7f7bf41452e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:45.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.625+0000 7f7bf8a35640 1 --2- 172.21.15.31:0/741912981 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7bf40b8a80 0x7f7bf4145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:45.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.625+0000 7f7bf3fff640 1 -- 172.21.15.31:0/741912981 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7bf40b8a80 msgr2=0x7f7bf4145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:45.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.625+0000 7f7bf3fff640 1 --2- 172.21.15.31:0/741912981 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f7bf40b8a80 0x7f7bf4145820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.625+0000 7f7bf3fff640 1 -- 172.21.15.31:0/741912981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bf40b77e0 msgr2=0x7f7bf41452e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:45.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.625+0000 7f7bf3fff640 1 --2- 172.21.15.31:0/741912981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bf40b77e0 0x7f7bf41452e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.625+0000 7f7bf3fff640 1 -- 172.21.15.31:0/741912981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf40b4940 con 0x7f7bf4072820 2024-04-15T00:31:45.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.625+0000 7f7bf3fff640 1 --2- 172.21.15.31:0/741912981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bf4072820 0x7f7bf41d2d50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc00c3c0 tx=0x7f7bdc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:45.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.626+0000 7f7bf0ff9640 1 -- 172.21.15.31:0/741912981 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc0052d0 con 0x7f7bf4072820 2024-04-15T00:31:45.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.626+0000 7f7bf0ff9640 1 -- 172.21.15.31:0/741912981 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bdc005490 con 0x7f7bf4072820 2024-04-15T00:31:45.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.626+0000 7f7bfa498640 1 -- 172.21.15.31:0/741912981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bf40b5690 con 0x7f7bf4072820 2024-04-15T00:31:45.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.626+0000 7f7bf0ff9640 1 -- 172.21.15.31:0/741912981 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc007260 con 0x7f7bf4072820 2024-04-15T00:31:45.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.626+0000 7f7bfa498640 1 -- 172.21.15.31:0/741912981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bf4148340 con 0x7f7bf4072820 2024-04-15T00:31:45.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.626+0000 7f7bfa498640 1 -- 172.21.15.31:0/741912981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7bf40b4520 con 0x7f7bf4072820 2024-04-15T00:31:45.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.627+0000 7f7bf0ff9640 1 -- 172.21.15.31:0/741912981 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f7bdc007400 con 0x7f7bf4072820 2024-04-15T00:31:45.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.627+0000 7f7bf0ff9640 1 --2- 172.21.15.31:0/741912981 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f7bd406b9c0 0x7f7bd406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:45.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.627+0000 7f7bf0ff9640 1 -- 172.21.15.31:0/741912981 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f7bdc08a0e0 con 0x7f7bf4072820 2024-04-15T00:31:45.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.627+0000 7f7bf37fe640 1 --2- 172.21.15.31:0/741912981 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f7bd406b9c0 0x7f7bd406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:45.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.628+0000 7f7bf0ff9640 1 --2- 172.21.15.31:0/741912981 >> [v2:172.21.15.31:6824/3722449780,v1:172.21.15.31:6825/3722449780] conn(0x7f7bd40753d0 0x7f7bd4077870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:45.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.628+0000 7f7bf0ff9640 1 -- 172.21.15.31:0/741912981 --> [v2:172.21.15.31:6824/3722449780,v1:172.21.15.31:6825/3722449780] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7bdc009e50 con 0x7f7bd40753d0 2024-04-15T00:31:45.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.628+0000 7f7bf0ff9640 1 -- 172.21.15.31:0/741912981 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7bdc091050 con 0x7f7bf4072820 2024-04-15T00:31:45.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.628+0000 7f7bf8a35640 1 --2- 172.21.15.31:0/741912981 >> [v2:172.21.15.31:6824/3722449780,v1:172.21.15.31:6825/3722449780] conn(0x7f7bd40753d0 0x7f7bd4077870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:45.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.628+0000 7f7bf37fe640 1 --2- 172.21.15.31:0/741912981 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f7bd406b9c0 0x7f7bd406de80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7bf41d3620 tx=0x7f7be4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:45.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.628+0000 7f7bf8a35640 1 --2- 172.21.15.31:0/741912981 >> [v2:172.21.15.31:6824/3722449780,v1:172.21.15.31:6825/3722449780] conn(0x7f7bd40753d0 0x7f7bd4077870 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:45.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.629+0000 7f7bf0ff9640 1 -- 172.21.15.31:0/741912981 <== osd.3 v2:172.21.15.31:6824/3722449780 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7bdc009e50 con 0x7f7bd40753d0 2024-04-15T00:31:45.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.642+0000 7f7bfa498640 1 -- 172.21.15.31:0/741912981 --> [v2:172.21.15.31:6824/3722449780,v1:172.21.15.31:6825/3722449780] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7bf4148130 con 0x7f7bd40753d0 2024-04-15T00:31:45.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.642+0000 7f7bf0ff9640 1 -- 172.21.15.31:0/741912981 <== osd.3 v2:172.21.15.31:6824/3722449780 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7bf4148130 con 0x7f7bd40753d0 2024-04-15T00:31:45.651 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-15T00:31:45.651 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T00:31:45.651 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-15T00:31:45.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.642+0000 7f7bfa498640 1 -- 172.21.15.31:0/741912981 >> [v2:172.21.15.31:6824/3722449780,v1:172.21.15.31:6825/3722449780] conn(0x7f7bd40753d0 msgr2=0x7f7bd4077870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:45.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.642+0000 7f7bfa498640 1 --2- 172.21.15.31:0/741912981 >> [v2:172.21.15.31:6824/3722449780,v1:172.21.15.31:6825/3722449780] conn(0x7f7bd40753d0 0x7f7bd4077870 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.642+0000 7f7bfa498640 1 -- 172.21.15.31:0/741912981 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f7bd406b9c0 msgr2=0x7f7bd406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.642+0000 7f7bfa498640 1 --2- 172.21.15.31:0/741912981 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f7bd406b9c0 0x7f7bd406de80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7bf41d3620 tx=0x7f7be4008040 comp rx=0 tx=0).stop 2024-04-15T00:31:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.642+0000 7f7bfa498640 1 -- 172.21.15.31:0/741912981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bf4072820 msgr2=0x7f7bf41d2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.642+0000 7f7bfa498640 1 --2- 172.21.15.31:0/741912981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bf4072820 0x7f7bf41d2d50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc00c3c0 tx=0x7f7bdc00c880 comp rx=0 tx=0).stop 2024-04-15T00:31:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.642+0000 7f7bf8a35640 1 -- 172.21.15.31:0/741912981 reap_dead start 2024-04-15T00:31:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.643+0000 7f7bfa498640 1 -- 172.21.15.31:0/741912981 shutdown_connections 2024-04-15T00:31:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.643+0000 7f7bfa498640 1 -- 172.21.15.31:0/741912981 >> 172.21.15.31:0/741912981 conn(0x7f7bf40bce60 msgr2=0x7f7bf40bd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.643+0000 7f7bfa498640 1 -- 172.21.15.31:0/741912981 shutdown_connections 2024-04-15T00:31:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.643+0000 7f7bfa498640 1 -- 172.21.15.31:0/741912981 wait complete. 2024-04-15T00:31:45.661 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-15T00:31:45.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.756+0000 7f99607b4640 1 Processor -- start 2024-04-15T00:31:45.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.756+0000 7f99607b4640 1 -- start start 2024-04-15T00:31:45.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.757+0000 7f99607b4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9958072690 0x7f995814ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:45.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.757+0000 7f99607b4640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f995806fde0 0x7f995814b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:45.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.757+0000 7f99607b4640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f99581414a0 0x7f9958141930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:45.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.757+0000 7f99607b4640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f995806efa0 con 0x7f99581414a0 2024-04-15T00:31:45.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.757+0000 7f99607b4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f995806f820 con 0x7f9958072690 2024-04-15T00:31:45.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.757+0000 7f99607b4640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f9958072a70 con 0x7f995806fde0 2024-04-15T00:31:45.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.757+0000 7f995ed51640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f99581414a0 0x7f9958141930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:45.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.757+0000 7f995ed51640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f99581414a0 0x7f9958141930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57530/0 (socket says 172.21.15.31:57530) 2024-04-15T00:31:45.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.757+0000 7f995ed51640 1 -- 172.21.15.31:0/2367398065 learned_addr learned my addr 172.21.15.31:0/2367398065 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:45.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.757+0000 7f995e550640 1 --2- 172.21.15.31:0/2367398065 >> v2:172.21.15.50:3300/0 conn(0x7f9958072690 0x7f995814ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:45.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.757+0000 7f995dd4f640 1 --2- 172.21.15.31:0/2367398065 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f995806fde0 0x7f995814b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:45.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.757+0000 7f995ed51640 1 -- 172.21.15.31:0/2367398065 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f995806fde0 msgr2=0x7f995814b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:45.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.757+0000 7f995ed51640 1 --2- 172.21.15.31:0/2367398065 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f995806fde0 0x7f995814b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.757+0000 7f995ed51640 1 -- 172.21.15.31:0/2367398065 >> v2:172.21.15.50:3300/0 conn(0x7f9958072690 msgr2=0x7f995814ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:45.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.757+0000 7f995ed51640 1 --2- 172.21.15.31:0/2367398065 >> v2:172.21.15.50:3300/0 conn(0x7f9958072690 0x7f995814ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.757+0000 7f995ed51640 1 -- 172.21.15.31:0/2367398065 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f995806f1d0 con 0x7f99581414a0 2024-04-15T00:31:45.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.758+0000 7f995ed51640 1 --2- 172.21.15.31:0/2367398065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99581414a0 0x7f9958141930 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9958070fb0 tx=0x7f995002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cc37287d41d1fa8 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:45.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.758+0000 7f995d54e640 1 -- 172.21.15.31:0/2367398065 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995002ca70 con 0x7f99581414a0 2024-04-15T00:31:45.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.758+0000 7f995d54e640 1 -- 172.21.15.31:0/2367398065 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f995002cc10 con 0x7f99581414a0 2024-04-15T00:31:45.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.758+0000 7f995d54e640 1 -- 172.21.15.31:0/2367398065 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99500343f0 con 0x7f99581414a0 2024-04-15T00:31:45.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.758+0000 7f99607b4640 1 -- 172.21.15.31:0/2367398065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99581414a0 msgr2=0x7f9958141930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:45.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.758+0000 7f99607b4640 1 --2- 172.21.15.31:0/2367398065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99581414a0 0x7f9958141930 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9958070fb0 tx=0x7f995002bed0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.759+0000 7f99607b4640 1 -- 172.21.15.31:0/2367398065 shutdown_connections 2024-04-15T00:31:45.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.759+0000 7f99607b4640 1 --2- 172.21.15.31:0/2367398065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99581414a0 0x7f9958141930 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.759+0000 7f99607b4640 1 --2- 172.21.15.31:0/2367398065 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f995806fde0 0x7f995814b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.759+0000 7f99607b4640 1 --2- 172.21.15.31:0/2367398065 >> v2:172.21.15.50:3300/0 conn(0x7f9958072690 0x7f995814ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.759+0000 7f99607b4640 1 -- 172.21.15.31:0/2367398065 >> 172.21.15.31:0/2367398065 conn(0x7f99580b7840 msgr2=0x7f99580b7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:45.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.759+0000 7f99607b4640 1 -- 172.21.15.31:0/2367398065 shutdown_connections 2024-04-15T00:31:45.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.759+0000 7f99607b4640 1 -- 172.21.15.31:0/2367398065 wait complete. 2024-04-15T00:31:45.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.760+0000 7f99607b4640 1 Processor -- start 2024-04-15T00:31:45.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.760+0000 7f99607b4640 1 -- start start 2024-04-15T00:31:45.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.760+0000 7f99607b4640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f995806fde0 0x7f995809f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:45.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.760+0000 7f99607b4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9958072690 0x7f99581e0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:45.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.760+0000 7f99607b4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99581414a0 0x7f99581e06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:45.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.760+0000 7f99607b4640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9958141e70 con 0x7f99581414a0 2024-04-15T00:31:45.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.760+0000 7f99607b4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f99580b5740 con 0x7f9958072690 2024-04-15T00:31:45.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.760+0000 7f99607b4640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f99580afd60 con 0x7f995806fde0 2024-04-15T00:31:45.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.760+0000 7f995ed51640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99581414a0 0x7f99581e06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:45.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.760+0000 7f995ed51640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99581414a0 0x7f99581e06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57542/0 (socket says 172.21.15.31:57542) 2024-04-15T00:31:45.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.760+0000 7f995ed51640 1 -- 172.21.15.31:0/2891937438 learned_addr learned my addr 172.21.15.31:0/2891937438 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:45.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.760+0000 7f995dd4f640 1 --2- 172.21.15.31:0/2891937438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9958072690 0x7f99581e0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:45.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.761+0000 7f995e550640 1 --2- 172.21.15.31:0/2891937438 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f995806fde0 0x7f995809f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:45.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.761+0000 7f995ed51640 1 -- 172.21.15.31:0/2891937438 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f995806fde0 msgr2=0x7f995809f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:45.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.761+0000 7f995ed51640 1 --2- 172.21.15.31:0/2891937438 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f995806fde0 0x7f995809f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.761+0000 7f995ed51640 1 -- 172.21.15.31:0/2891937438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9958072690 msgr2=0x7f99581e0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:45.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.761+0000 7f995ed51640 1 --2- 172.21.15.31:0/2891937438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9958072690 0x7f99581e0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.761+0000 7f995ed51640 1 -- 172.21.15.31:0/2891937438 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99580b0040 con 0x7f99581414a0 2024-04-15T00:31:45.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.761+0000 7f995ed51640 1 --2- 172.21.15.31:0/2891937438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99581414a0 0x7f99581e06a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9950036040 tx=0x7f9950004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:45.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.761+0000 7f994effd640 1 -- 172.21.15.31:0/2891937438 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9950043020 con 0x7f99581414a0 2024-04-15T00:31:45.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.761+0000 7f994effd640 1 -- 172.21.15.31:0/2891937438 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f995003e450 con 0x7f99581414a0 2024-04-15T00:31:45.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.761+0000 7f99607b4640 1 -- 172.21.15.31:0/2891937438 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99580b0320 con 0x7f99581414a0 2024-04-15T00:31:45.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.761+0000 7f994effd640 1 -- 172.21.15.31:0/2891937438 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9950009510 con 0x7f99581414a0 2024-04-15T00:31:45.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.761+0000 7f99607b4640 1 -- 172.21.15.31:0/2891937438 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9958144140 con 0x7f99581414a0 2024-04-15T00:31:45.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.762+0000 7f99607b4640 1 -- 172.21.15.31:0/2891937438 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f995804f620 con 0x7f99581414a0 2024-04-15T00:31:45.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.762+0000 7f994effd640 1 -- 172.21.15.31:0/2891937438 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f9950046020 con 0x7f99581414a0 2024-04-15T00:31:45.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.763+0000 7f994effd640 1 --2- 172.21.15.31:0/2891937438 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f993c06b9c0 0x7f993c06de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:45.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.763+0000 7f994effd640 1 -- 172.21.15.31:0/2891937438 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f99500ad060 con 0x7f99581414a0 2024-04-15T00:31:45.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.763+0000 7f995e550640 1 --2- 172.21.15.31:0/2891937438 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f993c06b9c0 0x7f993c06de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:45.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.763+0000 7f995e550640 1 --2- 172.21.15.31:0/2891937438 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f993c06b9c0 0x7f993c06de80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9954009a40 tx=0x7f9954008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:45.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.767+0000 7f994effd640 1 -- 172.21.15.31:0/2891937438 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f995004d070 con 0x7f99581414a0 2024-04-15T00:31:45.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.950+0000 7f99607b4640 1 -- 172.21.15.31:0/2891937438 --> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f995813db30 con 0x7f993c06b9c0 2024-04-15T00:31:45.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.951+0000 7f994effd640 1 -- 172.21.15.31:0/2891937438 <== mgr.4107 v2:172.21.15.31:6832/915470279 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f995813db30 con 0x7f993c06b9c0 2024-04-15T00:31:45.960 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 3 to deep-scrub 2024-04-15T00:31:45.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.953+0000 7f99607b4640 1 -- 172.21.15.31:0/2891937438 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f993c06b9c0 msgr2=0x7f993c06de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:45.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.953+0000 7f99607b4640 1 --2- 172.21.15.31:0/2891937438 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f993c06b9c0 0x7f993c06de80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9954009a40 tx=0x7f9954008040 comp rx=0 tx=0).stop 2024-04-15T00:31:45.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.953+0000 7f99607b4640 1 -- 172.21.15.31:0/2891937438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99581414a0 msgr2=0x7f99581e06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:45.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.953+0000 7f99607b4640 1 --2- 172.21.15.31:0/2891937438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99581414a0 0x7f99581e06a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9950036040 tx=0x7f9950004a40 comp rx=0 tx=0).stop 2024-04-15T00:31:45.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.953+0000 7f99607b4640 1 -- 172.21.15.31:0/2891937438 shutdown_connections 2024-04-15T00:31:45.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.953+0000 7f99607b4640 1 --2- 172.21.15.31:0/2891937438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99581414a0 0x7f99581e06a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.953+0000 7f99607b4640 1 --2- 172.21.15.31:0/2891937438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9958072690 0x7f99581e0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.953+0000 7f99607b4640 1 --2- 172.21.15.31:0/2891937438 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f993c06b9c0 0x7f993c06de80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.953+0000 7f99607b4640 1 --2- 172.21.15.31:0/2891937438 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f995806fde0 0x7f995809f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:45.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.953+0000 7f99607b4640 1 -- 172.21.15.31:0/2891937438 >> 172.21.15.31:0/2891937438 conn(0x7f99580b7840 msgr2=0x7f995813e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:45.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.953+0000 7f99607b4640 1 -- 172.21.15.31:0/2891937438 shutdown_connections 2024-04-15T00:31:45.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:45.953+0000 7f99607b4640 1 -- 172.21.15.31:0/2891937438 wait complete. 2024-04-15T00:31:45.973 INFO:tasks.ceph:Scrubbing osd.4 2024-04-15T00:31:45.973 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-15T00:31:46.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.072+0000 7f231a4de640 1 Processor -- start 2024-04-15T00:31:46.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.072+0000 7f231a4de640 1 -- start start 2024-04-15T00:31:46.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.072+0000 7f231a4de640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f23140b5c60 0x7f23140aff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.072+0000 7f231a4de640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f23140ae5a0 0x7f23140ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.072+0000 7f231a4de640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2314147ee0 0x7f2314148350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.072+0000 7f231a4de640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f23140ae110 con 0x7f2314147ee0 2024-04-15T00:31:46.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.072+0000 7f231a4de640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f23140b5080 con 0x7f23140b5c60 2024-04-15T00:31:46.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.072+0000 7f231a4de640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f23140b1160 con 0x7f23140ae5a0 2024-04-15T00:31:46.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.072+0000 7f2318a7b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2314147ee0 0x7f2314148350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.072+0000 7f2318a7b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2314147ee0 0x7f2314148350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57556/0 (socket says 172.21.15.31:57556) 2024-04-15T00:31:46.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.072+0000 7f2318a7b640 1 -- 172.21.15.31:0/1331589143 learned_addr learned my addr 172.21.15.31:0/1331589143 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:46.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.072+0000 7f2313fff640 1 --2- 172.21.15.31:0/1331589143 >> v2:172.21.15.50:3300/0 conn(0x7f23140b5c60 0x7f23140aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.072+0000 7f23137fe640 1 --2- 172.21.15.31:0/1331589143 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f23140ae5a0 0x7f23140ae9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.073+0000 7f2318a7b640 1 -- 172.21.15.31:0/1331589143 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f23140ae5a0 msgr2=0x7f23140ae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:46.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.073+0000 7f2318a7b640 1 --2- 172.21.15.31:0/1331589143 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f23140ae5a0 0x7f23140ae9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.073+0000 7f2318a7b640 1 -- 172.21.15.31:0/1331589143 >> v2:172.21.15.50:3300/0 conn(0x7f23140b5c60 msgr2=0x7f23140aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:46.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.073+0000 7f2318a7b640 1 --2- 172.21.15.31:0/1331589143 >> v2:172.21.15.50:3300/0 conn(0x7f23140b5c60 0x7f23140aff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.073+0000 7f2318a7b640 1 -- 172.21.15.31:0/1331589143 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23140adde0 con 0x7f2314147ee0 2024-04-15T00:31:46.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.073+0000 7f23137fe640 1 --2- 172.21.15.31:0/1331589143 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f23140ae5a0 0x7f23140ae9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:31:46.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.073+0000 7f2318a7b640 1 --2- 172.21.15.31:0/1331589143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2314147ee0 0x7f2314148350 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f23140b4b10 tx=0x7f230c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e47a846abffd84 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:46.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.074+0000 7f2312ffd640 1 -- 172.21.15.31:0/1331589143 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230c02c9e0 con 0x7f2314147ee0 2024-04-15T00:31:46.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.074+0000 7f2312ffd640 1 -- 172.21.15.31:0/1331589143 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f230c02cb80 con 0x7f2314147ee0 2024-04-15T00:31:46.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.074+0000 7f2312ffd640 1 -- 172.21.15.31:0/1331589143 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230c0343f0 con 0x7f2314147ee0 2024-04-15T00:31:46.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.074+0000 7f231a4de640 1 -- 172.21.15.31:0/1331589143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2314147ee0 msgr2=0x7f2314148350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:46.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.074+0000 7f231a4de640 1 --2- 172.21.15.31:0/1331589143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2314147ee0 0x7f2314148350 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f23140b4b10 tx=0x7f230c02be40 comp rx=0 tx=0).stop 2024-04-15T00:31:46.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.074+0000 7f231a4de640 1 -- 172.21.15.31:0/1331589143 shutdown_connections 2024-04-15T00:31:46.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.074+0000 7f231a4de640 1 --2- 172.21.15.31:0/1331589143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2314147ee0 0x7f2314148350 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.074+0000 7f231a4de640 1 --2- 172.21.15.31:0/1331589143 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f23140ae5a0 0x7f23140ae9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.074+0000 7f231a4de640 1 --2- 172.21.15.31:0/1331589143 >> v2:172.21.15.50:3300/0 conn(0x7f23140b5c60 0x7f23140aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.074+0000 7f231a4de640 1 -- 172.21.15.31:0/1331589143 >> 172.21.15.31:0/1331589143 conn(0x7f2314067330 msgr2=0x7f2314067740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:46.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.074+0000 7f231a4de640 1 -- 172.21.15.31:0/1331589143 shutdown_connections 2024-04-15T00:31:46.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.074+0000 7f231a4de640 1 -- 172.21.15.31:0/1331589143 wait complete. 2024-04-15T00:31:46.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.075+0000 7f231a4de640 1 Processor -- start 2024-04-15T00:31:46.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.075+0000 7f231a4de640 1 -- start start 2024-04-15T00:31:46.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.076+0000 7f231a4de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23140ae5a0 0x7f231409c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.076+0000 7f231a4de640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23140b5c60 0x7f231409b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.076+0000 7f231a4de640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2314147ee0 0x7f231409b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.076+0000 7f231a4de640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f23140aef00 con 0x7f23140b5c60 2024-04-15T00:31:46.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.076+0000 7f231a4de640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f23140b13d0 con 0x7f23140ae5a0 2024-04-15T00:31:46.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.076+0000 7f231a4de640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f2314148890 con 0x7f2314147ee0 2024-04-15T00:31:46.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.076+0000 7f23137fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23140b5c60 0x7f231409b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.076+0000 7f23137fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23140b5c60 0x7f231409b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57558/0 (socket says 172.21.15.31:57558) 2024-04-15T00:31:46.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.076+0000 7f23137fe640 1 -- 172.21.15.31:0/1824177116 learned_addr learned my addr 172.21.15.31:0/1824177116 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:46.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.076+0000 7f2318a7b640 1 --2- 172.21.15.31:0/1824177116 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2314147ee0 0x7f231409b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.076+0000 7f2313fff640 1 --2- 172.21.15.31:0/1824177116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23140ae5a0 0x7f231409c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.076+0000 7f23137fe640 1 -- 172.21.15.31:0/1824177116 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2314147ee0 msgr2=0x7f231409b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:46.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.076+0000 7f23137fe640 1 --2- 172.21.15.31:0/1824177116 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2314147ee0 0x7f231409b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.076+0000 7f23137fe640 1 -- 172.21.15.31:0/1824177116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23140ae5a0 msgr2=0x7f231409c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:46.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.076+0000 7f23137fe640 1 --2- 172.21.15.31:0/1824177116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23140ae5a0 0x7f231409c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.076+0000 7f23137fe640 1 -- 172.21.15.31:0/1824177116 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231409dbb0 con 0x7f23140b5c60 2024-04-15T00:31:46.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.076+0000 7f2318a7b640 1 --2- 172.21.15.31:0/1824177116 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2314147ee0 0x7f231409b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:31:46.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.076+0000 7f2313fff640 1 --2- 172.21.15.31:0/1824177116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23140ae5a0 0x7f231409c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:31:46.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.077+0000 7f23137fe640 1 --2- 172.21.15.31:0/1824177116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23140b5c60 0x7f231409b100 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f230800e810 tx=0x7f230800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:46.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.077+0000 7f2310ff9640 1 -- 172.21.15.31:0/1824177116 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230800f040 con 0x7f23140b5c60 2024-04-15T00:31:46.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.077+0000 7f2310ff9640 1 -- 172.21.15.31:0/1824177116 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2308004030 con 0x7f23140b5c60 2024-04-15T00:31:46.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.077+0000 7f2310ff9640 1 -- 172.21.15.31:0/1824177116 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2308004400 con 0x7f23140b5c60 2024-04-15T00:31:46.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.077+0000 7f231a4de640 1 -- 172.21.15.31:0/1824177116 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f231409e680 con 0x7f23140b5c60 2024-04-15T00:31:46.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.077+0000 7f231a4de640 1 -- 172.21.15.31:0/1824177116 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2314071ce0 con 0x7f23140b5c60 2024-04-15T00:31:46.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.078+0000 7f231a4de640 1 -- 172.21.15.31:0/1824177116 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f23140b0270 con 0x7f23140b5c60 2024-04-15T00:31:46.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.078+0000 7f2310ff9640 1 -- 172.21.15.31:0/1824177116 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f230800c6d0 con 0x7f23140b5c60 2024-04-15T00:31:46.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.079+0000 7f2310ff9640 1 --2- 172.21.15.31:0/1824177116 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f230006b990 0x7f230006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.079+0000 7f2310ff9640 1 -- 172.21.15.31:0/1824177116 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f230808a820 con 0x7f23140b5c60 2024-04-15T00:31:46.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.079+0000 7f2313fff640 1 --2- 172.21.15.31:0/1824177116 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f230006b990 0x7f230006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.079+0000 7f2310ff9640 1 --2- 172.21.15.31:0/1824177116 >> [v2:172.21.15.50:6800/1279970071,v1:172.21.15.50:6801/1279970071] conn(0x7f23000753a0 0x7f2300077840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.079+0000 7f2310ff9640 1 -- 172.21.15.31:0/1824177116 --> [v2:172.21.15.50:6800/1279970071,v1:172.21.15.50:6801/1279970071] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2308017e50 con 0x7f23000753a0 2024-04-15T00:31:46.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.079+0000 7f2310ff9640 1 -- 172.21.15.31:0/1824177116 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f230808f2c0 con 0x7f23140b5c60 2024-04-15T00:31:46.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.079+0000 7f2313fff640 1 --2- 172.21.15.31:0/1824177116 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f230006b990 0x7f230006de50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f231413c3b0 tx=0x7f2304008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:46.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.079+0000 7f2318a7b640 1 --2- 172.21.15.31:0/1824177116 >> [v2:172.21.15.50:6800/1279970071,v1:172.21.15.50:6801/1279970071] conn(0x7f23000753a0 0x7f2300077840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.080+0000 7f2318a7b640 1 --2- 172.21.15.31:0/1824177116 >> [v2:172.21.15.50:6800/1279970071,v1:172.21.15.50:6801/1279970071] conn(0x7f23000753a0 0x7f2300077840 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:46.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.080+0000 7f2310ff9640 1 -- 172.21.15.31:0/1824177116 <== osd.4 v2:172.21.15.50:6800/1279970071 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2308017e50 con 0x7f23000753a0 2024-04-15T00:31:46.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.094+0000 7f231a4de640 1 -- 172.21.15.31:0/1824177116 --> [v2:172.21.15.50:6800/1279970071,v1:172.21.15.50:6801/1279970071] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f231409ad20 con 0x7f23000753a0 2024-04-15T00:31:46.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.094+0000 7f2310ff9640 1 -- 172.21.15.31:0/1824177116 <== osd.4 v2:172.21.15.50:6800/1279970071 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f231409ad20 con 0x7f23000753a0 2024-04-15T00:31:46.103 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-15T00:31:46.103 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T00:31:46.103 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-15T00:31:46.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.094+0000 7f231a4de640 1 -- 172.21.15.31:0/1824177116 >> [v2:172.21.15.50:6800/1279970071,v1:172.21.15.50:6801/1279970071] conn(0x7f23000753a0 msgr2=0x7f2300077840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:46.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.094+0000 7f231a4de640 1 --2- 172.21.15.31:0/1824177116 >> [v2:172.21.15.50:6800/1279970071,v1:172.21.15.50:6801/1279970071] conn(0x7f23000753a0 0x7f2300077840 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.094+0000 7f231a4de640 1 -- 172.21.15.31:0/1824177116 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f230006b990 msgr2=0x7f230006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:46.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.094+0000 7f231a4de640 1 --2- 172.21.15.31:0/1824177116 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f230006b990 0x7f230006de50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f231413c3b0 tx=0x7f2304008040 comp rx=0 tx=0).stop 2024-04-15T00:31:46.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.094+0000 7f231a4de640 1 -- 172.21.15.31:0/1824177116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23140b5c60 msgr2=0x7f231409b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:46.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.094+0000 7f231a4de640 1 --2- 172.21.15.31:0/1824177116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23140b5c60 0x7f231409b100 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f230800e810 tx=0x7f230800ecd0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.094+0000 7f2318a7b640 1 -- 172.21.15.31:0/1824177116 reap_dead start 2024-04-15T00:31:46.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.095+0000 7f231a4de640 1 -- 172.21.15.31:0/1824177116 shutdown_connections 2024-04-15T00:31:46.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.095+0000 7f231a4de640 1 -- 172.21.15.31:0/1824177116 >> 172.21.15.31:0/1824177116 conn(0x7f2314067330 msgr2=0x7f23140b21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:46.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.095+0000 7f231a4de640 1 -- 172.21.15.31:0/1824177116 shutdown_connections 2024-04-15T00:31:46.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.095+0000 7f231a4de640 1 -- 172.21.15.31:0/1824177116 wait complete. 2024-04-15T00:31:46.114 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-15T00:31:46.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.209+0000 7f8bcd82d640 1 Processor -- start 2024-04-15T00:31:46.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.209+0000 7f8bcd82d640 1 -- start start 2024-04-15T00:31:46.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.209+0000 7f8bcd82d640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bc80b9bd0 0x7f8bc80bb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.209+0000 7f8bcd82d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8bc80b94f0 0x7f8bc8147600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.209+0000 7f8bcd82d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8bc814b870 0x7f8bc80b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.209+0000 7f8bcd82d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f8bc814b3e0 con 0x7f8bc80b94f0 2024-04-15T00:31:46.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.209+0000 7f8bcd82d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f8bc80b9fb0 con 0x7f8bc814b870 2024-04-15T00:31:46.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.209+0000 7f8bcd82d640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f8bc8147b40 con 0x7f8bc80b9bd0 2024-04-15T00:31:46.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.210+0000 7f8bc67fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8bc80b94f0 0x7f8bc8147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.210+0000 7f8bc67fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8bc80b94f0 0x7f8bc8147600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57564/0 (socket says 172.21.15.31:57564) 2024-04-15T00:31:46.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.210+0000 7f8bc67fc640 1 -- 172.21.15.31:0/21606534 learned_addr learned my addr 172.21.15.31:0/21606534 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:46.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.210+0000 7f8bc77fe640 1 --2- 172.21.15.31:0/21606534 >> v2:172.21.15.50:3300/0 conn(0x7f8bc814b870 0x7f8bc80b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.210+0000 7f8bc6ffd640 1 --2- 172.21.15.31:0/21606534 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bc80b9bd0 0x7f8bc80bb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.210+0000 7f8bc67fc640 1 -- 172.21.15.31:0/21606534 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bc80b9bd0 msgr2=0x7f8bc80bb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:46.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.210+0000 7f8bc67fc640 1 --2- 172.21.15.31:0/21606534 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bc80b9bd0 0x7f8bc80bb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.210+0000 7f8bc67fc640 1 -- 172.21.15.31:0/21606534 >> v2:172.21.15.50:3300/0 conn(0x7f8bc814b870 msgr2=0x7f8bc80b8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:46.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.210+0000 7f8bc67fc640 1 --2- 172.21.15.31:0/21606534 >> v2:172.21.15.50:3300/0 conn(0x7f8bc814b870 0x7f8bc80b8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.210+0000 7f8bc67fc640 1 -- 172.21.15.31:0/21606534 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc814ad90 con 0x7f8bc80b94f0 2024-04-15T00:31:46.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.210+0000 7f8bc6ffd640 1 --2- 172.21.15.31:0/21606534 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bc80b9bd0 0x7f8bc80bb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:31:46.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.211+0000 7f8bc67fc640 1 --2- 172.21.15.31:0/21606534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8bc80b94f0 0x7f8bc8147600 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8bc806cdf0 tx=0x7f8bbc02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4764a7b924ed764e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:46.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.211+0000 7f8bc5ffb640 1 -- 172.21.15.31:0/21606534 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc038070 con 0x7f8bc80b94f0 2024-04-15T00:31:46.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.211+0000 7f8bc5ffb640 1 -- 172.21.15.31:0/21606534 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bbc02f050 con 0x7f8bc80b94f0 2024-04-15T00:31:46.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.211+0000 7f8bc5ffb640 1 -- 172.21.15.31:0/21606534 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc031970 con 0x7f8bc80b94f0 2024-04-15T00:31:46.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.211+0000 7f8bcd82d640 1 -- 172.21.15.31:0/21606534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8bc80b94f0 msgr2=0x7f8bc8147600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:46.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.211+0000 7f8bcd82d640 1 --2- 172.21.15.31:0/21606534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8bc80b94f0 0x7f8bc8147600 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8bc806cdf0 tx=0x7f8bbc02b7f0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.211+0000 7f8bcd82d640 1 -- 172.21.15.31:0/21606534 shutdown_connections 2024-04-15T00:31:46.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.211+0000 7f8bcd82d640 1 --2- 172.21.15.31:0/21606534 >> v2:172.21.15.50:3300/0 conn(0x7f8bc814b870 0x7f8bc80b8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.211+0000 7f8bcd82d640 1 --2- 172.21.15.31:0/21606534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8bc80b94f0 0x7f8bc8147600 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.211+0000 7f8bcd82d640 1 --2- 172.21.15.31:0/21606534 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bc80b9bd0 0x7f8bc80bb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.211+0000 7f8bcd82d640 1 -- 172.21.15.31:0/21606534 >> 172.21.15.31:0/21606534 conn(0x7f8bc809ed70 msgr2=0x7f8bc809f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:46.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.211+0000 7f8bcd82d640 1 -- 172.21.15.31:0/21606534 shutdown_connections 2024-04-15T00:31:46.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.211+0000 7f8bcd82d640 1 -- 172.21.15.31:0/21606534 wait complete. 2024-04-15T00:31:46.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.212+0000 7f8bcd82d640 1 Processor -- start 2024-04-15T00:31:46.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.213+0000 7f8bcd82d640 1 -- start start 2024-04-15T00:31:46.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.213+0000 7f8bcd82d640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bc80b94f0 0x7f8bc80a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.213+0000 7f8bcd82d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8bc80b9bd0 0x7f8bc81d1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.213+0000 7f8bcd82d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bc814b870 0x7f8bc81e0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.213+0000 7f8bcd82d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc80b8fa0 con 0x7f8bc80b9bd0 2024-04-15T00:31:46.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.213+0000 7f8bcd82d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc80bcbe0 con 0x7f8bc814b870 2024-04-15T00:31:46.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.213+0000 7f8bcd82d640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f8bc80b9120 con 0x7f8bc80b94f0 2024-04-15T00:31:46.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.213+0000 7f8bc67fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8bc80b9bd0 0x7f8bc81d1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.213+0000 7f8bc67fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8bc80b9bd0 0x7f8bc81d1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57570/0 (socket says 172.21.15.31:57570) 2024-04-15T00:31:46.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.213+0000 7f8bc67fc640 1 -- 172.21.15.31:0/1231318376 learned_addr learned my addr 172.21.15.31:0/1231318376 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:46.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.213+0000 7f8bc77fe640 1 --2- 172.21.15.31:0/1231318376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bc814b870 0x7f8bc81e0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.213+0000 7f8bc6ffd640 1 --2- 172.21.15.31:0/1231318376 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bc80b94f0 0x7f8bc80a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.214+0000 7f8bc67fc640 1 -- 172.21.15.31:0/1231318376 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bc80b94f0 msgr2=0x7f8bc80a1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:46.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.214+0000 7f8bc67fc640 1 --2- 172.21.15.31:0/1231318376 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bc80b94f0 0x7f8bc80a1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.214+0000 7f8bc67fc640 1 -- 172.21.15.31:0/1231318376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bc814b870 msgr2=0x7f8bc81e0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:46.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.214+0000 7f8bc67fc640 1 --2- 172.21.15.31:0/1231318376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bc814b870 0x7f8bc81e0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.214+0000 7f8bc67fc640 1 -- 172.21.15.31:0/1231318376 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc81d15d0 con 0x7f8bc80b9bd0 2024-04-15T00:31:46.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.214+0000 7f8bc67fc640 1 --2- 172.21.15.31:0/1231318376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8bc80b9bd0 0x7f8bc81d1090 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc02b830 tx=0x7f8bbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:46.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.214+0000 7f8baffff640 1 -- 172.21.15.31:0/1231318376 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc042070 con 0x7f8bc80b9bd0 2024-04-15T00:31:46.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.214+0000 7f8baffff640 1 -- 172.21.15.31:0/1231318376 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bbc03d890 con 0x7f8bc80b9bd0 2024-04-15T00:31:46.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.214+0000 7f8baffff640 1 -- 172.21.15.31:0/1231318376 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc038040 con 0x7f8bc80b9bd0 2024-04-15T00:31:46.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.214+0000 7f8bcd82d640 1 -- 172.21.15.31:0/1231318376 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bc8145010 con 0x7f8bc80b9bd0 2024-04-15T00:31:46.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.214+0000 7f8bcd82d640 1 -- 172.21.15.31:0/1231318376 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bc81d1b30 con 0x7f8bc80b9bd0 2024-04-15T00:31:46.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.215+0000 7f8bcd82d640 1 -- 172.21.15.31:0/1231318376 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bc804f620 con 0x7f8bc80b9bd0 2024-04-15T00:31:46.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.215+0000 7f8baffff640 1 -- 172.21.15.31:0/1231318376 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f8bbc045070 con 0x7f8bc80b9bd0 2024-04-15T00:31:46.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.216+0000 7f8baffff640 1 --2- 172.21.15.31:0/1231318376 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f8bb406b990 0x7f8bb406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.216+0000 7f8baffff640 1 -- 172.21.15.31:0/1231318376 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f8bbc0ac900 con 0x7f8bc80b9bd0 2024-04-15T00:31:46.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.216+0000 7f8bc6ffd640 1 --2- 172.21.15.31:0/1231318376 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f8bb406b990 0x7f8bb406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.216+0000 7f8bc6ffd640 1 --2- 172.21.15.31:0/1231318376 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f8bb406b990 0x7f8bb406de50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8bb800ab60 tx=0x7f8bb8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:46.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.220+0000 7f8baffff640 1 -- 172.21.15.31:0/1231318376 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f8bc81d15d0 con 0x7f8bc80b9bd0 2024-04-15T00:31:46.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.401+0000 7f8bcd82d640 1 -- 172.21.15.31:0/1231318376 --> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f8bc80a2600 con 0x7f8bb406b990 2024-04-15T00:31:46.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.401+0000 7f8baffff640 1 -- 172.21.15.31:0/1231318376 <== mgr.4107 v2:172.21.15.31:6832/915470279 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8bc80a2600 con 0x7f8bb406b990 2024-04-15T00:31:46.409 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 4 to deep-scrub 2024-04-15T00:31:46.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.403+0000 7f8bcd82d640 1 -- 172.21.15.31:0/1231318376 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f8bb406b990 msgr2=0x7f8bb406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:46.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.403+0000 7f8bcd82d640 1 --2- 172.21.15.31:0/1231318376 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f8bb406b990 0x7f8bb406de50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8bb800ab60 tx=0x7f8bb8008040 comp rx=0 tx=0).stop 2024-04-15T00:31:46.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.403+0000 7f8bcd82d640 1 -- 172.21.15.31:0/1231318376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8bc80b9bd0 msgr2=0x7f8bc81d1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:46.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.403+0000 7f8bcd82d640 1 --2- 172.21.15.31:0/1231318376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8bc80b9bd0 0x7f8bc81d1090 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc02b830 tx=0x7f8bbc0046c0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.403+0000 7f8bcd82d640 1 -- 172.21.15.31:0/1231318376 shutdown_connections 2024-04-15T00:31:46.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.403+0000 7f8bcd82d640 1 --2- 172.21.15.31:0/1231318376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bc814b870 0x7f8bc81e0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.403+0000 7f8bcd82d640 1 --2- 172.21.15.31:0/1231318376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8bc80b9bd0 0x7f8bc81d1090 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.403+0000 7f8bcd82d640 1 --2- 172.21.15.31:0/1231318376 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f8bb406b990 0x7f8bb406de50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.403+0000 7f8bcd82d640 1 --2- 172.21.15.31:0/1231318376 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f8bc80b94f0 0x7f8bc80a1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.403+0000 7f8bcd82d640 1 -- 172.21.15.31:0/1231318376 >> 172.21.15.31:0/1231318376 conn(0x7f8bc809ed70 msgr2=0x7f8bc809b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:46.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.403+0000 7f8bcd82d640 1 -- 172.21.15.31:0/1231318376 shutdown_connections 2024-04-15T00:31:46.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.403+0000 7f8bcd82d640 1 -- 172.21.15.31:0/1231318376 wait complete. 2024-04-15T00:31:46.422 INFO:tasks.ceph:Scrubbing osd.5 2024-04-15T00:31:46.423 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-15T00:31:46.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.522+0000 7fe30fed1640 1 Processor -- start 2024-04-15T00:31:46.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.522+0000 7fe30fed1640 1 -- start start 2024-04-15T00:31:46.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.523+0000 7fe30fed1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe30814b950 0x7fe30809ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.523+0000 7fe30fed1640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3080b4980 con 0x7fe308148650 2024-04-15T00:31:46.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.523+0000 7fe30fed1640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3080b5670 con 0x7fe3080b5290 2024-04-15T00:31:46.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.523+0000 7fe30fed1640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe30814bd80 con 0x7fe30814b950 2024-04-15T00:31:46.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.523+0000 7fe30d46c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe308148650 0x7fe308150130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56240/0 (socket says 172.21.15.31:56240) 2024-04-15T00:31:46.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.523+0000 7fe30d46c640 1 -- 172.21.15.31:0/2579630319 learned_addr learned my addr 172.21.15.31:0/2579630319 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:31:46.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.523+0000 7fe30e46e640 1 --2- 172.21.15.31:0/2579630319 >> v2:172.21.15.50:3300/0 conn(0x7fe30814b950 0x7fe30809ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.523+0000 7fe30cc6b640 1 -- 172.21.15.31:0/2579630319 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3956156049 0 0) 0x7fe3080b4980 con 0x7fe308148650 2024-04-15T00:31:46.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.523+0000 7fe30cc6b640 1 -- 172.21.15.31:0/2579630319 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2f0003520 con 0x7fe308148650 2024-04-15T00:31:46.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.523+0000 7fe30cc6b640 1 -- 172.21.15.31:0/2579630319 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1744107719 0 0) 0x7fe2f0003520 con 0x7fe308148650 2024-04-15T00:31:46.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.523+0000 7fe30cc6b640 1 -- 172.21.15.31:0/2579630319 >> v2:172.21.15.50:3300/0 conn(0x7fe30814b950 msgr2=0x7fe30809ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:46.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.523+0000 7fe30cc6b640 1 --2- 172.21.15.31:0/2579630319 >> v2:172.21.15.50:3300/0 conn(0x7fe30814b950 0x7fe30809ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.523+0000 7fe30cc6b640 1 -- 172.21.15.31:0/2579630319 >> v1:172.21.15.50:6789/0 conn(0x7fe3080b5290 legacy=0x7fe308147f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:46.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.523+0000 7fe30cc6b640 1 -- 172.21.15.31:0/2579630319 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3080aee80 con 0x7fe308148650 2024-04-15T00:31:46.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.523+0000 7fe30cc6b640 1 -- 172.21.15.31:0/2579630319 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 697057150 0 0) 0x7fe2fc001670 con 0x7fe308148650 2024-04-15T00:31:46.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.523+0000 7fe30cc6b640 1 -- 172.21.15.31:0/2579630319 >> v1:172.21.15.31:6789/0 conn(0x7fe308148650 legacy=0x7fe308150130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:46.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.523+0000 7fe30cc6b640 1 --2- 172.21.15.31:0/2579630319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2f00039b0 0x7fe2f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.523+0000 7fe30cc6b640 1 --2- 172.21.15.31:0/2579630319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2f0004800 0x7fe2f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.523+0000 7fe30cc6b640 1 --2- 172.21.15.31:0/2579630319 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe2f00051c0 0x7fe2f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.523+0000 7fe30cc6b640 1 -- 172.21.15.31:0/2579630319 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe30814bd80 con 0x7fe2f00039b0 2024-04-15T00:31:46.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.523+0000 7fe30cc6b640 1 -- 172.21.15.31:0/2579630319 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f000c160 con 0x7fe2f0004800 2024-04-15T00:31:46.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.523+0000 7fe30cc6b640 1 -- 172.21.15.31:0/2579630319 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fe2f000c360 con 0x7fe2f00051c0 2024-04-15T00:31:46.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.524+0000 7fe30dc6d640 1 --2- 172.21.15.31:0/2579630319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2f00039b0 0x7fe2f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.524+0000 7fe30d46c640 1 --2- 172.21.15.31:0/2579630319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2f0004800 0x7fe2f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.524+0000 7fe30e46e640 1 --2- 172.21.15.31:0/2579630319 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe2f00051c0 0x7fe2f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.524+0000 7fe30dc6d640 1 -- 172.21.15.31:0/2579630319 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe2f00051c0 msgr2=0x7fe2f000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:46.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.524+0000 7fe30dc6d640 1 --2- 172.21.15.31:0/2579630319 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe2f00051c0 0x7fe2f000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.524+0000 7fe30dc6d640 1 -- 172.21.15.31:0/2579630319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2f0004800 msgr2=0x7fe2f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:46.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.524+0000 7fe30dc6d640 1 --2- 172.21.15.31:0/2579630319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2f0004800 0x7fe2f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.524+0000 7fe30e46e640 1 -- 172.21.15.31:0/2579630319 reap_dead start 2024-04-15T00:31:46.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.524+0000 7fe30dc6d640 1 -- 172.21.15.31:0/2579630319 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f0003520 con 0x7fe2f00039b0 2024-04-15T00:31:46.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.525+0000 7fe30dc6d640 1 --2- 172.21.15.31:0/2579630319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2f00039b0 0x7fe2f0003dd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe300001750 tx=0x7fe2f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7743eb363b2b358 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:46.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.525+0000 7fe30cc6b640 1 -- 172.21.15.31:0/2579630319 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe300001370 con 0x7fe2f00039b0 2024-04-15T00:31:46.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.525+0000 7fe30cc6b640 1 -- 172.21.15.31:0/2579630319 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3000052d0 con 0x7fe2f00039b0 2024-04-15T00:31:46.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.525+0000 7fe30cc6b640 1 -- 172.21.15.31:0/2579630319 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe300003830 con 0x7fe2f00039b0 2024-04-15T00:31:46.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.525+0000 7fe30fed1640 1 -- 172.21.15.31:0/2579630319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2f00039b0 msgr2=0x7fe2f0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:46.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.525+0000 7fe30fed1640 1 --2- 172.21.15.31:0/2579630319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2f00039b0 0x7fe2f0003dd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe300001750 tx=0x7fe2f0005830 comp rx=0 tx=0).stop 2024-04-15T00:31:46.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.525+0000 7fe30fed1640 1 -- 172.21.15.31:0/2579630319 shutdown_connections 2024-04-15T00:31:46.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.525+0000 7fe30fed1640 1 --2- 172.21.15.31:0/2579630319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2f00039b0 0x7fe2f0003dd0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.525+0000 7fe30fed1640 1 -- 172.21.15.31:0/2579630319 >> 172.21.15.31:0/2579630319 conn(0x7fe3080b6640 msgr2=0x7fe3080b6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:46.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.525+0000 7fe30fed1640 1 -- 172.21.15.31:0/2579630319 shutdown_connections 2024-04-15T00:31:46.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.525+0000 7fe30fed1640 1 -- 172.21.15.31:0/2579630319 wait complete. 2024-04-15T00:31:46.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.526+0000 7fe30fed1640 1 Processor -- start 2024-04-15T00:31:46.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.526+0000 7fe30fed1640 1 -- start start 2024-04-15T00:31:46.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.527+0000 7fe30fed1640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe2f00039b0 0x7fe30814a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.527+0000 7fe30fed1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3081dd1e0 0x7fe3081dd660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.527+0000 7fe30fed1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3081d6c70 0x7fe3081d70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.527+0000 7fe30fed1640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe30814b430 con 0x7fe3081dd1e0 2024-04-15T00:31:46.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.527+0000 7fe30fed1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe3080b0c50 con 0x7fe3081d6c70 2024-04-15T00:31:46.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.527+0000 7fe30fed1640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fe3080b7530 con 0x7fe2f00039b0 2024-04-15T00:31:46.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.527+0000 7fe30d46c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3081dd1e0 0x7fe3081dd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.527+0000 7fe30d46c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3081dd1e0 0x7fe3081dd660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57598/0 (socket says 172.21.15.31:57598) 2024-04-15T00:31:46.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.527+0000 7fe30d46c640 1 -- 172.21.15.31:0/3291594968 learned_addr learned my addr 172.21.15.31:0/3291594968 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:46.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.527+0000 7fe30d46c640 1 -- 172.21.15.31:0/3291594968 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe2f00039b0 msgr2=0x7fe30814a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:46.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.527+0000 7fe30d46c640 1 --2- 172.21.15.31:0/3291594968 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe2f00039b0 0x7fe30814a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.527+0000 7fe30e46e640 1 --2- 172.21.15.31:0/3291594968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3081d6c70 0x7fe3081d70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.527+0000 7fe30d46c640 1 -- 172.21.15.31:0/3291594968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3081d6c70 msgr2=0x7fe3081d70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:46.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.527+0000 7fe30d46c640 1 --2- 172.21.15.31:0/3291594968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3081d6c70 0x7fe3081d70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.527+0000 7fe30d46c640 1 -- 172.21.15.31:0/3291594968 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe308149a60 con 0x7fe3081dd1e0 2024-04-15T00:31:46.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.527+0000 7fe30d46c640 1 --2- 172.21.15.31:0/3291594968 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3081dd1e0 0x7fe3081dd660 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc007290 tx=0x7fe2fc007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:46.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.528+0000 7fe3067fc640 1 -- 172.21.15.31:0/3291594968 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc00f8e0 con 0x7fe3081dd1e0 2024-04-15T00:31:46.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.528+0000 7fe3067fc640 1 -- 172.21.15.31:0/3291594968 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2fc018070 con 0x7fe3081dd1e0 2024-04-15T00:31:46.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.528+0000 7fe30fed1640 1 -- 172.21.15.31:0/3291594968 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3081ddba0 con 0x7fe3081dd1e0 2024-04-15T00:31:46.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.528+0000 7fe3067fc640 1 -- 172.21.15.31:0/3291594968 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc00fca0 con 0x7fe3081dd1e0 2024-04-15T00:31:46.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.528+0000 7fe30fed1640 1 -- 172.21.15.31:0/3291594968 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe308071f80 con 0x7fe3081dd1e0 2024-04-15T00:31:46.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.528+0000 7fe30fed1640 1 -- 172.21.15.31:0/3291594968 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe30804f620 con 0x7fe3081dd1e0 2024-04-15T00:31:46.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.529+0000 7fe3067fc640 1 -- 172.21.15.31:0/3291594968 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fe2fc01d460 con 0x7fe3081dd1e0 2024-04-15T00:31:46.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.529+0000 7fe3067fc640 1 --2- 172.21.15.31:0/3291594968 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe2f406b9c0 0x7fe2f406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.530+0000 7fe3067fc640 1 -- 172.21.15.31:0/3291594968 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fe2fc08aad0 con 0x7fe3081dd1e0 2024-04-15T00:31:46.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.530+0000 7fe30dc6d640 1 --2- 172.21.15.31:0/3291594968 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe2f406b9c0 0x7fe2f406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.530+0000 7fe3067fc640 1 --2- 172.21.15.31:0/3291594968 >> [v2:172.21.15.50:6808/1589417182,v1:172.21.15.50:6809/1589417182] conn(0x7fe2f40753d0 0x7fe2f4077870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.530+0000 7fe3067fc640 1 -- 172.21.15.31:0/3291594968 --> [v2:172.21.15.50:6808/1589417182,v1:172.21.15.50:6809/1589417182] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe2fc00ae50 con 0x7fe2f40753d0 2024-04-15T00:31:46.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.530+0000 7fe3067fc640 1 -- 172.21.15.31:0/3291594968 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe2fc08f2c0 con 0x7fe3081dd1e0 2024-04-15T00:31:46.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.530+0000 7fe30e46e640 1 --2- 172.21.15.31:0/3291594968 >> [v2:172.21.15.50:6808/1589417182,v1:172.21.15.50:6809/1589417182] conn(0x7fe2f40753d0 0x7fe2f4077870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.530+0000 7fe30dc6d640 1 --2- 172.21.15.31:0/3291594968 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe2f406b9c0 0x7fe2f406de80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe300033000 tx=0x7fe30002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:46.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.530+0000 7fe30e46e640 1 --2- 172.21.15.31:0/3291594968 >> [v2:172.21.15.50:6808/1589417182,v1:172.21.15.50:6809/1589417182] conn(0x7fe2f40753d0 0x7fe2f4077870 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:46.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.531+0000 7fe3067fc640 1 -- 172.21.15.31:0/3291594968 <== osd.5 v2:172.21.15.50:6808/1589417182 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe2fc00ae50 con 0x7fe2f40753d0 2024-04-15T00:31:46.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.545+0000 7fe30fed1640 1 -- 172.21.15.31:0/3291594968 --> [v2:172.21.15.50:6808/1589417182,v1:172.21.15.50:6809/1589417182] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe3080b3ff0 con 0x7fe2f40753d0 2024-04-15T00:31:46.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.545+0000 7fe3067fc640 1 -- 172.21.15.31:0/3291594968 <== osd.5 v2:172.21.15.50:6808/1589417182 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe3080b3ff0 con 0x7fe2f40753d0 2024-04-15T00:31:46.553 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-15T00:31:46.554 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T00:31:46.554 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-15T00:31:46.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.545+0000 7fe30fed1640 1 -- 172.21.15.31:0/3291594968 >> [v2:172.21.15.50:6808/1589417182,v1:172.21.15.50:6809/1589417182] conn(0x7fe2f40753d0 msgr2=0x7fe2f4077870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:46.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.545+0000 7fe30fed1640 1 --2- 172.21.15.31:0/3291594968 >> [v2:172.21.15.50:6808/1589417182,v1:172.21.15.50:6809/1589417182] conn(0x7fe2f40753d0 0x7fe2f4077870 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.546+0000 7fe30fed1640 1 -- 172.21.15.31:0/3291594968 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe2f406b9c0 msgr2=0x7fe2f406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:46.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.546+0000 7fe30fed1640 1 --2- 172.21.15.31:0/3291594968 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe2f406b9c0 0x7fe2f406de80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe300033000 tx=0x7fe30002f000 comp rx=0 tx=0).stop 2024-04-15T00:31:46.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.546+0000 7fe30fed1640 1 -- 172.21.15.31:0/3291594968 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3081dd1e0 msgr2=0x7fe3081dd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:46.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.546+0000 7fe30fed1640 1 --2- 172.21.15.31:0/3291594968 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3081dd1e0 0x7fe3081dd660 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc007290 tx=0x7fe2fc007750 comp rx=0 tx=0).stop 2024-04-15T00:31:46.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.546+0000 7fe30e46e640 1 -- 172.21.15.31:0/3291594968 reap_dead start 2024-04-15T00:31:46.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.546+0000 7fe30fed1640 1 -- 172.21.15.31:0/3291594968 shutdown_connections 2024-04-15T00:31:46.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.546+0000 7fe30fed1640 1 -- 172.21.15.31:0/3291594968 >> 172.21.15.31:0/3291594968 conn(0x7fe3080b6640 msgr2=0x7fe308147d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:46.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.546+0000 7fe30fed1640 1 -- 172.21.15.31:0/3291594968 shutdown_connections 2024-04-15T00:31:46.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.546+0000 7fe30fed1640 1 -- 172.21.15.31:0/3291594968 wait complete. 2024-04-15T00:31:46.564 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-15T00:31:46.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.660+0000 7fb4c7808640 1 Processor -- start 2024-04-15T00:31:46.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.660+0000 7fb4c7808640 1 -- start start 2024-04-15T00:31:46.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.660+0000 7fb4c7808640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb4c00baef0 0x7fb4c0147670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.660+0000 7fb4c7808640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb4c014b8e0 0x7fb4c00b9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.660+0000 7fb4c7808640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4c00b8bf0 0x7fb4c0072600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.660+0000 7fb4c7808640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fb4c00bb2d0 con 0x7fb4c014b8e0 2024-04-15T00:31:46.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.660+0000 7fb4c7808640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fb4c0147bb0 con 0x7fb4c00baef0 2024-04-15T00:31:46.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.660+0000 7fb4c7808640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fb4c014ae00 con 0x7fb4c00b8bf0 2024-04-15T00:31:46.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.661+0000 7fb4c4da3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb4c014b8e0 0x7fb4c00b9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.661+0000 7fb4c4da3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb4c014b8e0 0x7fb4c00b9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57602/0 (socket says 172.21.15.31:57602) 2024-04-15T00:31:46.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.661+0000 7fb4c4da3640 1 -- 172.21.15.31:0/2103876028 learned_addr learned my addr 172.21.15.31:0/2103876028 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:46.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.661+0000 7fb4c55a4640 1 --2- 172.21.15.31:0/2103876028 >> v2:172.21.15.50:3300/0 conn(0x7fb4c00baef0 0x7fb4c0147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.661+0000 7fb4c5da5640 1 --2- 172.21.15.31:0/2103876028 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4c00b8bf0 0x7fb4c0072600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.661+0000 7fb4c4da3640 1 -- 172.21.15.31:0/2103876028 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4c00b8bf0 msgr2=0x7fb4c0072600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:46.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.661+0000 7fb4c4da3640 1 --2- 172.21.15.31:0/2103876028 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4c00b8bf0 0x7fb4c0072600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.661+0000 7fb4c4da3640 1 -- 172.21.15.31:0/2103876028 >> v2:172.21.15.50:3300/0 conn(0x7fb4c00baef0 msgr2=0x7fb4c0147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:46.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.661+0000 7fb4c4da3640 1 --2- 172.21.15.31:0/2103876028 >> v2:172.21.15.50:3300/0 conn(0x7fb4c00baef0 0x7fb4c0147670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.661+0000 7fb4c4da3640 1 -- 172.21.15.31:0/2103876028 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4c014b0e0 con 0x7fb4c014b8e0 2024-04-15T00:31:46.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.661+0000 7fb4c55a4640 1 --2- 172.21.15.31:0/2103876028 >> v2:172.21.15.50:3300/0 conn(0x7fb4c00baef0 0x7fb4c0147670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:31:46.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.661+0000 7fb4c5da5640 1 --2- 172.21.15.31:0/2103876028 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4c00b8bf0 0x7fb4c0072600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:31:46.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.662+0000 7fb4c4da3640 1 --2- 172.21.15.31:0/2103876028 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4c014b8e0 0x7fb4c00b9a10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb4c00736a0 tx=0x7fb4b002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a291c3a99676ef server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:46.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.662+0000 7fb4b7fff640 1 -- 172.21.15.31:0/2103876028 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b002e070 con 0x7fb4c014b8e0 2024-04-15T00:31:46.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.662+0000 7fb4b7fff640 1 -- 172.21.15.31:0/2103876028 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4b0037070 con 0x7fb4c014b8e0 2024-04-15T00:31:46.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.662+0000 7fb4b7fff640 1 -- 172.21.15.31:0/2103876028 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b0031a00 con 0x7fb4c014b8e0 2024-04-15T00:31:46.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.662+0000 7fb4c7808640 1 -- 172.21.15.31:0/2103876028 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4c014b8e0 msgr2=0x7fb4c00b9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:46.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.662+0000 7fb4c7808640 1 --2- 172.21.15.31:0/2103876028 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4c014b8e0 0x7fb4c00b9a10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb4c00736a0 tx=0x7fb4b002b880 comp rx=0 tx=0).stop 2024-04-15T00:31:46.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.662+0000 7fb4c7808640 1 -- 172.21.15.31:0/2103876028 shutdown_connections 2024-04-15T00:31:46.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.662+0000 7fb4c7808640 1 --2- 172.21.15.31:0/2103876028 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4c00b8bf0 0x7fb4c0072600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.662+0000 7fb4c7808640 1 --2- 172.21.15.31:0/2103876028 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4c014b8e0 0x7fb4c00b9a10 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.662+0000 7fb4c7808640 1 --2- 172.21.15.31:0/2103876028 >> v2:172.21.15.50:3300/0 conn(0x7fb4c00baef0 0x7fb4c0147670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.662+0000 7fb4c7808640 1 -- 172.21.15.31:0/2103876028 >> 172.21.15.31:0/2103876028 conn(0x7fb4c009ed70 msgr2=0x7fb4c009f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:46.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.662+0000 7fb4c7808640 1 -- 172.21.15.31:0/2103876028 shutdown_connections 2024-04-15T00:31:46.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.662+0000 7fb4c7808640 1 -- 172.21.15.31:0/2103876028 wait complete. 2024-04-15T00:31:46.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.663+0000 7fb4c7808640 1 Processor -- start 2024-04-15T00:31:46.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.663+0000 7fb4c7808640 1 -- start start 2024-04-15T00:31:46.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.664+0000 7fb4c7808640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4c00b8bf0 0x7fb4c0144010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.664+0000 7fb4c7808640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4c00baef0 0x7fb4c01dda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.664+0000 7fb4c7808640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4c014b8e0 0x7fb4c01e0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.664+0000 7fb4c7808640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c00ba0d0 con 0x7fb4c00b8bf0 2024-04-15T00:31:46.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.664+0000 7fb4c7808640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c00b9f50 con 0x7fb4c00baef0 2024-04-15T00:31:46.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.664+0000 7fb4c7808640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fb4c00b9040 con 0x7fb4c014b8e0 2024-04-15T00:31:46.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.664+0000 7fb4c55a4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4c00b8bf0 0x7fb4c0144010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.664+0000 7fb4c55a4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4c00b8bf0 0x7fb4c0144010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57606/0 (socket says 172.21.15.31:57606) 2024-04-15T00:31:46.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.664+0000 7fb4c55a4640 1 -- 172.21.15.31:0/1516358601 learned_addr learned my addr 172.21.15.31:0/1516358601 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:46.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.664+0000 7fb4c4da3640 1 --2- 172.21.15.31:0/1516358601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4c00baef0 0x7fb4c01dda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.664+0000 7fb4c5da5640 1 --2- 172.21.15.31:0/1516358601 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4c014b8e0 0x7fb4c01e0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.664+0000 7fb4c55a4640 1 -- 172.21.15.31:0/1516358601 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4c014b8e0 msgr2=0x7fb4c01e0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:46.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.664+0000 7fb4c55a4640 1 --2- 172.21.15.31:0/1516358601 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4c014b8e0 0x7fb4c01e0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.664+0000 7fb4c55a4640 1 -- 172.21.15.31:0/1516358601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4c00baef0 msgr2=0x7fb4c01dda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:46.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.664+0000 7fb4c55a4640 1 --2- 172.21.15.31:0/1516358601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4c00baef0 0x7fb4c01dda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.664+0000 7fb4c55a4640 1 -- 172.21.15.31:0/1516358601 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4c01ddf40 con 0x7fb4c00b8bf0 2024-04-15T00:31:46.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.664+0000 7fb4c4da3640 1 --2- 172.21.15.31:0/1516358601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4c00baef0 0x7fb4c01dda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:31:46.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.665+0000 7fb4c55a4640 1 --2- 172.21.15.31:0/1516358601 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4c00b8bf0 0x7fb4c0144010 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc00e7e0 tx=0x7fb4bc00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:46.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.665+0000 7fb4b5ffb640 1 -- 172.21.15.31:0/1516358601 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc00f040 con 0x7fb4c00b8bf0 2024-04-15T00:31:46.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.665+0000 7fb4b5ffb640 1 -- 172.21.15.31:0/1516358601 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4bc004030 con 0x7fb4c00b8bf0 2024-04-15T00:31:46.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.665+0000 7fb4b5ffb640 1 -- 172.21.15.31:0/1516358601 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc004400 con 0x7fb4c00b8bf0 2024-04-15T00:31:46.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.665+0000 7fb4c7808640 1 -- 172.21.15.31:0/1516358601 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4c01d1aa0 con 0x7fb4c00b8bf0 2024-04-15T00:31:46.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.665+0000 7fb4c7808640 1 -- 172.21.15.31:0/1516358601 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4c01d17c0 con 0x7fb4c00b8bf0 2024-04-15T00:31:46.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.666+0000 7fb4c7808640 1 -- 172.21.15.31:0/1516358601 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4c01dcff0 con 0x7fb4c00b8bf0 2024-04-15T00:31:46.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.666+0000 7fb4b5ffb640 1 -- 172.21.15.31:0/1516358601 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fb4bc00c6d0 con 0x7fb4c00b8bf0 2024-04-15T00:31:46.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.667+0000 7fb4b5ffb640 1 --2- 172.21.15.31:0/1516358601 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb4a406b990 0x7fb4a406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.667+0000 7fb4b5ffb640 1 -- 172.21.15.31:0/1516358601 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fb4bc08aa50 con 0x7fb4c00b8bf0 2024-04-15T00:31:46.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.667+0000 7fb4c4da3640 1 --2- 172.21.15.31:0/1516358601 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb4a406b990 0x7fb4a406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.667+0000 7fb4c4da3640 1 --2- 172.21.15.31:0/1516358601 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb4a406b990 0x7fb4a406de50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0036000 tx=0x7fb4b003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:46.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.671+0000 7fb4b5ffb640 1 -- 172.21.15.31:0/1516358601 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb4bc017020 con 0x7fb4c00b8bf0 2024-04-15T00:31:46.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.853+0000 7fb4c7808640 1 -- 172.21.15.31:0/1516358601 --> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fb4c004f620 con 0x7fb4a406b990 2024-04-15T00:31:46.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.853+0000 7fb4b5ffb640 1 -- 172.21.15.31:0/1516358601 <== mgr.4107 v2:172.21.15.31:6832/915470279 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb4c004f620 con 0x7fb4a406b990 2024-04-15T00:31:46.862 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 5 to deep-scrub 2024-04-15T00:31:46.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.855+0000 7fb4c7808640 1 -- 172.21.15.31:0/1516358601 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb4a406b990 msgr2=0x7fb4a406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:46.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.855+0000 7fb4c7808640 1 --2- 172.21.15.31:0/1516358601 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb4a406b990 0x7fb4a406de50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0036000 tx=0x7fb4b003d040 comp rx=0 tx=0).stop 2024-04-15T00:31:46.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.855+0000 7fb4c7808640 1 -- 172.21.15.31:0/1516358601 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4c00b8bf0 msgr2=0x7fb4c0144010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:46.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.855+0000 7fb4c7808640 1 --2- 172.21.15.31:0/1516358601 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4c00b8bf0 0x7fb4c0144010 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc00e7e0 tx=0x7fb4bc00eca0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.855+0000 7fb4c7808640 1 -- 172.21.15.31:0/1516358601 shutdown_connections 2024-04-15T00:31:46.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.855+0000 7fb4c7808640 1 --2- 172.21.15.31:0/1516358601 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb4a406b990 0x7fb4a406de50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.855+0000 7fb4c7808640 1 --2- 172.21.15.31:0/1516358601 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb4c014b8e0 0x7fb4c01e0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.855+0000 7fb4c7808640 1 --2- 172.21.15.31:0/1516358601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4c00baef0 0x7fb4c01dda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.855+0000 7fb4c7808640 1 --2- 172.21.15.31:0/1516358601 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4c00b8bf0 0x7fb4c0144010 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.855+0000 7fb4c7808640 1 -- 172.21.15.31:0/1516358601 >> 172.21.15.31:0/1516358601 conn(0x7fb4c009ed70 msgr2=0x7fb4c00bd680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:46.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.855+0000 7fb4c7808640 1 -- 172.21.15.31:0/1516358601 shutdown_connections 2024-04-15T00:31:46.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.855+0000 7fb4c7808640 1 -- 172.21.15.31:0/1516358601 wait complete. 2024-04-15T00:31:46.875 INFO:tasks.ceph:Scrubbing osd.6 2024-04-15T00:31:46.875 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-15T00:31:46.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.974+0000 7f04d1584640 1 Processor -- start 2024-04-15T00:31:46.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.974+0000 7f04d1584640 1 -- start start 2024-04-15T00:31:46.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.975+0000 7f04d1584640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04cc0b56b0 0x7f04cc0b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.975+0000 7f04d1584640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04cc06c6d0 con 0x7f04cc0b6f50 2024-04-15T00:31:46.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.975+0000 7f04d1584640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04cc06d150 con 0x7f04cc0b6b10 2024-04-15T00:31:46.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.975+0000 7f04d1584640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f04cc0b5fd0 con 0x7f04cc0b56b0 2024-04-15T00:31:46.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.975+0000 7f04cb7fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f04cc0b6f50 0x7f04cc152050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56248/0 (socket says 172.21.15.31:56248) 2024-04-15T00:31:46.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.975+0000 7f04cb7fe640 1 -- 172.21.15.31:0/4254154970 learned_addr learned my addr 172.21.15.31:0/4254154970 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:31:46.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.975+0000 7f04caffd640 1 --2- 172.21.15.31:0/4254154970 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04cc0b56b0 0x7f04cc0b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.975+0000 7f04c9ffb640 1 -- 172.21.15.31:0/4254154970 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1935669251 0 0) 0x7f04cc06c6d0 con 0x7f04cc0b6f50 2024-04-15T00:31:46.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.975+0000 7f04c9ffb640 1 -- 172.21.15.31:0/4254154970 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04b8003520 con 0x7f04cc0b6f50 2024-04-15T00:31:46.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.975+0000 7f04c9ffb640 1 -- 172.21.15.31:0/4254154970 <== mon.1 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1458801629 0 0) 0x7f04cc06d150 con 0x7f04cc0b6b10 2024-04-15T00:31:46.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.975+0000 7f04c9ffb640 1 -- 172.21.15.31:0/4254154970 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04cc06c6d0 con 0x7f04cc0b6b10 2024-04-15T00:31:46.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.975+0000 7f04c9ffb640 1 -- 172.21.15.31:0/4254154970 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 337415476 0 0) 0x7f04b8003520 con 0x7f04cc0b6f50 2024-04-15T00:31:46.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.975+0000 7f04c9ffb640 1 -- 172.21.15.31:0/4254154970 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04cc0b56b0 msgr2=0x7f04cc0b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:46.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.975+0000 7f04c9ffb640 1 --2- 172.21.15.31:0/4254154970 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04cc0b56b0 0x7f04cc0b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.975+0000 7f04c9ffb640 1 -- 172.21.15.31:0/4254154970 >> v1:172.21.15.50:6789/0 conn(0x7f04cc0b6b10 legacy=0x7f04cc14b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:46.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.975+0000 7f04c9ffb640 1 -- 172.21.15.31:0/4254154970 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04cc14bbf0 con 0x7f04cc0b6f50 2024-04-15T00:31:46.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.975+0000 7f04c9ffb640 1 -- 172.21.15.31:0/4254154970 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 697057150 0 0) 0x7f04bc001a10 con 0x7f04cc0b6f50 2024-04-15T00:31:46.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.975+0000 7f04c9ffb640 1 -- 172.21.15.31:0/4254154970 >> v1:172.21.15.31:6789/0 conn(0x7f04cc0b6f50 legacy=0x7f04cc152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:46.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.975+0000 7f04c9ffb640 1 --2- 172.21.15.31:0/4254154970 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04b8003b70 0x7f04b8003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.975+0000 7f04c9ffb640 1 --2- 172.21.15.31:0/4254154970 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04cc0b56b0 0x7f04b8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.975+0000 7f04c9ffb640 1 --2- 172.21.15.31:0/4254154970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04b8004d40 0x7f04b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.976+0000 7f04c9ffb640 1 -- 172.21.15.31:0/4254154970 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc0b5fd0 con 0x7f04b8003b70 2024-04-15T00:31:46.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.976+0000 7f04c9ffb640 1 -- 172.21.15.31:0/4254154970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f04b800bb50 con 0x7f04b8004d40 2024-04-15T00:31:46.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.976+0000 7f04c9ffb640 1 -- 172.21.15.31:0/4254154970 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f04b800bd20 con 0x7f04cc0b56b0 2024-04-15T00:31:46.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.976+0000 7f04caffd640 1 --2- 172.21.15.31:0/4254154970 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04b8003b70 0x7f04b8003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.976+0000 7f04ca7fc640 1 --2- 172.21.15.31:0/4254154970 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04cc0b56b0 0x7f04b8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.976+0000 7f04cb7fe640 1 --2- 172.21.15.31:0/4254154970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04b8004d40 0x7f04b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.976+0000 7f04caffd640 1 -- 172.21.15.31:0/4254154970 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04cc0b56b0 msgr2=0x7f04b8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:46.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.976+0000 7f04caffd640 1 --2- 172.21.15.31:0/4254154970 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04cc0b56b0 0x7f04b8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.976+0000 7f04caffd640 1 -- 172.21.15.31:0/4254154970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04b8004d40 msgr2=0x7f04b80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:46.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.976+0000 7f04caffd640 1 --2- 172.21.15.31:0/4254154970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04b8004d40 0x7f04b80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:46.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.976+0000 7f04caffd640 1 -- 172.21.15.31:0/4254154970 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b8003520 con 0x7f04b8003b70 2024-04-15T00:31:46.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.977+0000 7f04caffd640 1 --2- 172.21.15.31:0/4254154970 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04b8003b70 0x7f04b8003f70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f04c4009af0 tx=0x7f04b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a067d093800b75 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:46.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.977+0000 7f04c9ffb640 1 -- 172.21.15.31:0/4254154970 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c4039070 con 0x7f04b8003b70 2024-04-15T00:31:46.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.977+0000 7f04c9ffb640 1 -- 172.21.15.31:0/4254154970 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c402c6b0 con 0x7f04b8003b70 2024-04-15T00:31:46.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.977+0000 7f04c9ffb640 1 -- 172.21.15.31:0/4254154970 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c4009690 con 0x7f04b8003b70 2024-04-15T00:31:46.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.977+0000 7f04d1584640 1 -- 172.21.15.31:0/4254154970 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04b8003b70 msgr2=0x7f04b8003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:46.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.977+0000 7f04d1584640 1 --2- 172.21.15.31:0/4254154970 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04b8003b70 0x7f04b8003f70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f04c4009af0 tx=0x7f04b8005830 comp rx=0 tx=0).stop 2024-04-15T00:31:46.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.977+0000 7f04cb7fe640 1 -- 172.21.15.31:0/4254154970 reap_dead start 2024-04-15T00:31:46.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.977+0000 7f04d1584640 1 -- 172.21.15.31:0/4254154970 shutdown_connections 2024-04-15T00:31:46.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.977+0000 7f04d1584640 1 -- 172.21.15.31:0/4254154970 >> 172.21.15.31:0/4254154970 conn(0x7f04cc0b77b0 msgr2=0x7f04cc0b7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:46.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.977+0000 7f04d1584640 1 -- 172.21.15.31:0/4254154970 shutdown_connections 2024-04-15T00:31:46.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.977+0000 7f04d1584640 1 -- 172.21.15.31:0/4254154970 wait complete. 2024-04-15T00:31:46.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.979+0000 7f04d1584640 1 Processor -- start 2024-04-15T00:31:46.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.979+0000 7f04d1584640 1 -- start start 2024-04-15T00:31:46.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.979+0000 7f04d1584640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04b8003b70 0x7f04cc144990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.979+0000 7f04d1584640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04cc144ed0 0x7f04cc1428a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.979+0000 7f04d1584640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04cc142de0 0x7f04cc1e08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:46.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.979+0000 7f04d1584640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc0b65f0 con 0x7f04b8003b70 2024-04-15T00:31:46.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.979+0000 7f04d1584640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc06ca30 con 0x7f04cc142de0 2024-04-15T00:31:46.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.979+0000 7f04d1584640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f04cc06ba10 con 0x7f04cc144ed0 2024-04-15T00:31:46.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.979+0000 7f04caffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04b8003b70 0x7f04cc144990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.979+0000 7f04caffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04b8003b70 0x7f04cc144990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57618/0 (socket says 172.21.15.31:57618) 2024-04-15T00:31:46.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.979+0000 7f04caffd640 1 -- 172.21.15.31:0/3093175489 learned_addr learned my addr 172.21.15.31:0/3093175489 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:46.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.980+0000 7f04ca7fc640 1 --2- 172.21.15.31:0/3093175489 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04cc144ed0 0x7f04cc1428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.980+0000 7f04cb7fe640 1 --2- 172.21.15.31:0/3093175489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04cc142de0 0x7f04cc1e08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:46.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.980+0000 7f04caffd640 1 -- 172.21.15.31:0/3093175489 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04cc144ed0 msgr2=0x7f04cc1428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:46.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.980+0000 7f04caffd640 1 --2- 172.21.15.31:0/3093175489 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f04cc144ed0 0x7f04cc1428a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:47.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.980+0000 7f04caffd640 1 -- 172.21.15.31:0/3093175489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04cc142de0 msgr2=0x7f04cc1e08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:47.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.980+0000 7f04caffd640 1 --2- 172.21.15.31:0/3093175489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04cc142de0 0x7f04cc1e08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:47.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.980+0000 7f04caffd640 1 -- 172.21.15.31:0/3093175489 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04cc144020 con 0x7f04b8003b70 2024-04-15T00:31:47.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.980+0000 7f04cb7fe640 1 --2- 172.21.15.31:0/3093175489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04cc142de0 0x7f04cc1e08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:31:47.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.980+0000 7f04caffd640 1 --2- 172.21.15.31:0/3093175489 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04b8003b70 0x7f04cc144990 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f04c4037040 tx=0x7f04c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:47.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.980+0000 7f04c37fe640 1 -- 172.21.15.31:0/3093175489 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c4042020 con 0x7f04b8003b70 2024-04-15T00:31:47.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.980+0000 7f04c37fe640 1 -- 172.21.15.31:0/3093175489 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c403a040 con 0x7f04b8003b70 2024-04-15T00:31:47.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.980+0000 7f04d1584640 1 -- 172.21.15.31:0/3093175489 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04cc147e50 con 0x7f04b8003b70 2024-04-15T00:31:47.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.980+0000 7f04c37fe640 1 -- 172.21.15.31:0/3093175489 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c4039070 con 0x7f04b8003b70 2024-04-15T00:31:47.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.980+0000 7f04d1584640 1 -- 172.21.15.31:0/3093175489 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04cc148410 con 0x7f04b8003b70 2024-04-15T00:31:47.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.981+0000 7f04d1584640 1 -- 172.21.15.31:0/3093175489 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f04cc06b730 con 0x7f04b8003b70 2024-04-15T00:31:47.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.981+0000 7f04c37fe640 1 -- 172.21.15.31:0/3093175489 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f04c4045020 con 0x7f04b8003b70 2024-04-15T00:31:47.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.982+0000 7f04c37fe640 1 --2- 172.21.15.31:0/3093175489 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f04ac06b9c0 0x7f04ac06de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:47.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.982+0000 7f04c37fe640 1 -- 172.21.15.31:0/3093175489 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f04c40abd20 con 0x7f04b8003b70 2024-04-15T00:31:47.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.982+0000 7f04ca7fc640 1 --2- 172.21.15.31:0/3093175489 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f04ac06b9c0 0x7f04ac06de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:47.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.982+0000 7f04c37fe640 1 --2- 172.21.15.31:0/3093175489 >> [v2:172.21.15.50:6816/682288274,v1:172.21.15.50:6817/682288274] conn(0x7f04ac0753d0 0x7f04ac077870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:47.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.982+0000 7f04c37fe640 1 -- 172.21.15.31:0/3093175489 --> [v2:172.21.15.50:6816/682288274,v1:172.21.15.50:6817/682288274] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f04ac077f40 con 0x7f04ac0753d0 2024-04-15T00:31:47.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.982+0000 7f04c37fe640 1 -- 172.21.15.31:0/3093175489 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f04c40ae420 con 0x7f04b8003b70 2024-04-15T00:31:47.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.982+0000 7f04cb7fe640 1 --2- 172.21.15.31:0/3093175489 >> [v2:172.21.15.50:6816/682288274,v1:172.21.15.50:6817/682288274] conn(0x7f04ac0753d0 0x7f04ac077870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:47.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.982+0000 7f04ca7fc640 1 --2- 172.21.15.31:0/3093175489 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f04ac06b9c0 0x7f04ac06de80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f04cc1d4af0 tx=0x7f04b4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:47.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.983+0000 7f04cb7fe640 1 --2- 172.21.15.31:0/3093175489 >> [v2:172.21.15.50:6816/682288274,v1:172.21.15.50:6817/682288274] conn(0x7f04ac0753d0 0x7f04ac077870 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:47.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.984+0000 7f04c37fe640 1 -- 172.21.15.31:0/3093175489 <== osd.6 v2:172.21.15.50:6816/682288274 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f04ac077f40 con 0x7f04ac0753d0 2024-04-15T00:31:47.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.997+0000 7f04d1584640 1 -- 172.21.15.31:0/3093175489 --> [v2:172.21.15.50:6816/682288274,v1:172.21.15.50:6817/682288274] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f04cc04f620 con 0x7f04ac0753d0 2024-04-15T00:31:47.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.998+0000 7f04c37fe640 1 -- 172.21.15.31:0/3093175489 <== osd.6 v2:172.21.15.50:6816/682288274 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f04cc04f620 con 0x7f04ac0753d0 2024-04-15T00:31:47.006 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-15T00:31:47.006 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T00:31:47.006 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-15T00:31:47.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.998+0000 7f04d1584640 1 -- 172.21.15.31:0/3093175489 >> [v2:172.21.15.50:6816/682288274,v1:172.21.15.50:6817/682288274] conn(0x7f04ac0753d0 msgr2=0x7f04ac077870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:47.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.998+0000 7f04d1584640 1 --2- 172.21.15.31:0/3093175489 >> [v2:172.21.15.50:6816/682288274,v1:172.21.15.50:6817/682288274] conn(0x7f04ac0753d0 0x7f04ac077870 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:47.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.998+0000 7f04d1584640 1 -- 172.21.15.31:0/3093175489 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f04ac06b9c0 msgr2=0x7f04ac06de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:47.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.998+0000 7f04d1584640 1 --2- 172.21.15.31:0/3093175489 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f04ac06b9c0 0x7f04ac06de80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f04cc1d4af0 tx=0x7f04b4009040 comp rx=0 tx=0).stop 2024-04-15T00:31:47.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.998+0000 7f04d1584640 1 -- 172.21.15.31:0/3093175489 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04b8003b70 msgr2=0x7f04cc144990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:47.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.998+0000 7f04d1584640 1 --2- 172.21.15.31:0/3093175489 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04b8003b70 0x7f04cc144990 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f04c4037040 tx=0x7f04c4004730 comp rx=0 tx=0).stop 2024-04-15T00:31:47.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.998+0000 7f04cb7fe640 1 -- 172.21.15.31:0/3093175489 reap_dead start 2024-04-15T00:31:47.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.998+0000 7f04d1584640 1 -- 172.21.15.31:0/3093175489 shutdown_connections 2024-04-15T00:31:47.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.998+0000 7f04d1584640 1 -- 172.21.15.31:0/3093175489 >> 172.21.15.31:0/3093175489 conn(0x7f04cc0b77b0 msgr2=0x7f04cc071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:47.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.999+0000 7f04d1584640 1 -- 172.21.15.31:0/3093175489 shutdown_connections 2024-04-15T00:31:47.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:46.999+0000 7f04d1584640 1 -- 172.21.15.31:0/3093175489 wait complete. 2024-04-15T00:31:47.017 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-15T00:31:47.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.112+0000 7fe76311e640 1 Processor -- start 2024-04-15T00:31:47.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.112+0000 7fe76311e640 1 -- start start 2024-04-15T00:31:47.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.112+0000 7fe76311e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe75c0b0590 0x7fe75c0b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:47.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.112+0000 7fe76311e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe75c0af930 0x7fe75c06b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:47.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.112+0000 7fe76311e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe75c067560 con 0x7fe75c067180 2024-04-15T00:31:47.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.112+0000 7fe76311e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fe75c0afdc0 con 0x7fe75c0af930 2024-04-15T00:31:47.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.112+0000 7fe76311e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe75c0af1d0 con 0x7fe75c0b0590 2024-04-15T00:31:47.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.112+0000 7fe7616bb640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe75c0af930 0x7fe75c06b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:47.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.112+0000 7fe760eba640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe75c067180 0x7fe75c06b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56258/0 (socket says 172.21.15.31:56258) 2024-04-15T00:31:47.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.112+0000 7fe760eba640 1 -- 172.21.15.31:0/603879052 learned_addr learned my addr 172.21.15.31:0/603879052 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:31:47.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.112+0000 7fe75bfff640 1 --2- 172.21.15.31:0/603879052 >> v2:172.21.15.50:3300/0 conn(0x7fe75c0b0590 0x7fe75c0b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:47.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.113+0000 7fe7616bb640 1 -- 172.21.15.31:0/603879052 >> v2:172.21.15.50:3300/0 conn(0x7fe75c0b0590 msgr2=0x7fe75c0b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:47.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.113+0000 7fe7616bb640 1 --2- 172.21.15.31:0/603879052 >> v2:172.21.15.50:3300/0 conn(0x7fe75c0b0590 0x7fe75c0b4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:47.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.113+0000 7fe7616bb640 1 -- 172.21.15.31:0/603879052 >> v1:172.21.15.31:6789/0 conn(0x7fe75c067180 legacy=0x7fe75c06b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:47.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.113+0000 7fe75b7fe640 1 -- 172.21.15.31:0/603879052 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3021423172 0 0) 0x7fe75c067560 con 0x7fe75c067180 2024-04-15T00:31:47.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.113+0000 7fe7616bb640 1 -- 172.21.15.31:0/603879052 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe75c09f250 con 0x7fe75c0af930 2024-04-15T00:31:47.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.113+0000 7fe75bfff640 1 --2- 172.21.15.31:0/603879052 >> v2:172.21.15.50:3300/0 conn(0x7fe75c0b0590 0x7fe75c0b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:31:47.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.113+0000 7fe7616bb640 1 --2- 172.21.15.31:0/603879052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe75c0af930 0x7fe75c06b910 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe754009d90 tx=0x7fe75402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd192096850ca16 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:47.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.114+0000 7fe75b7fe640 1 -- 172.21.15.31:0/603879052 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe754039070 con 0x7fe75c0af930 2024-04-15T00:31:47.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.114+0000 7fe75b7fe640 1 -- 172.21.15.31:0/603879052 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe75402cbd0 con 0x7fe75c0af930 2024-04-15T00:31:47.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.114+0000 7fe75b7fe640 1 -- 172.21.15.31:0/603879052 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe754034440 con 0x7fe75c0af930 2024-04-15T00:31:47.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.114+0000 7fe76311e640 1 -- 172.21.15.31:0/603879052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe75c0af930 msgr2=0x7fe75c06b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:47.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.114+0000 7fe76311e640 1 --2- 172.21.15.31:0/603879052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe75c0af930 0x7fe75c06b910 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe754009d90 tx=0x7fe75402be20 comp rx=0 tx=0).stop 2024-04-15T00:31:47.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.114+0000 7fe76311e640 1 -- 172.21.15.31:0/603879052 shutdown_connections 2024-04-15T00:31:47.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.114+0000 7fe76311e640 1 --2- 172.21.15.31:0/603879052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe75c0af930 0x7fe75c06b910 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:47.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.114+0000 7fe76311e640 1 --2- 172.21.15.31:0/603879052 >> v2:172.21.15.50:3300/0 conn(0x7fe75c0b0590 0x7fe75c0b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:47.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.114+0000 7fe76311e640 1 -- 172.21.15.31:0/603879052 >> 172.21.15.31:0/603879052 conn(0x7fe75c0b6640 msgr2=0x7fe75c0b6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:47.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.114+0000 7fe76311e640 1 -- 172.21.15.31:0/603879052 shutdown_connections 2024-04-15T00:31:47.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.114+0000 7fe76311e640 1 -- 172.21.15.31:0/603879052 wait complete. 2024-04-15T00:31:47.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.115+0000 7fe76311e640 1 Processor -- start 2024-04-15T00:31:47.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.115+0000 7fe76311e640 1 -- start start 2024-04-15T00:31:47.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.116+0000 7fe76311e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe75c067180 0x7fe75c1ce490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:47.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.116+0000 7fe76311e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe75c0af930 0x7fe75c1cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:47.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.116+0000 7fe76311e640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe75c0b0590 0x7fe75c1dd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:47.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.116+0000 7fe76311e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe75c0b5be0 con 0x7fe75c067180 2024-04-15T00:31:47.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.116+0000 7fe76311e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe75c0b5a60 con 0x7fe75c0af930 2024-04-15T00:31:47.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.116+0000 7fe76311e640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fe75c06be50 con 0x7fe75c0b0590 2024-04-15T00:31:47.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.116+0000 7fe760eba640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe75c067180 0x7fe75c1ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:47.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.116+0000 7fe760eba640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe75c067180 0x7fe75c1ce490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57640/0 (socket says 172.21.15.31:57640) 2024-04-15T00:31:47.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.116+0000 7fe760eba640 1 -- 172.21.15.31:0/4075249457 learned_addr learned my addr 172.21.15.31:0/4075249457 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:47.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.116+0000 7fe75bfff640 1 --2- 172.21.15.31:0/4075249457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe75c0af930 0x7fe75c1cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:47.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.116+0000 7fe7616bb640 1 --2- 172.21.15.31:0/4075249457 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe75c0b0590 0x7fe75c1dd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:47.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.116+0000 7fe760eba640 1 -- 172.21.15.31:0/4075249457 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe75c0b0590 msgr2=0x7fe75c1dd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:47.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.116+0000 7fe760eba640 1 --2- 172.21.15.31:0/4075249457 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe75c0b0590 0x7fe75c1dd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:47.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.116+0000 7fe760eba640 1 -- 172.21.15.31:0/4075249457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe75c0af930 msgr2=0x7fe75c1cf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:47.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.116+0000 7fe760eba640 1 --2- 172.21.15.31:0/4075249457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe75c0af930 0x7fe75c1cf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:47.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.116+0000 7fe760eba640 1 -- 172.21.15.31:0/4075249457 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe75c1cd990 con 0x7fe75c067180 2024-04-15T00:31:47.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.117+0000 7fe760eba640 1 --2- 172.21.15.31:0/4075249457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe75c067180 0x7fe75c1ce490 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe74c00c4d0 tx=0x7fe74c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:47.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.117+0000 7fe7597fa640 1 -- 172.21.15.31:0/4075249457 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74c018070 con 0x7fe75c067180 2024-04-15T00:31:47.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.117+0000 7fe7597fa640 1 -- 172.21.15.31:0/4075249457 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe74c007500 con 0x7fe75c067180 2024-04-15T00:31:47.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.117+0000 7fe7597fa640 1 -- 172.21.15.31:0/4075249457 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74c004a20 con 0x7fe75c067180 2024-04-15T00:31:47.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.117+0000 7fe76311e640 1 -- 172.21.15.31:0/4075249457 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe75c1cf5f0 con 0x7fe75c067180 2024-04-15T00:31:47.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.117+0000 7fe76311e640 1 -- 172.21.15.31:0/4075249457 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe75c144ac0 con 0x7fe75c067180 2024-04-15T00:31:47.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.118+0000 7fe76311e640 1 -- 172.21.15.31:0/4075249457 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe75c1478b0 con 0x7fe75c067180 2024-04-15T00:31:47.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.118+0000 7fe7597fa640 1 -- 172.21.15.31:0/4075249457 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fe74c01b070 con 0x7fe75c067180 2024-04-15T00:31:47.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.119+0000 7fe7597fa640 1 --2- 172.21.15.31:0/4075249457 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe74806b990 0x7fe74806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:47.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.119+0000 7fe7597fa640 1 -- 172.21.15.31:0/4075249457 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fe74c089e20 con 0x7fe75c067180 2024-04-15T00:31:47.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.119+0000 7fe75bfff640 1 --2- 172.21.15.31:0/4075249457 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe74806b990 0x7fe74806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:47.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.119+0000 7fe75bfff640 1 --2- 172.21.15.31:0/4075249457 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe74806b990 0x7fe74806de50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe75c1de390 tx=0x7fe750008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:47.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.123+0000 7fe7597fa640 1 -- 172.21.15.31:0/4075249457 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe74c058070 con 0x7fe75c067180 2024-04-15T00:31:47.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.305+0000 7fe76311e640 1 -- 172.21.15.31:0/4075249457 --> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fe75c09f7c0 con 0x7fe74806b990 2024-04-15T00:31:47.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.306+0000 7fe7597fa640 1 -- 172.21.15.31:0/4075249457 <== mgr.4107 v2:172.21.15.31:6832/915470279 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe75c09f7c0 con 0x7fe74806b990 2024-04-15T00:31:47.314 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 6 to deep-scrub 2024-04-15T00:31:47.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.307+0000 7fe76311e640 1 -- 172.21.15.31:0/4075249457 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe74806b990 msgr2=0x7fe74806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:47.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.307+0000 7fe76311e640 1 --2- 172.21.15.31:0/4075249457 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe74806b990 0x7fe74806de50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe75c1de390 tx=0x7fe750008040 comp rx=0 tx=0).stop 2024-04-15T00:31:47.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.307+0000 7fe76311e640 1 -- 172.21.15.31:0/4075249457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe75c067180 msgr2=0x7fe75c1ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:47.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.307+0000 7fe76311e640 1 --2- 172.21.15.31:0/4075249457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe75c067180 0x7fe75c1ce490 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe74c00c4d0 tx=0x7fe74c00c990 comp rx=0 tx=0).stop 2024-04-15T00:31:47.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.307+0000 7fe76311e640 1 -- 172.21.15.31:0/4075249457 shutdown_connections 2024-04-15T00:31:47.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.307+0000 7fe76311e640 1 --2- 172.21.15.31:0/4075249457 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe74806b990 0x7fe74806de50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:47.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.307+0000 7fe76311e640 1 --2- 172.21.15.31:0/4075249457 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe75c0b0590 0x7fe75c1dd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:47.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.308+0000 7fe76311e640 1 --2- 172.21.15.31:0/4075249457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe75c0af930 0x7fe75c1cf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:47.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.308+0000 7fe76311e640 1 --2- 172.21.15.31:0/4075249457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe75c067180 0x7fe75c1ce490 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:47.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.308+0000 7fe76311e640 1 -- 172.21.15.31:0/4075249457 >> 172.21.15.31:0/4075249457 conn(0x7fe75c0b6640 msgr2=0x7fe75c0b6a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:47.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.308+0000 7fe76311e640 1 -- 172.21.15.31:0/4075249457 shutdown_connections 2024-04-15T00:31:47.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.308+0000 7fe76311e640 1 -- 172.21.15.31:0/4075249457 wait complete. 2024-04-15T00:31:47.327 INFO:tasks.ceph:Scrubbing osd.7 2024-04-15T00:31:47.327 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-15T00:31:47.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.425+0000 7fb1dc4d5640 1 Processor -- start 2024-04-15T00:31:47.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.425+0000 7fb1dc4d5640 1 -- start start 2024-04-15T00:31:47.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.426+0000 7fb1dc4d5640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1d4072820 0x7fb1d40b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:47.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.426+0000 7fb1dc4d5640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1d4072c00 con 0x7fb1d40b77e0 2024-04-15T00:31:47.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.426+0000 7fb1dc4d5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1d409c400 con 0x7fb1d40b8a80 2024-04-15T00:31:47.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.426+0000 7fb1dc4d5640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fb1d40b8560 con 0x7fb1d4072820 2024-04-15T00:31:47.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.426+0000 7fb1d9a70640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb1d40b77e0 0x7fb1d4141690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56270/0 (socket says 172.21.15.31:56270) 2024-04-15T00:31:47.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.426+0000 7fb1d9a70640 1 -- 172.21.15.31:0/3302298197 learned_addr learned my addr 172.21.15.31:0/3302298197 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:31:47.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.426+0000 7fb1da271640 1 --2- 172.21.15.31:0/3302298197 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1d4072820 0x7fb1d40b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:47.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.426+0000 7fb1d926f640 1 -- 172.21.15.31:0/3302298197 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 103837955 0 0) 0x7fb1d4072c00 con 0x7fb1d40b77e0 2024-04-15T00:31:47.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.426+0000 7fb1d926f640 1 -- 172.21.15.31:0/3302298197 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1bc003520 con 0x7fb1d40b77e0 2024-04-15T00:31:47.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.427+0000 7fb1d926f640 1 -- 172.21.15.31:0/3302298197 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1152960943 0 0) 0x7fb1bc003520 con 0x7fb1d40b77e0 2024-04-15T00:31:47.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.427+0000 7fb1d926f640 1 -- 172.21.15.31:0/3302298197 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1d4072820 msgr2=0x7fb1d40b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:47.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.427+0000 7fb1d926f640 1 --2- 172.21.15.31:0/3302298197 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1d4072820 0x7fb1d40b2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:47.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.427+0000 7fb1d926f640 1 -- 172.21.15.31:0/3302298197 >> v1:172.21.15.50:6789/0 conn(0x7fb1d40b8a80 legacy=0x7fb1d4152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:47.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.427+0000 7fb1d926f640 1 -- 172.21.15.31:0/3302298197 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d40b3b70 con 0x7fb1d40b77e0 2024-04-15T00:31:47.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.427+0000 7fb1d926f640 1 -- 172.21.15.31:0/3302298197 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 697057150 0 0) 0x7fb1c8001670 con 0x7fb1d40b77e0 2024-04-15T00:31:47.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.427+0000 7fb1d926f640 1 -- 172.21.15.31:0/3302298197 >> v1:172.21.15.31:6789/0 conn(0x7fb1d40b77e0 legacy=0x7fb1d4141690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:47.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.427+0000 7fb1d926f640 1 --2- 172.21.15.31:0/3302298197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1bc0039e0 0x7fb1bc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:47.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.427+0000 7fb1d926f640 1 --2- 172.21.15.31:0/3302298197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1bc004800 0x7fb1bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:47.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.427+0000 7fb1d926f640 1 --2- 172.21.15.31:0/3302298197 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1d4072820 0x7fb1bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:47.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.427+0000 7fb1d926f640 1 -- 172.21.15.31:0/3302298197 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d40b8560 con 0x7fb1bc004800 2024-04-15T00:31:47.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.427+0000 7fb1d926f640 1 -- 172.21.15.31:0/3302298197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb1bc00ba70 con 0x7fb1bc0039e0 2024-04-15T00:31:47.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.427+0000 7fb1d926f640 1 -- 172.21.15.31:0/3302298197 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fb1bc00bc70 con 0x7fb1d4072820 2024-04-15T00:31:47.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.427+0000 7fb1d9a70640 1 --2- 172.21.15.31:0/3302298197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1bc004800 0x7fb1bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:47.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.427+0000 7fb1da271640 1 --2- 172.21.15.31:0/3302298197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1bc0039e0 0x7fb1bc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:47.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.427+0000 7fb1daa72640 1 --2- 172.21.15.31:0/3302298197 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1d4072820 0x7fb1bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:47.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.427+0000 7fb1d9a70640 1 -- 172.21.15.31:0/3302298197 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1d4072820 msgr2=0x7fb1bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:47.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.427+0000 7fb1d9a70640 1 --2- 172.21.15.31:0/3302298197 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1d4072820 0x7fb1bc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:47.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.427+0000 7fb1d9a70640 1 -- 172.21.15.31:0/3302298197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1bc0039e0 msgr2=0x7fb1bc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:47.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.427+0000 7fb1d9a70640 1 --2- 172.21.15.31:0/3302298197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1bc0039e0 0x7fb1bc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:47.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.427+0000 7fb1d9a70640 1 -- 172.21.15.31:0/3302298197 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1bc003520 con 0x7fb1bc004800 2024-04-15T00:31:47.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.428+0000 7fb1d9a70640 1 --2- 172.21.15.31:0/3302298197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1bc004800 0x7fb1bc004c80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8001eb0 tx=0x7fb1bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1729683b624eed1c server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:47.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.428+0000 7fb1d926f640 1 -- 172.21.15.31:0/3302298197 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c8007d30 con 0x7fb1bc004800 2024-04-15T00:31:47.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.428+0000 7fb1d926f640 1 -- 172.21.15.31:0/3302298197 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1c8030070 con 0x7fb1bc004800 2024-04-15T00:31:47.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.428+0000 7fb1d926f640 1 -- 172.21.15.31:0/3302298197 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c8005d30 con 0x7fb1bc004800 2024-04-15T00:31:47.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.428+0000 7fb1dc4d5640 1 -- 172.21.15.31:0/3302298197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1bc004800 msgr2=0x7fb1bc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:47.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.428+0000 7fb1dc4d5640 1 --2- 172.21.15.31:0/3302298197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1bc004800 0x7fb1bc004c80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8001eb0 tx=0x7fb1bc005830 comp rx=0 tx=0).stop 2024-04-15T00:31:47.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.429+0000 7fb1daa72640 1 -- 172.21.15.31:0/3302298197 reap_dead start 2024-04-15T00:31:47.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.429+0000 7fb1dc4d5640 1 -- 172.21.15.31:0/3302298197 shutdown_connections 2024-04-15T00:31:47.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.429+0000 7fb1dc4d5640 1 -- 172.21.15.31:0/3302298197 >> 172.21.15.31:0/3302298197 conn(0x7fb1d40bce60 msgr2=0x7fb1d40bd270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:47.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.429+0000 7fb1dc4d5640 1 -- 172.21.15.31:0/3302298197 shutdown_connections 2024-04-15T00:31:47.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.429+0000 7fb1dc4d5640 1 -- 172.21.15.31:0/3302298197 wait complete. 2024-04-15T00:31:47.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.430+0000 7fb1dc4d5640 1 Processor -- start 2024-04-15T00:31:47.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.430+0000 7fb1dc4d5640 1 -- start start 2024-04-15T00:31:47.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.430+0000 7fb1dc4d5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1bc004800 0x7fb1d40a09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:47.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.430+0000 7fb1dc4d5640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1d41dd6a0 0x7fb1d41ddb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:47.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.430+0000 7fb1dc4d5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1d413afe0 0x7fb1d413b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:47.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.430+0000 7fb1dc4d5640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d409c010 con 0x7fb1d413afe0 2024-04-15T00:31:47.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.430+0000 7fb1dc4d5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d409be90 con 0x7fb1bc004800 2024-04-15T00:31:47.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.430+0000 7fb1dc4d5640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fb1d409c190 con 0x7fb1d41dd6a0 2024-04-15T00:31:47.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.430+0000 7fb1daa72640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1d413afe0 0x7fb1d413b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:47.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.430+0000 7fb1daa72640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1d413afe0 0x7fb1d413b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57658/0 (socket says 172.21.15.31:57658) 2024-04-15T00:31:47.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.430+0000 7fb1daa72640 1 -- 172.21.15.31:0/3578647827 learned_addr learned my addr 172.21.15.31:0/3578647827 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:47.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.430+0000 7fb1d9a70640 1 --2- 172.21.15.31:0/3578647827 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1d41dd6a0 0x7fb1d41ddb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:47.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.430+0000 7fb1da271640 1 --2- 172.21.15.31:0/3578647827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1bc004800 0x7fb1d40a09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:47.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.431+0000 7fb1daa72640 1 -- 172.21.15.31:0/3578647827 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1d41dd6a0 msgr2=0x7fb1d41ddb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:47.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.431+0000 7fb1daa72640 1 --2- 172.21.15.31:0/3578647827 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb1d41dd6a0 0x7fb1d41ddb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:47.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.431+0000 7fb1daa72640 1 -- 172.21.15.31:0/3578647827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1bc004800 msgr2=0x7fb1d40a09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:47.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.431+0000 7fb1daa72640 1 --2- 172.21.15.31:0/3578647827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1bc004800 0x7fb1d40a09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:47.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.431+0000 7fb1daa72640 1 -- 172.21.15.31:0/3578647827 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d41de060 con 0x7fb1d413afe0 2024-04-15T00:31:47.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.431+0000 7fb1daa72640 1 --2- 172.21.15.31:0/3578647827 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1d413afe0 0x7fb1d413b460 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4145390 tx=0x7fb1c400fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:47.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.431+0000 7fb1d2ffd640 1 -- 172.21.15.31:0/3578647827 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c401a070 con 0x7fb1d413afe0 2024-04-15T00:31:47.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.431+0000 7fb1d2ffd640 1 -- 172.21.15.31:0/3578647827 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1c4006d60 con 0x7fb1d413afe0 2024-04-15T00:31:47.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.431+0000 7fb1dc4d5640 1 -- 172.21.15.31:0/3578647827 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1d409e9d0 con 0x7fb1d413afe0 2024-04-15T00:31:47.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.431+0000 7fb1d2ffd640 1 -- 172.21.15.31:0/3578647827 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4003b90 con 0x7fb1d413afe0 2024-04-15T00:31:47.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.431+0000 7fb1dc4d5640 1 -- 172.21.15.31:0/3578647827 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1d40a1590 con 0x7fb1d413afe0 2024-04-15T00:31:47.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.432+0000 7fb1dc4d5640 1 -- 172.21.15.31:0/3578647827 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb1d409f870 con 0x7fb1d413afe0 2024-04-15T00:31:47.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.432+0000 7fb1d2ffd640 1 -- 172.21.15.31:0/3578647827 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fb1c4005110 con 0x7fb1d413afe0 2024-04-15T00:31:47.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.433+0000 7fb1d2ffd640 1 --2- 172.21.15.31:0/3578647827 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb1c006b9c0 0x7fb1c006de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:47.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.433+0000 7fb1d2ffd640 1 -- 172.21.15.31:0/3578647827 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fb1c408a350 con 0x7fb1d413afe0 2024-04-15T00:31:47.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.433+0000 7fb1da271640 1 --2- 172.21.15.31:0/3578647827 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb1c006b9c0 0x7fb1c006de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:47.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.433+0000 7fb1d2ffd640 1 --2- 172.21.15.31:0/3578647827 >> [v2:172.21.15.50:6824/4129060906,v1:172.21.15.50:6825/4129060906] conn(0x7fb1c00753d0 0x7fb1c0077870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:47.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.433+0000 7fb1d2ffd640 1 -- 172.21.15.31:0/3578647827 --> [v2:172.21.15.50:6824/4129060906,v1:172.21.15.50:6825/4129060906] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb1c4019ec0 con 0x7fb1c00753d0 2024-04-15T00:31:47.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.433+0000 7fb1d2ffd640 1 -- 172.21.15.31:0/3578647827 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb1c408a7e0 con 0x7fb1d413afe0 2024-04-15T00:31:47.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.433+0000 7fb1d9a70640 1 --2- 172.21.15.31:0/3578647827 >> [v2:172.21.15.50:6824/4129060906,v1:172.21.15.50:6825/4129060906] conn(0x7fb1c00753d0 0x7fb1c0077870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:47.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.433+0000 7fb1da271640 1 --2- 172.21.15.31:0/3578647827 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb1c006b9c0 0x7fb1c006de80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb1d41daf80 tx=0x7fb1cc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:47.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.434+0000 7fb1d9a70640 1 --2- 172.21.15.31:0/3578647827 >> [v2:172.21.15.50:6824/4129060906,v1:172.21.15.50:6825/4129060906] conn(0x7fb1c00753d0 0x7fb1c0077870 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:47.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.434+0000 7fb1d2ffd640 1 -- 172.21.15.31:0/3578647827 <== osd.7 v2:172.21.15.50:6824/4129060906 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb1c4019ec0 con 0x7fb1c00753d0 2024-04-15T00:31:47.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.449+0000 7fb1dc4d5640 1 -- 172.21.15.31:0/3578647827 --> [v2:172.21.15.50:6824/4129060906,v1:172.21.15.50:6825/4129060906] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb1d40b7190 con 0x7fb1c00753d0 2024-04-15T00:31:47.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.450+0000 7fb1d2ffd640 1 -- 172.21.15.31:0/3578647827 <== osd.7 v2:172.21.15.50:6824/4129060906 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb1d40b7190 con 0x7fb1c00753d0 2024-04-15T00:31:47.677 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-15T00:31:47.677 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T00:31:47.678 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-15T00:31:47.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.450+0000 7fb1dc4d5640 1 -- 172.21.15.31:0/3578647827 >> [v2:172.21.15.50:6824/4129060906,v1:172.21.15.50:6825/4129060906] conn(0x7fb1c00753d0 msgr2=0x7fb1c0077870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:47.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.450+0000 7fb1dc4d5640 1 --2- 172.21.15.31:0/3578647827 >> [v2:172.21.15.50:6824/4129060906,v1:172.21.15.50:6825/4129060906] conn(0x7fb1c00753d0 0x7fb1c0077870 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:47.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.450+0000 7fb1dc4d5640 1 -- 172.21.15.31:0/3578647827 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb1c006b9c0 msgr2=0x7fb1c006de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:47.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.450+0000 7fb1dc4d5640 1 --2- 172.21.15.31:0/3578647827 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb1c006b9c0 0x7fb1c006de80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb1d41daf80 tx=0x7fb1cc009190 comp rx=0 tx=0).stop 2024-04-15T00:31:47.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.450+0000 7fb1dc4d5640 1 -- 172.21.15.31:0/3578647827 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1d413afe0 msgr2=0x7fb1d413b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:47.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.450+0000 7fb1dc4d5640 1 --2- 172.21.15.31:0/3578647827 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1d413afe0 0x7fb1d413b460 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4145390 tx=0x7fb1c400fc80 comp rx=0 tx=0).stop 2024-04-15T00:31:47.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.450+0000 7fb1daa72640 1 -- 172.21.15.31:0/3578647827 reap_dead start 2024-04-15T00:31:47.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.450+0000 7fb1dc4d5640 1 -- 172.21.15.31:0/3578647827 shutdown_connections 2024-04-15T00:31:47.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.450+0000 7fb1dc4d5640 1 -- 172.21.15.31:0/3578647827 >> 172.21.15.31:0/3578647827 conn(0x7fb1d40bce60 msgr2=0x7fb1d40b9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:47.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.450+0000 7fb1dc4d5640 1 -- 172.21.15.31:0/3578647827 shutdown_connections 2024-04-15T00:31:47.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.450+0000 7fb1dc4d5640 1 -- 172.21.15.31:0/3578647827 wait complete. 2024-04-15T00:31:47.683 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-15T00:31:47.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.782+0000 7fdefd295640 1 Processor -- start 2024-04-15T00:31:47.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.782+0000 7fdefd295640 1 -- start start 2024-04-15T00:31:47.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.782+0000 7fdefd295640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdef8072690 0x7fdef814ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:47.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.782+0000 7fdefd295640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdef806fde0 0x7fdef814b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:47.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.782+0000 7fdefd295640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdef8072a70 con 0x7fdef81414a0 2024-04-15T00:31:47.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.782+0000 7fdefd295640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fdef8142000 con 0x7fdef8072690 2024-04-15T00:31:47.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.782+0000 7fdefd295640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fdef806efa0 con 0x7fdef806fde0 2024-04-15T00:31:47.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.782+0000 7fdef6ffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdef8072690 0x7fdef814ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:47.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.782+0000 7fdef77fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fdef81414a0 0x7fdef81418f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56272/0 (socket says 172.21.15.31:56272) 2024-04-15T00:31:47.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.782+0000 7fdef77fe640 1 -- 172.21.15.31:0/716073528 learned_addr learned my addr 172.21.15.31:0/716073528 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:31:47.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.782+0000 7fdef6ffd640 1 --2- 172.21.15.31:0/716073528 >> v2:172.21.15.31:3300/0 conn(0x7fdef8072690 0x7fdef814ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57668/0 (socket says 172.21.15.31:57668) 2024-04-15T00:31:47.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.783+0000 7fdeeffff640 1 --2- 172.21.15.31:0/716073528 >> v2:172.21.15.50:3300/0 conn(0x7fdef806fde0 0x7fdef814b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:47.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.783+0000 7fdef6ffd640 1 -- 172.21.15.31:0/716073528 >> v2:172.21.15.50:3300/0 conn(0x7fdef806fde0 msgr2=0x7fdef814b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:47.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.783+0000 7fdef6ffd640 1 --2- 172.21.15.31:0/716073528 >> v2:172.21.15.50:3300/0 conn(0x7fdef806fde0 0x7fdef814b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:47.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.783+0000 7fdef6ffd640 1 -- 172.21.15.31:0/716073528 >> v1:172.21.15.31:6789/0 conn(0x7fdef81414a0 legacy=0x7fdef81418f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:47.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.783+0000 7fdef6ffd640 1 -- 172.21.15.31:0/716073528 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef806f1d0 con 0x7fdef8072690 2024-04-15T00:31:47.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.783+0000 7fdef67fc640 1 -- 172.21.15.31:0/716073528 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1570573649 0 0) 0x7fdef8072a70 con 0x7fdef81414a0 2024-04-15T00:31:47.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.783+0000 7fdef6ffd640 1 --2- 172.21.15.31:0/716073528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdef8072690 0x7fdef814ae60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdef814be40 tx=0x7fdee802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21854a1ce59cea4 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:47.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.784+0000 7fdef67fc640 1 -- 172.21.15.31:0/716073528 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee8035020 con 0x7fdef8072690 2024-04-15T00:31:47.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.784+0000 7fdef67fc640 1 -- 172.21.15.31:0/716073528 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdee8031830 con 0x7fdef8072690 2024-04-15T00:31:47.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.784+0000 7fdef67fc640 1 -- 172.21.15.31:0/716073528 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee8031c00 con 0x7fdef8072690 2024-04-15T00:31:47.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.784+0000 7fdefd295640 1 -- 172.21.15.31:0/716073528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdef8072690 msgr2=0x7fdef814ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:47.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.784+0000 7fdefd295640 1 --2- 172.21.15.31:0/716073528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdef8072690 0x7fdef814ae60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdef814be40 tx=0x7fdee802b8d0 comp rx=0 tx=0).stop 2024-04-15T00:31:47.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.784+0000 7fdefd295640 1 -- 172.21.15.31:0/716073528 shutdown_connections 2024-04-15T00:31:47.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.784+0000 7fdefd295640 1 --2- 172.21.15.31:0/716073528 >> v2:172.21.15.50:3300/0 conn(0x7fdef806fde0 0x7fdef814b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:47.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.784+0000 7fdefd295640 1 --2- 172.21.15.31:0/716073528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdef8072690 0x7fdef814ae60 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:47.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.784+0000 7fdefd295640 1 -- 172.21.15.31:0/716073528 >> 172.21.15.31:0/716073528 conn(0x7fdef80b7840 msgr2=0x7fdef80b7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:47.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.784+0000 7fdefd295640 1 -- 172.21.15.31:0/716073528 shutdown_connections 2024-04-15T00:31:47.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.784+0000 7fdefd295640 1 -- 172.21.15.31:0/716073528 wait complete. 2024-04-15T00:31:47.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.785+0000 7fdefd295640 1 Processor -- start 2024-04-15T00:31:47.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.785+0000 7fdefd295640 1 -- start start 2024-04-15T00:31:47.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.786+0000 7fdefd295640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdef806fde0 0x7fdef81e0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:47.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.786+0000 7fdefd295640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdef8072690 0x7fdef813bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:47.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.786+0000 7fdefd295640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdef81414a0 0x7fdef81441d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:47.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.786+0000 7fdefd295640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdef80b5740 con 0x7fdef8072690 2024-04-15T00:31:47.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.786+0000 7fdefd295640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdef806f820 con 0x7fdef81414a0 2024-04-15T00:31:47.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.786+0000 7fdefd295640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fdef80b58c0 con 0x7fdef806fde0 2024-04-15T00:31:47.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.786+0000 7fdeeffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdef8072690 0x7fdef813bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:47.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.786+0000 7fdeeffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdef8072690 0x7fdef813bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57670/0 (socket says 172.21.15.31:57670) 2024-04-15T00:31:47.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.786+0000 7fdeeffff640 1 -- 172.21.15.31:0/2804919052 learned_addr learned my addr 172.21.15.31:0/2804919052 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:47.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.786+0000 7fdef77fe640 1 --2- 172.21.15.31:0/2804919052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdef81414a0 0x7fdef81441d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:47.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.786+0000 7fdef6ffd640 1 --2- 172.21.15.31:0/2804919052 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdef806fde0 0x7fdef81e0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:47.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.786+0000 7fdeeffff640 1 -- 172.21.15.31:0/2804919052 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdef806fde0 msgr2=0x7fdef81e0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:47.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.786+0000 7fdeeffff640 1 --2- 172.21.15.31:0/2804919052 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdef806fde0 0x7fdef81e0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:47.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.786+0000 7fdeeffff640 1 -- 172.21.15.31:0/2804919052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdef81414a0 msgr2=0x7fdef81441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:47.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.786+0000 7fdeeffff640 1 --2- 172.21.15.31:0/2804919052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdef81414a0 0x7fdef81441d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:47.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.786+0000 7fdeeffff640 1 -- 172.21.15.31:0/2804919052 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef8143d20 con 0x7fdef8072690 2024-04-15T00:31:47.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.786+0000 7fdef77fe640 1 --2- 172.21.15.31:0/2804919052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdef81414a0 0x7fdef81441d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:31:47.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.786+0000 7fdeeffff640 1 --2- 172.21.15.31:0/2804919052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdef8072690 0x7fdef813bfc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdee000e9e0 tx=0x7fdee000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:47.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.787+0000 7fdeef7fe640 1 -- 172.21.15.31:0/2804919052 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee0017070 con 0x7fdef8072690 2024-04-15T00:31:47.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.787+0000 7fdeef7fe640 1 -- 172.21.15.31:0/2804919052 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdee000c9d0 con 0x7fdef8072690 2024-04-15T00:31:47.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.787+0000 7fdefd295640 1 -- 172.21.15.31:0/2804919052 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdef81d0e40 con 0x7fdef8072690 2024-04-15T00:31:47.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.787+0000 7fdeef7fe640 1 -- 172.21.15.31:0/2804919052 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee000cdc0 con 0x7fdef8072690 2024-04-15T00:31:47.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.787+0000 7fdefd295640 1 -- 172.21.15.31:0/2804919052 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdef813c8c0 con 0x7fdef8072690 2024-04-15T00:31:47.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.788+0000 7fdefd295640 1 -- 172.21.15.31:0/2804919052 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdef804f620 con 0x7fdef8072690 2024-04-15T00:31:47.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.788+0000 7fdeef7fe640 1 -- 172.21.15.31:0/2804919052 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fdee001a070 con 0x7fdef8072690 2024-04-15T00:31:47.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.788+0000 7fdeef7fe640 1 --2- 172.21.15.31:0/2804919052 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fded806b990 0x7fded806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:47.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.789+0000 7fdeef7fe640 1 -- 172.21.15.31:0/2804919052 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fdee008ac40 con 0x7fdef8072690 2024-04-15T00:31:47.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.789+0000 7fdef6ffd640 1 --2- 172.21.15.31:0/2804919052 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fded806b990 0x7fded806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:47.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.789+0000 7fdef6ffd640 1 --2- 172.21.15.31:0/2804919052 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fded806b990 0x7fded806de50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdee8036000 tx=0x7fdee8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:47.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.794+0000 7fdeef7fe640 1 -- 172.21.15.31:0/2804919052 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fdee00594e0 con 0x7fdef8072690 2024-04-15T00:31:47.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.975+0000 7fdefd295640 1 -- 172.21.15.31:0/2804919052 --> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fdef806db00 con 0x7fded806b990 2024-04-15T00:31:47.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.975+0000 7fdeef7fe640 1 -- 172.21.15.31:0/2804919052 <== mgr.4107 v2:172.21.15.31:6832/915470279 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdef806db00 con 0x7fded806b990 2024-04-15T00:31:47.983 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 7 to deep-scrub 2024-04-15T00:31:47.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.977+0000 7fdefd295640 1 -- 172.21.15.31:0/2804919052 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fded806b990 msgr2=0x7fded806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:47.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.977+0000 7fdefd295640 1 --2- 172.21.15.31:0/2804919052 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fded806b990 0x7fded806de50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdee8036000 tx=0x7fdee8008030 comp rx=0 tx=0).stop 2024-04-15T00:31:47.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.977+0000 7fdefd295640 1 -- 172.21.15.31:0/2804919052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdef8072690 msgr2=0x7fdef813bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:47.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.977+0000 7fdefd295640 1 --2- 172.21.15.31:0/2804919052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdef8072690 0x7fdef813bfc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdee000e9e0 tx=0x7fdee000eea0 comp rx=0 tx=0).stop 2024-04-15T00:31:47.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.977+0000 7fdefd295640 1 -- 172.21.15.31:0/2804919052 shutdown_connections 2024-04-15T00:31:47.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.977+0000 7fdefd295640 1 --2- 172.21.15.31:0/2804919052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdef81414a0 0x7fdef81441d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:47.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.977+0000 7fdefd295640 1 --2- 172.21.15.31:0/2804919052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdef8072690 0x7fdef813bfc0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:47.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.977+0000 7fdefd295640 1 --2- 172.21.15.31:0/2804919052 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fded806b990 0x7fded806de50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:47.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.977+0000 7fdefd295640 1 --2- 172.21.15.31:0/2804919052 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fdef806fde0 0x7fdef81e0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:47.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.977+0000 7fdefd295640 1 -- 172.21.15.31:0/2804919052 >> 172.21.15.31:0/2804919052 conn(0x7fdef80b7840 msgr2=0x7fdef813e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:47.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.977+0000 7fdefd295640 1 -- 172.21.15.31:0/2804919052 shutdown_connections 2024-04-15T00:31:47.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:47.977+0000 7fdefd295640 1 -- 172.21.15.31:0/2804919052 wait complete. 2024-04-15T00:31:47.998 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T00:31:48.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.093+0000 7fb46e1c8640 1 Processor -- start 2024-04-15T00:31:48.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.093+0000 7fb46e1c8640 1 -- start start 2024-04-15T00:31:48.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.093+0000 7fb46e1c8640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb468074680 0x7fb46813f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:48.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.093+0000 7fb46e1c8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb4681488c0 0x7fb468148d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:48.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.093+0000 7fb46e1c8640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb468074a60 con 0x7fb4680b4290 2024-04-15T00:31:48.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.093+0000 7fb46e1c8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fb46806fe10 con 0x7fb4681488c0 2024-04-15T00:31:48.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.093+0000 7fb46e1c8640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fb468149440 con 0x7fb468074680 2024-04-15T00:31:48.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.093+0000 7fb466ffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb4681488c0 0x7fb468148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:48.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.093+0000 7fb467fff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb4680b4290 0x7fb4680b4720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56282/0 (socket says 172.21.15.31:56282) 2024-04-15T00:31:48.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.093+0000 7fb467fff640 1 -- 172.21.15.31:0/2617454512 learned_addr learned my addr 172.21.15.31:0/2617454512 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:31:48.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.094+0000 7fb4677fe640 1 --2- 172.21.15.31:0/2617454512 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb468074680 0x7fb46813f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:48.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.094+0000 7fb466ffd640 1 -- 172.21.15.31:0/2617454512 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb468074680 msgr2=0x7fb46813f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:31:48.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.094+0000 7fb466ffd640 1 --2- 172.21.15.31:0/2617454512 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb468074680 0x7fb46813f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:48.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.094+0000 7fb466ffd640 1 -- 172.21.15.31:0/2617454512 >> v1:172.21.15.31:6789/0 conn(0x7fb4680b4290 legacy=0x7fb4680b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:48.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.094+0000 7fb466ffd640 1 -- 172.21.15.31:0/2617454512 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb468149720 con 0x7fb4681488c0 2024-04-15T00:31:48.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.094+0000 7fb4667fc640 1 -- 172.21.15.31:0/2617454512 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 821580039 0 0) 0x7fb468074a60 con 0x7fb4680b4290 2024-04-15T00:31:48.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.094+0000 7fb4677fe640 1 --2- 172.21.15.31:0/2617454512 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb468074680 0x7fb46813f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:31:48.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.094+0000 7fb466ffd640 1 --2- 172.21.15.31:0/2617454512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4681488c0 0x7fb468148d20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb45c0097a0 tx=0x7fb45c02b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d3600e6b412e7cd server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:48.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.095+0000 7fb4667fc640 1 -- 172.21.15.31:0/2617454512 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb45c031780 con 0x7fb4681488c0 2024-04-15T00:31:48.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.095+0000 7fb4667fc640 1 -- 172.21.15.31:0/2617454512 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb45c037070 con 0x7fb4681488c0 2024-04-15T00:31:48.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.095+0000 7fb4667fc640 1 -- 172.21.15.31:0/2617454512 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb45c031b40 con 0x7fb4681488c0 2024-04-15T00:31:48.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.095+0000 7fb46e1c8640 1 -- 172.21.15.31:0/2617454512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4681488c0 msgr2=0x7fb468148d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:48.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.095+0000 7fb46e1c8640 1 --2- 172.21.15.31:0/2617454512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4681488c0 0x7fb468148d20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb45c0097a0 tx=0x7fb45c02b820 comp rx=0 tx=0).stop 2024-04-15T00:31:48.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.095+0000 7fb46e1c8640 1 -- 172.21.15.31:0/2617454512 shutdown_connections 2024-04-15T00:31:48.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.095+0000 7fb46e1c8640 1 --2- 172.21.15.31:0/2617454512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4681488c0 0x7fb468148d20 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:48.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.095+0000 7fb46e1c8640 1 --2- 172.21.15.31:0/2617454512 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb468074680 0x7fb46813f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:48.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.095+0000 7fb46e1c8640 1 -- 172.21.15.31:0/2617454512 >> 172.21.15.31:0/2617454512 conn(0x7fb4680b92d0 msgr2=0x7fb4680b96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:48.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.095+0000 7fb46e1c8640 1 -- 172.21.15.31:0/2617454512 shutdown_connections 2024-04-15T00:31:48.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.095+0000 7fb46e1c8640 1 -- 172.21.15.31:0/2617454512 wait complete. 2024-04-15T00:31:48.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.096+0000 7fb46e1c8640 1 Processor -- start 2024-04-15T00:31:48.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.096+0000 7fb46e1c8640 1 -- start start 2024-04-15T00:31:48.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.097+0000 7fb46e1c8640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb468074680 0x7fb468070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:48.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.097+0000 7fb46e1c8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4680b4290 0x7fb468072c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:48.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.097+0000 7fb46e1c8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4681488c0 0x7fb4681dd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:48.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.097+0000 7fb46e1c8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb46813fae0 con 0x7fb4680b4290 2024-04-15T00:31:48.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.097+0000 7fb46e1c8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb46813f960 con 0x7fb4681488c0 2024-04-15T00:31:48.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.097+0000 7fb46e1c8640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fb46814fc50 con 0x7fb468074680 2024-04-15T00:31:48.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.097+0000 7fb466ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4680b4290 0x7fb468072c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:48.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.097+0000 7fb466ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4680b4290 0x7fb468072c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57702/0 (socket says 172.21.15.31:57702) 2024-04-15T00:31:48.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.097+0000 7fb466ffd640 1 -- 172.21.15.31:0/2822975151 learned_addr learned my addr 172.21.15.31:0/2822975151 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:31:48.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.097+0000 7fb4677fe640 1 --2- 172.21.15.31:0/2822975151 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb468074680 0x7fb468070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:48.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.097+0000 7fb467fff640 1 --2- 172.21.15.31:0/2822975151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4681488c0 0x7fb4681dd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:48.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.097+0000 7fb466ffd640 1 -- 172.21.15.31:0/2822975151 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb468074680 msgr2=0x7fb468070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:48.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.097+0000 7fb466ffd640 1 --2- 172.21.15.31:0/2822975151 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb468074680 0x7fb468070ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:48.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.097+0000 7fb466ffd640 1 -- 172.21.15.31:0/2822975151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4681488c0 msgr2=0x7fb4681dd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:48.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.097+0000 7fb466ffd640 1 --2- 172.21.15.31:0/2822975151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4681488c0 0x7fb4681dd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:48.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.097+0000 7fb466ffd640 1 -- 172.21.15.31:0/2822975151 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb468072220 con 0x7fb4680b4290 2024-04-15T00:31:48.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.097+0000 7fb4677fe640 1 --2- 172.21.15.31:0/2822975151 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb468074680 0x7fb468070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:31:48.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.097+0000 7fb467fff640 1 --2- 172.21.15.31:0/2822975151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4681488c0 0x7fb4681dd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:31:48.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.098+0000 7fb466ffd640 1 --2- 172.21.15.31:0/2822975151 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4680b4290 0x7fb468072c60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb45c0097a0 tx=0x7fb45c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:48.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.098+0000 7fb44ffff640 1 -- 172.21.15.31:0/2822975151 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb45c004230 con 0x7fb4680b4290 2024-04-15T00:31:48.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.098+0000 7fb44ffff640 1 -- 172.21.15.31:0/2822975151 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb45c0043f0 con 0x7fb4680b4290 2024-04-15T00:31:48.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.098+0000 7fb46e1c8640 1 -- 172.21.15.31:0/2822975151 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4680aff40 con 0x7fb4680b4290 2024-04-15T00:31:48.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.098+0000 7fb44ffff640 1 -- 172.21.15.31:0/2822975151 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb45c032860 con 0x7fb4680b4290 2024-04-15T00:31:48.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.098+0000 7fb46e1c8640 1 -- 172.21.15.31:0/2822975151 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb468071f40 con 0x7fb4680b4290 2024-04-15T00:31:48.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.099+0000 7fb46e1c8640 1 -- 172.21.15.31:0/2822975151 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb46809bef0 con 0x7fb4680b4290 2024-04-15T00:31:48.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.099+0000 7fb44ffff640 1 -- 172.21.15.31:0/2822975151 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fb45c032a00 con 0x7fb4680b4290 2024-04-15T00:31:48.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.099+0000 7fb44ffff640 1 --2- 172.21.15.31:0/2822975151 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb45406b9c0 0x7fb45406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:31:48.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.099+0000 7fb44ffff640 1 -- 172.21.15.31:0/2822975151 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fb45c0acc50 con 0x7fb4680b4290 2024-04-15T00:31:48.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.100+0000 7fb4677fe640 1 --2- 172.21.15.31:0/2822975151 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb45406b9c0 0x7fb45406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:31:48.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.100+0000 7fb4677fe640 1 --2- 172.21.15.31:0/2822975151 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb45406b9c0 0x7fb45406de80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb46806d6a0 tx=0x7fb458008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:31:48.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.105+0000 7fb44ffff640 1 -- 172.21.15.31:0/2822975151 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb46809bef0 con 0x7fb4680b4290 2024-04-15T00:31:48.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.283+0000 7fb46e1c8640 1 -- 172.21.15.31:0/2822975151 --> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb4681dcf30 con 0x7fb45406b9c0 2024-04-15T00:31:48.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.290+0000 7fb44ffff640 1 -- 172.21.15.31:0/2822975151 <== mgr.4107 v2:172.21.15.31:6832/915470279 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334056 (secure 0 0 0) 0x7fb4681dcf30 con 0x7fb45406b9c0 2024-04-15T00:31:48.306 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:31:48.316 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-15T00:31:48.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.294+0000 7fb46e1c8640 1 -- 172.21.15.31:0/2822975151 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb45406b9c0 msgr2=0x7fb45406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:48.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.294+0000 7fb46e1c8640 1 --2- 172.21.15.31:0/2822975151 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb45406b9c0 0x7fb45406de80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb46806d6a0 tx=0x7fb458008040 comp rx=0 tx=0).stop 2024-04-15T00:31:48.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.294+0000 7fb46e1c8640 1 -- 172.21.15.31:0/2822975151 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4680b4290 msgr2=0x7fb468072c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:31:48.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.294+0000 7fb46e1c8640 1 --2- 172.21.15.31:0/2822975151 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4680b4290 0x7fb468072c60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb45c0097a0 tx=0x7fb45c0046c0 comp rx=0 tx=0).stop 2024-04-15T00:31:48.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.294+0000 7fb46e1c8640 1 -- 172.21.15.31:0/2822975151 shutdown_connections 2024-04-15T00:31:48.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.294+0000 7fb46e1c8640 1 --2- 172.21.15.31:0/2822975151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4681488c0 0x7fb4681dd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:48.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.294+0000 7fb46e1c8640 1 --2- 172.21.15.31:0/2822975151 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4680b4290 0x7fb468072c60 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:48.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.294+0000 7fb46e1c8640 1 --2- 172.21.15.31:0/2822975151 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb45406b9c0 0x7fb45406de80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:48.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.294+0000 7fb46e1c8640 1 --2- 172.21.15.31:0/2822975151 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb468074680 0x7fb468070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:31:48.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.294+0000 7fb46e1c8640 1 -- 172.21.15.31:0/2822975151 >> 172.21.15.31:0/2822975151 conn(0x7fb4680b92d0 msgr2=0x7fb4680b7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:31:48.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.294+0000 7fb46e1c8640 1 -- 172.21.15.31:0/2822975151 shutdown_connections 2024-04-15T00:31:48.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:31:48.294+0000 7fb46e1c8640 1 -- 172.21.15.31:0/2822975151 wait complete. 2024-04-15T00:31:48.330 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":346,"stamp":"2024-04-15T00:31:46.532051+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":13436300267,"num_objects":3426,"num_object_clones":0,"num_object_copies":13632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3426,"num_whiteouts":0,"num_read":152,"num_read_kb":172,"num_write":151407,"num_write_kb":13705922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33228,"ondisk_log_size":33228,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":28054848,"kb_used_data":26247040,"kb_used_omap":12,"kb_used_meta":1807731,"kb_avail":726919872,"statfs":{"total":773094113280,"available":744365948928,"internally_reserved":0,"allocated":26876968960,"data_stored":26875554112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1851117105},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":168300,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1935,"num_write_kb":7903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002594"},"pg_stats":[{"pgid":"2.1f","version":"27'5","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:31.459095+0000","last_change":"2024-04-15T00:21:07.577313+0000","last_active":"2024-04-15T00:29:31.459095+0000","last_peered":"2024-04-15T00:29:31.459095+0000","last_clean":"2024-04-15T00:29:31.459095+0000","last_became_active":"2024-04-15T00:21:07.576921+0000","last_became_peered":"2024-04-15T00:21:07.576921+0000","last_unstale":"2024-04-15T00:29:31.459095+0000","last_undegraded":"2024-04-15T00:29:31.459095+0000","last_fullsized":"2024-04-15T00:29:31.459095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:41:31.846500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'8","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.992841+0000","last_change":"2024-04-15T00:21:08.579912+0000","last_active":"2024-04-15T00:31:40.992841+0000","last_peered":"2024-04-15T00:31:40.992841+0000","last_clean":"2024-04-15T00:31:40.992841+0000","last_became_active":"2024-04-15T00:21:08.579545+0000","last_became_peered":"2024-04-15T00:21:08.579545+0000","last_unstale":"2024-04-15T00:31:40.992841+0000","last_undegraded":"2024-04-15T00:31:40.992841+0000","last_fullsized":"2024-04-15T00:31:40.992841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'1071","reported_seq":1093,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.698383+0000","last_change":"2024-04-15T00:21:12.634366+0000","last_active":"2024-04-15T00:31:32.698383+0000","last_peered":"2024-04-15T00:31:32.698383+0000","last_clean":"2024-04-15T00:31:32.698383+0000","last_became_active":"2024-04-15T00:21:12.633323+0000","last_became_peered":"2024-04-15T00:21:12.633323+0000","last_unstale":"2024-04-15T00:31:32.698383+0000","last_undegraded":"2024-04-15T00:31:32.698383+0000","last_fullsized":"2024-04-15T00:31:32.698383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1071,"log_dups_size":0,"ondisk_log_size":1071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:26:21.575108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444643618,"num_objects":114,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5549,"num_write_kb":456057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:11.454494+0000","last_change":"2024-04-15T00:21:07.569057+0000","last_active":"2024-04-15T00:29:11.454494+0000","last_peered":"2024-04-15T00:29:11.454494+0000","last_clean":"2024-04-15T00:29:11.454494+0000","last_became_active":"2024-04-15T00:21:07.568724+0000","last_became_peered":"2024-04-15T00:21:07.568724+0000","last_unstale":"2024-04-15T00:29:11.454494+0000","last_undegraded":"2024-04-15T00:29:11.454494+0000","last_fullsized":"2024-04-15T00:29:11.454494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:21:35.113136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'12","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.999993+0000","last_change":"2024-04-15T00:21:08.598196+0000","last_active":"2024-04-15T00:31:40.999993+0000","last_peered":"2024-04-15T00:31:40.999993+0000","last_clean":"2024-04-15T00:31:40.999993+0000","last_became_active":"2024-04-15T00:21:08.597625+0000","last_became_peered":"2024-04-15T00:21:08.597625+0000","last_unstale":"2024-04-15T00:31:40.999993+0000","last_undegraded":"2024-04-15T00:31:40.999993+0000","last_fullsized":"2024-04-15T00:31:40.999993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'864","reported_seq":886,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.174953+0000","last_change":"2024-04-15T00:21:12.624625+0000","last_active":"2024-04-15T00:31:30.174953+0000","last_peered":"2024-04-15T00:31:30.174953+0000","last_clean":"2024-04-15T00:31:30.174953+0000","last_became_active":"2024-04-15T00:21:12.624222+0000","last_became_peered":"2024-04-15T00:21:12.624222+0000","last_unstale":"2024-04-15T00:31:30.174953+0000","last_undegraded":"2024-04-15T00:31:30.174953+0000","last_fullsized":"2024-04-15T00:31:30.174953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":864,"log_dups_size":0,"ondisk_log_size":864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:28.534842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432116108,"num_objects":108,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4130,"num_write_kb":438054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'7","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:13.937261+0000","last_change":"2024-04-15T00:21:07.576936+0000","last_active":"2024-04-15T00:29:13.937261+0000","last_peered":"2024-04-15T00:29:13.937261+0000","last_clean":"2024-04-15T00:29:13.937261+0000","last_became_active":"2024-04-15T00:21:07.576674+0000","last_became_peered":"2024-04-15T00:21:07.576674+0000","last_unstale":"2024-04-15T00:29:13.937261+0000","last_undegraded":"2024-04-15T00:29:13.937261+0000","last_fullsized":"2024-04-15T00:29:13.937261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'16","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.986105+0000","last_change":"2024-04-15T00:21:08.587098+0000","last_active":"2024-04-15T00:31:40.986105+0000","last_peered":"2024-04-15T00:31:40.986105+0000","last_clean":"2024-04-15T00:31:40.986105+0000","last_became_active":"2024-04-15T00:21:08.586825+0000","last_became_peered":"2024-04-15T00:21:08.586825+0000","last_unstale":"2024-04-15T00:31:40.986105+0000","last_undegraded":"2024-04-15T00:31:40.986105+0000","last_fullsized":"2024-04-15T00:31:40.986105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:30.470116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'1019","reported_seq":1041,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.357740+0000","last_change":"2024-04-15T00:21:12.619903+0000","last_active":"2024-04-15T00:31:30.357740+0000","last_peered":"2024-04-15T00:31:30.357740+0000","last_clean":"2024-04-15T00:31:30.357740+0000","last_became_active":"2024-04-15T00:21:12.619259+0000","last_became_peered":"2024-04-15T00:21:12.619259+0000","last_unstale":"2024-04-15T00:31:30.357740+0000","last_undegraded":"2024-04-15T00:31:30.357740+0000","last_fullsized":"2024-04-15T00:31:30.357740+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1019,"log_dups_size":0,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:31.463828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411101590,"num_objects":106,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4869,"num_write_kb":420502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'4","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:13.316381+0000","last_change":"2024-04-15T00:21:07.579089+0000","last_active":"2024-04-15T00:29:13.316381+0000","last_peered":"2024-04-15T00:29:13.316381+0000","last_clean":"2024-04-15T00:29:13.316381+0000","last_became_active":"2024-04-15T00:21:07.578733+0000","last_became_peered":"2024-04-15T00:21:07.578733+0000","last_unstale":"2024-04-15T00:29:13.316381+0000","last_undegraded":"2024-04-15T00:29:13.316381+0000","last_fullsized":"2024-04-15T00:29:13.316381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:44:30.015803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'21","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.988808+0000","last_change":"2024-04-15T00:21:08.588235+0000","last_active":"2024-04-15T00:31:40.988808+0000","last_peered":"2024-04-15T00:31:40.988808+0000","last_clean":"2024-04-15T00:31:40.988808+0000","last_became_active":"2024-04-15T00:21:08.587951+0000","last_became_peered":"2024-04-15T00:21:08.587951+0000","last_unstale":"2024-04-15T00:31:40.988808+0000","last_undegraded":"2024-04-15T00:31:40.988808+0000","last_fullsized":"2024-04-15T00:31:40.988808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:08.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'897","reported_seq":919,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.101297+0000","last_change":"2024-04-15T00:21:12.613395+0000","last_active":"2024-04-15T00:31:30.101297+0000","last_peered":"2024-04-15T00:31:30.101297+0000","last_clean":"2024-04-15T00:31:30.101297+0000","last_became_active":"2024-04-15T00:21:12.612976+0000","last_became_peered":"2024-04-15T00:21:12.612976+0000","last_unstale":"2024-04-15T00:31:30.101297+0000","last_undegraded":"2024-04-15T00:31:30.101297+0000","last_fullsized":"2024-04-15T00:31:30.101297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":897,"log_dups_size":0,"ondisk_log_size":897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:05.044024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360723173,"num_objects":88,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4357,"num_write_kb":369330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'11","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.001086+0000","last_change":"2024-04-15T00:21:08.585248+0000","last_active":"2024-04-15T00:31:41.001086+0000","last_peered":"2024-04-15T00:31:41.001086+0000","last_clean":"2024-04-15T00:31:41.001086+0000","last_became_active":"2024-04-15T00:21:08.584882+0000","last_became_peered":"2024-04-15T00:21:08.584882+0000","last_unstale":"2024-04-15T00:31:41.001086+0000","last_undegraded":"2024-04-15T00:31:41.001086+0000","last_fullsized":"2024-04-15T00:31:41.001086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:27:41.268464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'856","reported_seq":886,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.960333+0000","last_change":"2024-04-15T00:21:07.580541+0000","last_active":"2024-04-15T00:31:41.960333+0000","last_peered":"2024-04-15T00:31:41.960333+0000","last_clean":"2024-04-15T00:31:41.960333+0000","last_became_active":"2024-04-15T00:21:07.580229+0000","last_became_peered":"2024-04-15T00:21:07.580229+0000","last_unstale":"2024-04-15T00:31:41.960333+0000","last_undegraded":"2024-04-15T00:31:41.960333+0000","last_fullsized":"2024-04-15T00:31:41.960333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":856,"log_dups_size":0,"ondisk_log_size":856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:34:26.325595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3034937,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":855,"num_write_kb":3147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'817","reported_seq":839,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.023590+0000","last_change":"2024-04-15T00:21:12.624175+0000","last_active":"2024-04-15T00:31:30.023590+0000","last_peered":"2024-04-15T00:31:30.023590+0000","last_clean":"2024-04-15T00:31:30.023590+0000","last_became_active":"2024-04-15T00:21:12.623783+0000","last_became_peered":"2024-04-15T00:21:12.623783+0000","last_unstale":"2024-04-15T00:31:30.023590+0000","last_undegraded":"2024-04-15T00:31:30.023590+0000","last_fullsized":"2024-04-15T00:31:30.023590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:22:04.031788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":419652210,"num_objects":107,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4013,"num_write_kb":425701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'16","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.001202+0000","last_change":"2024-04-15T00:21:08.594955+0000","last_active":"2024-04-15T00:31:41.001202+0000","last_peered":"2024-04-15T00:31:41.001202+0000","last_clean":"2024-04-15T00:31:41.001202+0000","last_became_active":"2024-04-15T00:21:08.594535+0000","last_became_peered":"2024-04-15T00:21:08.594535+0000","last_unstale":"2024-04-15T00:31:41.001202+0000","last_undegraded":"2024-04-15T00:31:41.001202+0000","last_fullsized":"2024-04-15T00:31:41.001202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:40.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:40.456499+0000","last_change":"2024-04-15T00:21:07.570862+0000","last_active":"2024-04-15T00:27:40.456499+0000","last_peered":"2024-04-15T00:27:40.456499+0000","last_clean":"2024-04-15T00:27:40.456499+0000","last_became_active":"2024-04-15T00:21:07.570555+0000","last_became_peered":"2024-04-15T00:21:07.570555+0000","last_unstale":"2024-04-15T00:27:40.456499+0000","last_undegraded":"2024-04-15T00:27:40.456499+0000","last_fullsized":"2024-04-15T00:27:40.456499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:54.810223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'900","reported_seq":929,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.386105+0000","last_change":"2024-04-15T00:21:50.135837+0000","last_active":"2024-04-15T00:31:30.386105+0000","last_peered":"2024-04-15T00:31:30.386105+0000","last_clean":"2024-04-15T00:31:30.386105+0000","last_became_active":"2024-04-15T00:21:50.135204+0000","last_became_peered":"2024-04-15T00:21:50.135204+0000","last_unstale":"2024-04-15T00:31:30.386105+0000","last_undegraded":"2024-04-15T00:31:30.386105+0000","last_fullsized":"2024-04-15T00:31:30.386105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:15:08.738300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423642109,"num_objects":107,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4534,"num_write_kb":431423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'17","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.999899+0000","last_change":"2024-04-15T00:21:08.574901+0000","last_active":"2024-04-15T00:31:40.999899+0000","last_peered":"2024-04-15T00:31:40.999899+0000","last_clean":"2024-04-15T00:31:40.999899+0000","last_became_active":"2024-04-15T00:21:08.574536+0000","last_became_peered":"2024-04-15T00:21:08.574536+0000","last_unstale":"2024-04-15T00:31:40.999899+0000","last_undegraded":"2024-04-15T00:31:40.999899+0000","last_fullsized":"2024-04-15T00:31:40.999899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:08.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:40.456476+0000","last_change":"2024-04-15T00:21:07.577048+0000","last_active":"2024-04-15T00:27:40.456476+0000","last_peered":"2024-04-15T00:27:40.456476+0000","last_clean":"2024-04-15T00:27:40.456476+0000","last_became_active":"2024-04-15T00:21:07.576739+0000","last_became_peered":"2024-04-15T00:21:07.576739+0000","last_unstale":"2024-04-15T00:27:40.456476+0000","last_undegraded":"2024-04-15T00:27:40.456476+0000","last_fullsized":"2024-04-15T00:27:40.456476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:14.441186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'1173","reported_seq":1195,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.552356+0000","last_change":"2024-04-15T00:21:12.632213+0000","last_active":"2024-04-15T00:31:32.552356+0000","last_peered":"2024-04-15T00:31:32.552356+0000","last_clean":"2024-04-15T00:31:32.552356+0000","last_became_active":"2024-04-15T00:21:12.631900+0000","last_became_peered":"2024-04-15T00:21:12.631900+0000","last_unstale":"2024-04-15T00:31:32.552356+0000","last_undegraded":"2024-04-15T00:31:32.552356+0000","last_fullsized":"2024-04-15T00:31:32.552356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1173,"log_dups_size":0,"ondisk_log_size":1173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:52:31.142377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":507526656,"num_objects":125,"num_object_clones":0,"num_object_copies":500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5839,"num_write_kb":518448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.972417+0000","last_change":"2024-04-15T00:21:08.590270+0000","last_active":"2024-04-15T00:31:40.972417+0000","last_peered":"2024-04-15T00:31:40.972417+0000","last_clean":"2024-04-15T00:31:40.972417+0000","last_became_active":"2024-04-15T00:21:08.589960+0000","last_became_peered":"2024-04-15T00:21:08.589960+0000","last_unstale":"2024-04-15T00:31:40.972417+0000","last_undegraded":"2024-04-15T00:31:40.972417+0000","last_fullsized":"2024-04-15T00:31:40.972417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:52.880065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:40.459480+0000","last_change":"2024-04-15T00:21:07.577518+0000","last_active":"2024-04-15T00:27:40.459480+0000","last_peered":"2024-04-15T00:27:40.459480+0000","last_clean":"2024-04-15T00:27:40.459480+0000","last_became_active":"2024-04-15T00:21:07.576961+0000","last_became_peered":"2024-04-15T00:21:07.576961+0000","last_unstale":"2024-04-15T00:27:40.459480+0000","last_undegraded":"2024-04-15T00:27:40.459480+0000","last_fullsized":"2024-04-15T00:27:40.459480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:14.441186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'743","reported_seq":772,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.215032+0000","last_change":"2024-04-15T00:21:50.136014+0000","last_active":"2024-04-15T00:31:30.215032+0000","last_peered":"2024-04-15T00:31:30.215032+0000","last_clean":"2024-04-15T00:31:30.215032+0000","last_became_active":"2024-04-15T00:21:50.135523+0000","last_became_peered":"2024-04-15T00:21:50.135523+0000","last_unstale":"2024-04-15T00:31:30.215032+0000","last_undegraded":"2024-04-15T00:31:30.215032+0000","last_fullsized":"2024-04-15T00:31:30.215032+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:29.469506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373416048,"num_objects":97,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3682,"num_write_kb":379037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'20","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.998655+0000","last_change":"2024-04-15T00:21:08.601349+0000","last_active":"2024-04-15T00:31:40.998655+0000","last_peered":"2024-04-15T00:31:40.998655+0000","last_clean":"2024-04-15T00:31:40.998655+0000","last_became_active":"2024-04-15T00:21:08.601048+0000","last_became_peered":"2024-04-15T00:21:08.601048+0000","last_unstale":"2024-04-15T00:31:40.998655+0000","last_undegraded":"2024-04-15T00:31:40.998655+0000","last_fullsized":"2024-04-15T00:31:40.998655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:27:41.268464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'4","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:40.453118+0000","last_change":"2024-04-15T00:21:07.577793+0000","last_active":"2024-04-15T00:27:40.453118+0000","last_peered":"2024-04-15T00:27:40.453118+0000","last_clean":"2024-04-15T00:27:40.453118+0000","last_became_active":"2024-04-15T00:21:07.577472+0000","last_became_peered":"2024-04-15T00:21:07.577472+0000","last_unstale":"2024-04-15T00:27:40.453118+0000","last_undegraded":"2024-04-15T00:27:40.453118+0000","last_fullsized":"2024-04-15T00:27:40.453118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:54.810223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'847","reported_seq":870,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.090056+0000","last_change":"2024-04-15T00:21:12.634814+0000","last_active":"2024-04-15T00:31:30.090056+0000","last_peered":"2024-04-15T00:31:30.090056+0000","last_clean":"2024-04-15T00:31:30.090056+0000","last_became_active":"2024-04-15T00:21:12.633228+0000","last_became_peered":"2024-04-15T00:21:12.633228+0000","last_unstale":"2024-04-15T00:31:30.090056+0000","last_undegraded":"2024-04-15T00:31:30.090056+0000","last_fullsized":"2024-04-15T00:31:30.090056+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:13.312501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411134922,"num_objects":101,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3991,"num_write_kb":416955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'13","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.988463+0000","last_change":"2024-04-15T00:21:49.708455+0000","last_active":"2024-04-15T00:31:40.988463+0000","last_peered":"2024-04-15T00:31:40.988463+0000","last_clean":"2024-04-15T00:31:40.988463+0000","last_became_active":"2024-04-15T00:21:49.708106+0000","last_became_peered":"2024-04-15T00:21:49.708106+0000","last_unstale":"2024-04-15T00:31:40.988463+0000","last_undegraded":"2024-04-15T00:31:40.988463+0000","last_fullsized":"2024-04-15T00:31:40.988463+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:04:14.156671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"27'322","reported_seq":352,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:35.662989+0000","last_change":"2024-04-15T00:21:07.573285+0000","last_active":"2024-04-15T00:31:35.662989+0000","last_peered":"2024-04-15T00:31:35.662989+0000","last_clean":"2024-04-15T00:31:35.662989+0000","last_became_active":"2024-04-15T00:21:07.572973+0000","last_became_peered":"2024-04-15T00:21:07.572973+0000","last_unstale":"2024-04-15T00:31:35.662989+0000","last_undegraded":"2024-04-15T00:31:35.662989+0000","last_fullsized":"2024-04-15T00:31:35.662989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":665,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'847","reported_seq":870,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.320976+0000","last_change":"2024-04-15T00:21:12.633602+0000","last_active":"2024-04-15T00:31:32.320976+0000","last_peered":"2024-04-15T00:31:32.320976+0000","last_clean":"2024-04-15T00:31:32.320976+0000","last_became_active":"2024-04-15T00:21:12.633178+0000","last_became_peered":"2024-04-15T00:21:12.633178+0000","last_unstale":"2024-04-15T00:31:32.320976+0000","last_undegraded":"2024-04-15T00:31:32.320976+0000","last_fullsized":"2024-04-15T00:31:32.320976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:01:48.959493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448855783,"num_objects":113,"num_object_clones":0,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4294,"num_write_kb":455043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'14","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.002998+0000","last_change":"2024-04-15T00:21:08.580727+0000","last_active":"2024-04-15T00:31:41.002998+0000","last_peered":"2024-04-15T00:31:41.002998+0000","last_clean":"2024-04-15T00:31:41.002998+0000","last_became_active":"2024-04-15T00:21:08.580418+0000","last_became_peered":"2024-04-15T00:21:08.580418+0000","last_unstale":"2024-04-15T00:31:41.002998+0000","last_undegraded":"2024-04-15T00:31:41.002998+0000","last_fullsized":"2024-04-15T00:31:41.002998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'1","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.470869+0000","last_change":"2024-04-15T00:21:07.575864+0000","last_active":"2024-04-15T00:29:30.470869+0000","last_peered":"2024-04-15T00:29:30.470869+0000","last_clean":"2024-04-15T00:29:30.470869+0000","last_became_active":"2024-04-15T00:21:07.575562+0000","last_became_peered":"2024-04-15T00:21:07.575562+0000","last_unstale":"2024-04-15T00:29:30.470869+0000","last_undegraded":"2024-04-15T00:29:30.470869+0000","last_fullsized":"2024-04-15T00:29:30.470869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:35:39.009511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'992","reported_seq":1015,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.362666+0000","last_change":"2024-04-15T00:21:12.633674+0000","last_active":"2024-04-15T00:31:30.362666+0000","last_peered":"2024-04-15T00:31:30.362666+0000","last_clean":"2024-04-15T00:31:30.362666+0000","last_became_active":"2024-04-15T00:21:12.633277+0000","last_became_peered":"2024-04-15T00:21:12.633277+0000","last_unstale":"2024-04-15T00:31:30.362666+0000","last_undegraded":"2024-04-15T00:31:30.362666+0000","last_fullsized":"2024-04-15T00:31:30.362666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":992,"log_dups_size":0,"ondisk_log_size":992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:49.295552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":382066035,"num_objects":93,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4954,"num_write_kb":392450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'10","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.006578+0000","last_change":"2024-04-15T00:21:08.578321+0000","last_active":"2024-04-15T00:31:41.006578+0000","last_peered":"2024-04-15T00:31:41.006578+0000","last_clean":"2024-04-15T00:31:41.006578+0000","last_became_active":"2024-04-15T00:21:08.578017+0000","last_became_peered":"2024-04-15T00:21:08.578017+0000","last_unstale":"2024-04-15T00:31:41.006578+0000","last_undegraded":"2024-04-15T00:31:41.006578+0000","last_fullsized":"2024-04-15T00:31:41.006578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:40.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.465258+0000","last_change":"2024-04-15T00:21:07.575183+0000","last_active":"2024-04-15T00:29:30.465258+0000","last_peered":"2024-04-15T00:29:30.465258+0000","last_clean":"2024-04-15T00:29:30.465258+0000","last_became_active":"2024-04-15T00:21:07.574822+0000","last_became_peered":"2024-04-15T00:21:07.574822+0000","last_unstale":"2024-04-15T00:29:30.465258+0000","last_undegraded":"2024-04-15T00:29:30.465258+0000","last_fullsized":"2024-04-15T00:29:30.465258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:26:22.612110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'1180","reported_seq":1203,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:33.170887+0000","last_change":"2024-04-15T00:21:12.620150+0000","last_active":"2024-04-15T00:31:33.170887+0000","last_peered":"2024-04-15T00:31:33.170887+0000","last_clean":"2024-04-15T00:31:33.170887+0000","last_became_active":"2024-04-15T00:21:12.619694+0000","last_became_peered":"2024-04-15T00:21:12.619694+0000","last_unstale":"2024-04-15T00:31:33.170887+0000","last_undegraded":"2024-04-15T00:31:33.170887+0000","last_fullsized":"2024-04-15T00:31:33.170887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1180,"log_dups_size":0,"ondisk_log_size":1180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:34.506827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474051932,"num_objects":120,"num_object_clones":0,"num_object_copies":480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":120,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5768,"num_write_kb":485640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'13","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.996144+0000","last_change":"2024-04-15T00:21:08.596959+0000","last_active":"2024-04-15T00:31:40.996144+0000","last_peered":"2024-04-15T00:31:40.996144+0000","last_clean":"2024-04-15T00:31:40.996144+0000","last_became_active":"2024-04-15T00:21:08.596678+0000","last_became_peered":"2024-04-15T00:21:08.596678+0000","last_unstale":"2024-04-15T00:31:40.996144+0000","last_undegraded":"2024-04-15T00:31:40.996144+0000","last_fullsized":"2024-04-15T00:31:40.996144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:35:40.014598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.464535+0000","last_change":"2024-04-15T00:21:07.574514+0000","last_active":"2024-04-15T00:29:30.464535+0000","last_peered":"2024-04-15T00:29:30.464535+0000","last_clean":"2024-04-15T00:29:30.464535+0000","last_became_active":"2024-04-15T00:21:07.574228+0000","last_became_peered":"2024-04-15T00:21:07.574228+0000","last_unstale":"2024-04-15T00:29:30.464535+0000","last_undegraded":"2024-04-15T00:29:30.464535+0000","last_fullsized":"2024-04-15T00:29:30.464535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'1049","reported_seq":1072,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.015692+0000","last_change":"2024-04-15T00:21:12.619733+0000","last_active":"2024-04-15T00:31:32.015692+0000","last_peered":"2024-04-15T00:31:32.015692+0000","last_clean":"2024-04-15T00:31:32.015692+0000","last_became_active":"2024-04-15T00:21:12.619307+0000","last_became_peered":"2024-04-15T00:21:12.619307+0000","last_unstale":"2024-04-15T00:31:32.015692+0000","last_undegraded":"2024-04-15T00:31:32.015692+0000","last_fullsized":"2024-04-15T00:31:32.015692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1049,"log_dups_size":0,"ondisk_log_size":1049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:48:00.696018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415249523,"num_objects":103,"num_object_clones":0,"num_object_copies":412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5497,"num_write_kb":427157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'18","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.997049+0000","last_change":"2024-04-15T00:21:08.589246+0000","last_active":"2024-04-15T00:31:40.997049+0000","last_peered":"2024-04-15T00:31:40.997049+0000","last_clean":"2024-04-15T00:31:40.997049+0000","last_became_active":"2024-04-15T00:21:08.588920+0000","last_became_peered":"2024-04-15T00:21:08.588920+0000","last_unstale":"2024-04-15T00:31:40.997049+0000","last_undegraded":"2024-04-15T00:31:40.997049+0000","last_fullsized":"2024-04-15T00:31:40.997049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'38","reported_seq":114,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:46.492052+0000","last_change":"2024-04-15T00:31:46.492076+0000","last_active":"2024-04-15T00:31:46.492052+0000","last_peered":"2024-04-15T00:31:46.492052+0000","last_clean":"2024-04-15T00:31:46.492052+0000","last_became_active":"2024-04-15T00:21:07.566240+0000","last_became_peered":"2024-04-15T00:21:07.566240+0000","last_unstale":"2024-04-15T00:31:46.492052+0000","last_undegraded":"2024-04-15T00:31:46.492052+0000","last_fullsized":"2024-04-15T00:31:46.492052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2024-04-15T00:31:46.491982+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2024-04-15T00:31:46.491982+0000","last_clean_scrub_stamp":"2024-04-15T00:31:46.491982+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:41:40.312173+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50889,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":72,"num_write":36,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'862","reported_seq":884,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.536387+0000","last_change":"2024-04-15T00:21:12.623452+0000","last_active":"2024-04-15T00:31:32.536387+0000","last_peered":"2024-04-15T00:31:32.536387+0000","last_clean":"2024-04-15T00:31:32.536387+0000","last_became_active":"2024-04-15T00:21:12.623066+0000","last_became_peered":"2024-04-15T00:21:12.623066+0000","last_unstale":"2024-04-15T00:31:32.536387+0000","last_undegraded":"2024-04-15T00:31:32.536387+0000","last_fullsized":"2024-04-15T00:31:32.536387+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:11:16.107864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":453040013,"num_objects":117,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4260,"num_write_kb":459037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'8","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.991863+0000","last_change":"2024-04-15T00:21:08.586376+0000","last_active":"2024-04-15T00:31:40.991863+0000","last_peered":"2024-04-15T00:31:40.991863+0000","last_clean":"2024-04-15T00:31:40.991863+0000","last_became_active":"2024-04-15T00:21:08.586054+0000","last_became_peered":"2024-04-15T00:21:08.586054+0000","last_unstale":"2024-04-15T00:31:40.991863+0000","last_undegraded":"2024-04-15T00:31:40.991863+0000","last_fullsized":"2024-04-15T00:31:40.991863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:02:56.329428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:10.468749+0000","last_change":"2024-04-15T00:21:07.577289+0000","last_active":"2024-04-15T00:29:10.468749+0000","last_peered":"2024-04-15T00:29:10.468749+0000","last_clean":"2024-04-15T00:29:10.468749+0000","last_became_active":"2024-04-15T00:21:07.576602+0000","last_became_peered":"2024-04-15T00:21:07.576602+0000","last_unstale":"2024-04-15T00:29:10.468749+0000","last_undegraded":"2024-04-15T00:29:10.468749+0000","last_fullsized":"2024-04-15T00:29:10.468749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:26:22.612110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'902","reported_seq":924,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.470317+0000","last_change":"2024-04-15T00:21:12.634248+0000","last_active":"2024-04-15T00:31:30.470317+0000","last_peered":"2024-04-15T00:31:30.470317+0000","last_clean":"2024-04-15T00:31:30.470317+0000","last_became_active":"2024-04-15T00:21:12.633239+0000","last_became_peered":"2024-04-15T00:21:12.633239+0000","last_unstale":"2024-04-15T00:31:30.470317+0000","last_undegraded":"2024-04-15T00:31:30.470317+0000","last_fullsized":"2024-04-15T00:31:30.470317+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:52:31.142377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356541982,"num_objects":92,"num_object_clones":0,"num_object_copies":368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4244,"num_write_kb":364740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'12","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.005522+0000","last_change":"2024-04-15T00:21:08.591060+0000","last_active":"2024-04-15T00:31:41.005522+0000","last_peered":"2024-04-15T00:31:41.005522+0000","last_clean":"2024-04-15T00:31:41.005522+0000","last_became_active":"2024-04-15T00:21:08.590781+0000","last_became_peered":"2024-04-15T00:21:08.590781+0000","last_unstale":"2024-04-15T00:31:41.005522+0000","last_undegraded":"2024-04-15T00:31:41.005522+0000","last_fullsized":"2024-04-15T00:31:41.005522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:30.464552+0000","last_change":"2024-04-15T00:21:07.573617+0000","last_active":"2024-04-15T00:29:30.464552+0000","last_peered":"2024-04-15T00:29:30.464552+0000","last_clean":"2024-04-15T00:29:30.464552+0000","last_became_active":"2024-04-15T00:21:07.573308+0000","last_became_peered":"2024-04-15T00:21:07.573308+0000","last_unstale":"2024-04-15T00:29:30.464552+0000","last_undegraded":"2024-04-15T00:29:30.464552+0000","last_fullsized":"2024-04-15T00:29:30.464552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:36:11.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":187,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:00.467601+0000","last_change":"2024-04-15T00:20:57.937516+0000","last_active":"2024-04-15T00:29:00.467601+0000","last_peered":"2024-04-15T00:29:00.467601+0000","last_clean":"2024-04-15T00:29:00.467601+0000","last_became_active":"2024-04-15T00:20:57.936329+0000","last_became_peered":"2024-04-15T00:20:57.936329+0000","last_unstale":"2024-04-15T00:29:00.467601+0000","last_undegraded":"2024-04-15T00:29:00.467601+0000","last_fullsized":"2024-04-15T00:29:00.467601+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:20:56.517419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:20:56.517419+0000","last_clean_scrub_stamp":"2024-04-15T00:20:56.517419+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:07:23.949459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'923","reported_seq":946,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.464035+0000","last_change":"2024-04-15T00:21:12.633530+0000","last_active":"2024-04-15T00:31:30.464035+0000","last_peered":"2024-04-15T00:31:30.464035+0000","last_clean":"2024-04-15T00:31:30.464035+0000","last_became_active":"2024-04-15T00:21:12.633124+0000","last_became_peered":"2024-04-15T00:21:12.633124+0000","last_unstale":"2024-04-15T00:31:30.464035+0000","last_undegraded":"2024-04-15T00:31:30.464035+0000","last_fullsized":"2024-04-15T00:31:30.464035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":923,"log_dups_size":0,"ondisk_log_size":923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:49.295552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406896485,"num_objects":106,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4652,"num_write_kb":415602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'13","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.004006+0000","last_change":"2024-04-15T00:21:08.583443+0000","last_active":"2024-04-15T00:31:41.004006+0000","last_peered":"2024-04-15T00:31:41.004006+0000","last_clean":"2024-04-15T00:31:41.004006+0000","last_became_active":"2024-04-15T00:21:08.583143+0000","last_became_peered":"2024-04-15T00:21:08.583143+0000","last_unstale":"2024-04-15T00:31:41.004006+0000","last_undegraded":"2024-04-15T00:31:41.004006+0000","last_fullsized":"2024-04-15T00:31:41.004006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:01.007313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:30:11.454420+0000","last_change":"2024-04-15T00:21:07.579386+0000","last_active":"2024-04-15T00:30:11.454420+0000","last_peered":"2024-04-15T00:30:11.454420+0000","last_clean":"2024-04-15T00:30:11.454420+0000","last_became_active":"2024-04-15T00:21:07.579024+0000","last_became_peered":"2024-04-15T00:21:07.579024+0000","last_unstale":"2024-04-15T00:30:11.454420+0000","last_undegraded":"2024-04-15T00:30:11.454420+0000","last_fullsized":"2024-04-15T00:30:11.454420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'783","reported_seq":805,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.088053+0000","last_change":"2024-04-15T00:21:12.635286+0000","last_active":"2024-04-15T00:31:30.088053+0000","last_peered":"2024-04-15T00:31:30.088053+0000","last_clean":"2024-04-15T00:31:30.088053+0000","last_became_active":"2024-04-15T00:21:12.634689+0000","last_became_peered":"2024-04-15T00:21:12.634689+0000","last_unstale":"2024-04-15T00:31:30.088053+0000","last_undegraded":"2024-04-15T00:31:30.088053+0000","last_fullsized":"2024-04-15T00:31:30.088053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:05.044024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":419485282,"num_objects":105,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3792,"num_write_kb":424412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'13","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.005773+0000","last_change":"2024-04-15T00:21:49.708583+0000","last_active":"2024-04-15T00:31:41.005773+0000","last_peered":"2024-04-15T00:31:41.005773+0000","last_clean":"2024-04-15T00:31:41.005773+0000","last_became_active":"2024-04-15T00:21:49.708252+0000","last_became_peered":"2024-04-15T00:21:49.708252+0000","last_unstale":"2024-04-15T00:31:41.005773+0000","last_undegraded":"2024-04-15T00:31:41.005773+0000","last_fullsized":"2024-04-15T00:31:41.005773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:55.457685+0000","last_change":"2024-04-15T00:21:07.571553+0000","last_active":"2024-04-15T00:27:55.457685+0000","last_peered":"2024-04-15T00:27:55.457685+0000","last_clean":"2024-04-15T00:27:55.457685+0000","last_became_active":"2024-04-15T00:21:07.571238+0000","last_became_peered":"2024-04-15T00:21:07.571238+0000","last_unstale":"2024-04-15T00:27:55.457685+0000","last_undegraded":"2024-04-15T00:27:55.457685+0000","last_fullsized":"2024-04-15T00:27:55.457685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:35:39.009511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'910","reported_seq":932,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.379637+0000","last_change":"2024-04-15T00:21:12.619646+0000","last_active":"2024-04-15T00:31:30.379637+0000","last_peered":"2024-04-15T00:31:30.379637+0000","last_clean":"2024-04-15T00:31:30.379637+0000","last_became_active":"2024-04-15T00:21:12.619263+0000","last_became_peered":"2024-04-15T00:21:12.619263+0000","last_unstale":"2024-04-15T00:31:30.379637+0000","last_undegraded":"2024-04-15T00:31:30.379637+0000","last_fullsized":"2024-04-15T00:31:30.379637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:31.463828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394550963,"num_objects":102,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4303,"num_write_kb":402124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'17","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.007765+0000","last_change":"2024-04-15T00:21:08.599410+0000","last_active":"2024-04-15T00:31:41.007765+0000","last_peered":"2024-04-15T00:31:41.007765+0000","last_clean":"2024-04-15T00:31:41.007765+0000","last_became_active":"2024-04-15T00:21:08.599132+0000","last_became_peered":"2024-04-15T00:21:08.599132+0000","last_unstale":"2024-04-15T00:31:41.007765+0000","last_undegraded":"2024-04-15T00:31:41.007765+0000","last_fullsized":"2024-04-15T00:31:41.007765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:47:56.659307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'3","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:30:11.454447+0000","last_change":"2024-04-15T00:21:07.567917+0000","last_active":"2024-04-15T00:30:11.454447+0000","last_peered":"2024-04-15T00:30:11.454447+0000","last_clean":"2024-04-15T00:30:11.454447+0000","last_became_active":"2024-04-15T00:21:07.567673+0000","last_became_peered":"2024-04-15T00:21:07.567673+0000","last_unstale":"2024-04-15T00:30:11.454447+0000","last_undegraded":"2024-04-15T00:30:11.454447+0000","last_fullsized":"2024-04-15T00:30:11.454447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'711","reported_seq":733,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.109666+0000","last_change":"2024-04-15T00:21:12.632937+0000","last_active":"2024-04-15T00:31:30.109666+0000","last_peered":"2024-04-15T00:31:30.109666+0000","last_clean":"2024-04-15T00:31:30.109666+0000","last_became_active":"2024-04-15T00:21:12.632508+0000","last_became_peered":"2024-04-15T00:21:12.632508+0000","last_unstale":"2024-04-15T00:31:30.109666+0000","last_undegraded":"2024-04-15T00:31:30.109666+0000","last_fullsized":"2024-04-15T00:31:30.109666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:07:36.246879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":385889695,"num_objects":96,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3516,"num_write_kb":390521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'9","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.007328+0000","last_change":"2024-04-15T00:21:08.600430+0000","last_active":"2024-04-15T00:31:41.007328+0000","last_peered":"2024-04-15T00:31:41.007328+0000","last_clean":"2024-04-15T00:31:41.007328+0000","last_became_active":"2024-04-15T00:21:08.600142+0000","last_became_peered":"2024-04-15T00:21:08.600142+0000","last_unstale":"2024-04-15T00:31:41.007328+0000","last_undegraded":"2024-04-15T00:31:41.007328+0000","last_fullsized":"2024-04-15T00:31:41.007328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:30.470116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:27:55.469451+0000","last_change":"2024-04-15T00:21:07.576781+0000","last_active":"2024-04-15T00:27:55.469451+0000","last_peered":"2024-04-15T00:27:55.469451+0000","last_clean":"2024-04-15T00:27:55.469451+0000","last_became_active":"2024-04-15T00:21:07.576491+0000","last_became_peered":"2024-04-15T00:21:07.576491+0000","last_unstale":"2024-04-15T00:27:55.469451+0000","last_undegraded":"2024-04-15T00:27:55.469451+0000","last_fullsized":"2024-04-15T00:27:55.469451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:41:31.846500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'793","reported_seq":815,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.146293+0000","last_change":"2024-04-15T00:21:12.620247+0000","last_active":"2024-04-15T00:31:30.146293+0000","last_peered":"2024-04-15T00:31:30.146293+0000","last_clean":"2024-04-15T00:31:30.146293+0000","last_became_active":"2024-04-15T00:21:12.619257+0000","last_became_peered":"2024-04-15T00:21:12.619257+0000","last_unstale":"2024-04-15T00:31:30.146293+0000","last_undegraded":"2024-04-15T00:31:30.146293+0000","last_fullsized":"2024-04-15T00:31:30.146293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:44.287619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398629714,"num_objects":100,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3893,"num_write_kb":404464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'15","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.008028+0000","last_change":"2024-04-15T00:21:08.590732+0000","last_active":"2024-04-15T00:31:41.008028+0000","last_peered":"2024-04-15T00:31:41.008028+0000","last_clean":"2024-04-15T00:31:41.008028+0000","last_became_active":"2024-04-15T00:21:08.590450+0000","last_became_peered":"2024-04-15T00:21:08.590450+0000","last_unstale":"2024-04-15T00:31:41.008028+0000","last_undegraded":"2024-04-15T00:31:41.008028+0000","last_fullsized":"2024-04-15T00:31:41.008028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:10:24.477646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'10","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:30:31.456113+0000","last_change":"2024-04-15T00:21:07.566984+0000","last_active":"2024-04-15T00:30:31.456113+0000","last_peered":"2024-04-15T00:30:31.456113+0000","last_clean":"2024-04-15T00:30:31.456113+0000","last_became_active":"2024-04-15T00:21:07.566681+0000","last_became_peered":"2024-04-15T00:21:07.566681+0000","last_unstale":"2024-04-15T00:30:31.456113+0000","last_undegraded":"2024-04-15T00:30:31.456113+0000","last_fullsized":"2024-04-15T00:30:31.456113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'1080","reported_seq":1102,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.437365+0000","last_change":"2024-04-15T00:21:12.615981+0000","last_active":"2024-04-15T00:31:30.437365+0000","last_peered":"2024-04-15T00:31:30.437365+0000","last_clean":"2024-04-15T00:31:30.437365+0000","last_became_active":"2024-04-15T00:21:12.615577+0000","last_became_peered":"2024-04-15T00:21:12.615577+0000","last_unstale":"2024-04-15T00:31:30.437365+0000","last_undegraded":"2024-04-15T00:31:30.437365+0000","last_fullsized":"2024-04-15T00:31:30.437365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1080,"log_dups_size":0,"ondisk_log_size":1080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:52:14.595303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440503524,"num_objects":114,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5539,"num_write_kb":451979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'11","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.005218+0000","last_change":"2024-04-15T00:21:08.588266+0000","last_active":"2024-04-15T00:31:41.005218+0000","last_peered":"2024-04-15T00:31:41.005218+0000","last_clean":"2024-04-15T00:31:41.005218+0000","last_became_active":"2024-04-15T00:21:08.587962+0000","last_became_peered":"2024-04-15T00:21:08.587962+0000","last_unstale":"2024-04-15T00:31:41.005218+0000","last_undegraded":"2024-04-15T00:31:41.005218+0000","last_fullsized":"2024-04-15T00:31:41.005218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:10.456423+0000","last_change":"2024-04-15T00:21:07.573664+0000","last_active":"2024-04-15T00:28:10.456423+0000","last_peered":"2024-04-15T00:28:10.456423+0000","last_clean":"2024-04-15T00:28:10.456423+0000","last_became_active":"2024-04-15T00:21:07.573325+0000","last_became_peered":"2024-04-15T00:21:07.573325+0000","last_unstale":"2024-04-15T00:28:10.456423+0000","last_undegraded":"2024-04-15T00:28:10.456423+0000","last_fullsized":"2024-04-15T00:28:10.456423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:16:52.647503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'921","reported_seq":950,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.745387+0000","last_change":"2024-04-15T00:21:50.136384+0000","last_active":"2024-04-15T00:31:32.745387+0000","last_peered":"2024-04-15T00:31:32.745387+0000","last_clean":"2024-04-15T00:31:32.745387+0000","last_became_active":"2024-04-15T00:21:50.135899+0000","last_became_peered":"2024-04-15T00:21:50.135899+0000","last_unstale":"2024-04-15T00:31:32.745387+0000","last_undegraded":"2024-04-15T00:31:32.745387+0000","last_fullsized":"2024-04-15T00:31:32.745387+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:16:56.946948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444634187,"num_objects":110,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4674,"num_write_kb":452484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'25","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.007948+0000","last_change":"2024-04-15T00:21:08.593412+0000","last_active":"2024-04-15T00:31:41.007948+0000","last_peered":"2024-04-15T00:31:41.007948+0000","last_clean":"2024-04-15T00:31:41.007948+0000","last_became_active":"2024-04-15T00:21:08.593112+0000","last_became_peered":"2024-04-15T00:21:08.593112+0000","last_unstale":"2024-04-15T00:31:41.007948+0000","last_undegraded":"2024-04-15T00:31:41.007948+0000","last_fullsized":"2024-04-15T00:31:41.007948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:45.258841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:10.456433+0000","last_change":"2024-04-15T00:21:07.576800+0000","last_active":"2024-04-15T00:28:10.456433+0000","last_peered":"2024-04-15T00:28:10.456433+0000","last_clean":"2024-04-15T00:28:10.456433+0000","last_became_active":"2024-04-15T00:21:07.576501+0000","last_became_peered":"2024-04-15T00:21:07.576501+0000","last_unstale":"2024-04-15T00:28:10.456433+0000","last_undegraded":"2024-04-15T00:28:10.456433+0000","last_fullsized":"2024-04-15T00:28:10.456433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:54.810223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'976","reported_seq":998,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:33.308898+0000","last_change":"2024-04-15T00:21:12.634065+0000","last_active":"2024-04-15T00:31:33.308898+0000","last_peered":"2024-04-15T00:31:33.308898+0000","last_clean":"2024-04-15T00:31:33.308898+0000","last_became_active":"2024-04-15T00:21:12.633242+0000","last_became_peered":"2024-04-15T00:21:12.633242+0000","last_unstale":"2024-04-15T00:31:33.308898+0000","last_undegraded":"2024-04-15T00:31:33.308898+0000","last_fullsized":"2024-04-15T00:31:33.308898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":976,"log_dups_size":0,"ondisk_log_size":976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:38:32.207334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":453069136,"num_objects":118,"num_object_clones":0,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4842,"num_write_kb":461390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'19","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.996342+0000","last_change":"2024-04-15T00:21:49.706390+0000","last_active":"2024-04-15T00:31:40.996342+0000","last_peered":"2024-04-15T00:31:40.996342+0000","last_clean":"2024-04-15T00:31:40.996342+0000","last_became_active":"2024-04-15T00:21:49.705916+0000","last_became_peered":"2024-04-15T00:21:49.705916+0000","last_unstale":"2024-04-15T00:31:40.996342+0000","last_undegraded":"2024-04-15T00:31:40.996342+0000","last_fullsized":"2024-04-15T00:31:40.996342+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.13","version":"27'4","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:13.316890+0000","last_change":"2024-04-15T00:21:07.573340+0000","last_active":"2024-04-15T00:29:13.316890+0000","last_peered":"2024-04-15T00:29:13.316890+0000","last_clean":"2024-04-15T00:29:13.316890+0000","last_became_active":"2024-04-15T00:21:07.572749+0000","last_became_peered":"2024-04-15T00:21:07.572749+0000","last_unstale":"2024-04-15T00:29:13.316890+0000","last_undegraded":"2024-04-15T00:29:13.316890+0000","last_fullsized":"2024-04-15T00:29:13.316890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:05:06.225337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'1053","reported_seq":1075,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.353159+0000","last_change":"2024-04-15T00:21:12.632412+0000","last_active":"2024-04-15T00:31:30.353159+0000","last_peered":"2024-04-15T00:31:30.353159+0000","last_clean":"2024-04-15T00:31:30.353159+0000","last_became_active":"2024-04-15T00:21:12.631982+0000","last_became_peered":"2024-04-15T00:21:12.631982+0000","last_unstale":"2024-04-15T00:31:30.353159+0000","last_undegraded":"2024-04-15T00:31:30.353159+0000","last_fullsized":"2024-04-15T00:31:30.353159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1053,"log_dups_size":0,"ondisk_log_size":1053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:11:44.674232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402653184,"num_objects":96,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5184,"num_write_kb":413411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'15","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.009678+0000","last_change":"2024-04-15T00:21:08.582822+0000","last_active":"2024-04-15T00:31:41.009678+0000","last_peered":"2024-04-15T00:31:41.009678+0000","last_clean":"2024-04-15T00:31:41.009678+0000","last_became_active":"2024-04-15T00:21:08.582531+0000","last_became_peered":"2024-04-15T00:21:08.582531+0000","last_unstale":"2024-04-15T00:31:41.009678+0000","last_undegraded":"2024-04-15T00:31:41.009678+0000","last_fullsized":"2024-04-15T00:31:41.009678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:21:59.995077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'287","reported_seq":317,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:11.997546+0000","last_change":"2024-04-15T00:21:07.576694+0000","last_active":"2024-04-15T00:31:11.997546+0000","last_peered":"2024-04-15T00:31:11.997546+0000","last_clean":"2024-04-15T00:31:11.997546+0000","last_became_active":"2024-04-15T00:21:07.576380+0000","last_became_peered":"2024-04-15T00:21:07.576380+0000","last_unstale":"2024-04-15T00:31:11.997546+0000","last_undegraded":"2024-04-15T00:31:11.997546+0000","last_fullsized":"2024-04-15T00:31:11.997546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:36:11.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":4242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'986","reported_seq":1008,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:33.149195+0000","last_change":"2024-04-15T00:21:12.620928+0000","last_active":"2024-04-15T00:31:33.149195+0000","last_peered":"2024-04-15T00:31:33.149195+0000","last_clean":"2024-04-15T00:31:33.149195+0000","last_became_active":"2024-04-15T00:21:12.620536+0000","last_became_peered":"2024-04-15T00:21:12.620536+0000","last_unstale":"2024-04-15T00:31:33.149195+0000","last_undegraded":"2024-04-15T00:31:33.149195+0000","last_fullsized":"2024-04-15T00:31:33.149195+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":986,"log_dups_size":0,"ondisk_log_size":986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:52:14.595303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402669397,"num_objects":101,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4803,"num_write_kb":412051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'14","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.010106+0000","last_change":"2024-04-15T00:21:08.588132+0000","last_active":"2024-04-15T00:31:41.010106+0000","last_peered":"2024-04-15T00:31:41.010106+0000","last_clean":"2024-04-15T00:31:41.010106+0000","last_became_active":"2024-04-15T00:21:08.587383+0000","last_became_peered":"2024-04-15T00:21:08.587383+0000","last_unstale":"2024-04-15T00:31:41.010106+0000","last_undegraded":"2024-04-15T00:31:41.010106+0000","last_fullsized":"2024-04-15T00:31:41.010106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:15.446273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'21","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:13.316687+0000","last_change":"2024-04-15T00:21:07.574695+0000","last_active":"2024-04-15T00:29:13.316687+0000","last_peered":"2024-04-15T00:29:13.316687+0000","last_clean":"2024-04-15T00:29:13.316687+0000","last_became_active":"2024-04-15T00:21:07.574389+0000","last_became_peered":"2024-04-15T00:21:07.574389+0000","last_unstale":"2024-04-15T00:29:13.316687+0000","last_undegraded":"2024-04-15T00:29:13.316687+0000","last_fullsized":"2024-04-15T00:29:13.316687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:34:26.325595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'1044","reported_seq":1066,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.256686+0000","last_change":"2024-04-15T00:21:12.620255+0000","last_active":"2024-04-15T00:31:30.256686+0000","last_peered":"2024-04-15T00:31:30.256686+0000","last_clean":"2024-04-15T00:31:30.256686+0000","last_became_active":"2024-04-15T00:21:12.619218+0000","last_became_peered":"2024-04-15T00:21:12.619218+0000","last_unstale":"2024-04-15T00:31:30.256686+0000","last_undegraded":"2024-04-15T00:31:30.256686+0000","last_fullsized":"2024-04-15T00:31:30.256686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1044,"log_dups_size":0,"ondisk_log_size":1044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:49.295552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423735680,"num_objects":112,"num_object_clones":0,"num_object_copies":448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5284,"num_write_kb":434520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'18","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.991272+0000","last_change":"2024-04-15T00:21:08.597898+0000","last_active":"2024-04-15T00:31:40.991272+0000","last_peered":"2024-04-15T00:31:40.991272+0000","last_clean":"2024-04-15T00:31:40.991272+0000","last_became_active":"2024-04-15T00:21:08.597262+0000","last_became_peered":"2024-04-15T00:21:08.597262+0000","last_unstale":"2024-04-15T00:31:40.991272+0000","last_undegraded":"2024-04-15T00:31:40.991272+0000","last_fullsized":"2024-04-15T00:31:40.991272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.457852+0000","last_change":"2024-04-15T00:21:07.574003+0000","last_active":"2024-04-15T00:28:25.457852+0000","last_peered":"2024-04-15T00:28:25.457852+0000","last_clean":"2024-04-15T00:28:25.457852+0000","last_became_active":"2024-04-15T00:21:07.573469+0000","last_became_peered":"2024-04-15T00:21:07.573469+0000","last_unstale":"2024-04-15T00:28:25.457852+0000","last_undegraded":"2024-04-15T00:28:25.457852+0000","last_fullsized":"2024-04-15T00:28:25.457852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:16:52.647503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'945","reported_seq":967,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.343735+0000","last_change":"2024-04-15T00:21:12.624850+0000","last_active":"2024-04-15T00:31:32.343735+0000","last_peered":"2024-04-15T00:31:32.343735+0000","last_clean":"2024-04-15T00:31:32.343735+0000","last_became_active":"2024-04-15T00:21:12.624484+0000","last_became_peered":"2024-04-15T00:21:12.624484+0000","last_unstale":"2024-04-15T00:31:32.343735+0000","last_undegraded":"2024-04-15T00:31:32.343735+0000","last_fullsized":"2024-04-15T00:31:32.343735+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":945,"log_dups_size":0,"ondisk_log_size":945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:15:08.738300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402666169,"num_objects":101,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4734,"num_write_kb":411824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'15","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.989716+0000","last_change":"2024-04-15T00:21:08.591705+0000","last_active":"2024-04-15T00:31:40.989716+0000","last_peered":"2024-04-15T00:31:40.989716+0000","last_clean":"2024-04-15T00:31:40.989716+0000","last_became_active":"2024-04-15T00:21:08.591407+0000","last_became_peered":"2024-04-15T00:21:08.591407+0000","last_unstale":"2024-04-15T00:31:40.989716+0000","last_undegraded":"2024-04-15T00:31:40.989716+0000","last_fullsized":"2024-04-15T00:31:40.989716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.457818+0000","last_change":"2024-04-15T00:21:07.574971+0000","last_active":"2024-04-15T00:28:25.457818+0000","last_peered":"2024-04-15T00:28:25.457818+0000","last_clean":"2024-04-15T00:28:25.457818+0000","last_became_active":"2024-04-15T00:21:07.574656+0000","last_became_peered":"2024-04-15T00:21:07.574656+0000","last_unstale":"2024-04-15T00:28:25.457818+0000","last_undegraded":"2024-04-15T00:28:25.457818+0000","last_fullsized":"2024-04-15T00:28:25.457818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:21:35.113136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'741","reported_seq":763,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.711934+0000","last_change":"2024-04-15T00:21:12.633646+0000","last_active":"2024-04-15T00:31:32.711934+0000","last_peered":"2024-04-15T00:31:32.711934+0000","last_clean":"2024-04-15T00:31:32.711934+0000","last_became_active":"2024-04-15T00:21:12.633262+0000","last_became_peered":"2024-04-15T00:21:12.633262+0000","last_unstale":"2024-04-15T00:31:32.711934+0000","last_undegraded":"2024-04-15T00:31:32.711934+0000","last_fullsized":"2024-04-15T00:31:32.711934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:26:17.136974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":419466538,"num_objects":105,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3547,"num_write_kb":423381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'1101","reported_seq":1124,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.423734+0000","last_change":"2024-04-15T00:21:12.634552+0000","last_active":"2024-04-15T00:31:30.423734+0000","last_peered":"2024-04-15T00:31:30.423734+0000","last_clean":"2024-04-15T00:31:30.423734+0000","last_became_active":"2024-04-15T00:21:12.633824+0000","last_became_peered":"2024-04-15T00:21:12.633824+0000","last_unstale":"2024-04-15T00:31:30.423734+0000","last_undegraded":"2024-04-15T00:31:30.423734+0000","last_fullsized":"2024-04-15T00:31:30.423734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1101,"log_dups_size":0,"ondisk_log_size":1101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:03:34.506827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482370782,"num_objects":121,"num_object_clones":0,"num_object_copies":484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5837,"num_write_kb":494050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'15","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.007279+0000","last_change":"2024-04-15T00:21:08.577988+0000","last_active":"2024-04-15T00:31:41.007279+0000","last_peered":"2024-04-15T00:31:41.007279+0000","last_clean":"2024-04-15T00:31:41.007279+0000","last_became_active":"2024-04-15T00:21:08.577692+0000","last_became_peered":"2024-04-15T00:21:08.577692+0000","last_unstale":"2024-04-15T00:31:41.007279+0000","last_undegraded":"2024-04-15T00:31:41.007279+0000","last_fullsized":"2024-04-15T00:31:41.007279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:25.457793+0000","last_change":"2024-04-15T00:21:07.563155+0000","last_active":"2024-04-15T00:28:25.457793+0000","last_peered":"2024-04-15T00:28:25.457793+0000","last_clean":"2024-04-15T00:28:25.457793+0000","last_became_active":"2024-04-15T00:21:07.562747+0000","last_became_peered":"2024-04-15T00:21:07.562747+0000","last_unstale":"2024-04-15T00:28:25.457793+0000","last_undegraded":"2024-04-15T00:28:25.457793+0000","last_fullsized":"2024-04-15T00:28:25.457793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:21:35.113136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'958","reported_seq":981,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.212363+0000","last_change":"2024-04-15T00:21:12.624627+0000","last_active":"2024-04-15T00:31:30.212363+0000","last_peered":"2024-04-15T00:31:30.212363+0000","last_clean":"2024-04-15T00:31:30.212363+0000","last_became_active":"2024-04-15T00:21:12.624245+0000","last_became_peered":"2024-04-15T00:21:12.624245+0000","last_unstale":"2024-04-15T00:31:30.212363+0000","last_undegraded":"2024-04-15T00:31:30.212363+0000","last_fullsized":"2024-04-15T00:31:30.212363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":958,"log_dups_size":0,"ondisk_log_size":958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:31.463828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432096512,"num_objects":111,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4784,"num_write_kb":440700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'22","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.002077+0000","last_change":"2024-04-15T00:21:08.590595+0000","last_active":"2024-04-15T00:31:41.002077+0000","last_peered":"2024-04-15T00:31:41.002077+0000","last_clean":"2024-04-15T00:31:41.002077+0000","last_became_active":"2024-04-15T00:21:08.590333+0000","last_became_peered":"2024-04-15T00:21:08.590333+0000","last_unstale":"2024-04-15T00:31:41.002077+0000","last_undegraded":"2024-04-15T00:31:41.002077+0000","last_fullsized":"2024-04-15T00:31:41.002077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:26.450774+0000","last_change":"2024-04-15T00:21:07.576399+0000","last_active":"2024-04-15T00:28:26.450774+0000","last_peered":"2024-04-15T00:28:26.450774+0000","last_clean":"2024-04-15T00:28:26.450774+0000","last_became_active":"2024-04-15T00:21:07.576008+0000","last_became_peered":"2024-04-15T00:21:07.576008+0000","last_unstale":"2024-04-15T00:28:26.450774+0000","last_undegraded":"2024-04-15T00:28:26.450774+0000","last_fullsized":"2024-04-15T00:28:26.450774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:16:52.647503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:28:40.459371+0000","last_change":"2024-04-15T00:21:07.572597+0000","last_active":"2024-04-15T00:28:40.459371+0000","last_peered":"2024-04-15T00:28:40.459371+0000","last_clean":"2024-04-15T00:28:40.459371+0000","last_became_active":"2024-04-15T00:21:07.572273+0000","last_became_peered":"2024-04-15T00:21:07.572273+0000","last_unstale":"2024-04-15T00:28:40.459371+0000","last_undegraded":"2024-04-15T00:28:40.459371+0000","last_fullsized":"2024-04-15T00:28:40.459371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:39:51.874977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'16","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.991746+0000","last_change":"2024-04-15T00:21:08.587210+0000","last_active":"2024-04-15T00:31:40.991746+0000","last_peered":"2024-04-15T00:31:40.991746+0000","last_clean":"2024-04-15T00:31:40.991746+0000","last_became_active":"2024-04-15T00:21:08.586910+0000","last_became_peered":"2024-04-15T00:21:08.586910+0000","last_unstale":"2024-04-15T00:31:40.991746+0000","last_undegraded":"2024-04-15T00:31:40.991746+0000","last_fullsized":"2024-04-15T00:31:40.991746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'803","reported_seq":826,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:30.298609+0000","last_change":"2024-04-15T00:21:12.622128+0000","last_active":"2024-04-15T00:31:30.298609+0000","last_peered":"2024-04-15T00:31:30.298609+0000","last_clean":"2024-04-15T00:31:30.298609+0000","last_became_active":"2024-04-15T00:21:12.621682+0000","last_became_peered":"2024-04-15T00:21:12.621682+0000","last_unstale":"2024-04-15T00:31:30.298609+0000","last_undegraded":"2024-04-15T00:31:30.298609+0000","last_fullsized":"2024-04-15T00:31:30.298609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":803,"log_dups_size":0,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":339750667,"num_objects":83,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4004,"num_write_kb":347535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'636","reported_seq":666,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:29:13.317066+0000","last_change":"2024-04-15T00:21:07.577069+0000","last_active":"2024-04-15T00:29:13.317066+0000","last_peered":"2024-04-15T00:29:13.317066+0000","last_clean":"2024-04-15T00:29:13.317066+0000","last_became_active":"2024-04-15T00:21:07.576791+0000","last_became_peered":"2024-04-15T00:21:07.576791+0000","last_unstale":"2024-04-15T00:29:13.317066+0000","last_undegraded":"2024-04-15T00:29:13.317066+0000","last_fullsized":"2024-04-15T00:29:13.317066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:06.546768+0000","last_clean_scrub_stamp":"2024-04-15T00:21:06.546768+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:36:11.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":636,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'16","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.998181+0000","last_change":"2024-04-15T00:21:08.584214+0000","last_active":"2024-04-15T00:31:40.998181+0000","last_peered":"2024-04-15T00:31:40.998181+0000","last_clean":"2024-04-15T00:31:40.998181+0000","last_became_active":"2024-04-15T00:21:08.583909+0000","last_became_peered":"2024-04-15T00:21:08.583909+0000","last_unstale":"2024-04-15T00:31:40.998181+0000","last_undegraded":"2024-04-15T00:31:40.998181+0000","last_fullsized":"2024-04-15T00:31:40.998181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:34:55.815311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'1057","reported_seq":1079,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:32.450905+0000","last_change":"2024-04-15T00:21:12.624156+0000","last_active":"2024-04-15T00:31:32.450905+0000","last_peered":"2024-04-15T00:31:32.450905+0000","last_clean":"2024-04-15T00:31:32.450905+0000","last_became_active":"2024-04-15T00:21:12.623756+0000","last_became_peered":"2024-04-15T00:21:12.623756+0000","last_unstale":"2024-04-15T00:31:32.450905+0000","last_undegraded":"2024-04-15T00:31:32.450905+0000","last_fullsized":"2024-04-15T00:31:32.450905+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:11.588566+0000","last_clean_scrub_stamp":"2024-04-15T00:21:11.588566+0000","objects_scrubbed":0,"log_size":1057,"log_dups_size":0,"ondisk_log_size":1057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:31:33.202296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":461404378,"num_objects":118,"num_object_clones":0,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5333,"num_write_kb":471487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'16","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.005950+0000","last_change":"2024-04-15T00:21:08.588647+0000","last_active":"2024-04-15T00:31:41.005950+0000","last_peered":"2024-04-15T00:31:41.005950+0000","last_clean":"2024-04-15T00:31:41.005950+0000","last_became_active":"2024-04-15T00:21:08.587719+0000","last_became_peered":"2024-04-15T00:21:08.587719+0000","last_unstale":"2024-04-15T00:31:41.005950+0000","last_undegraded":"2024-04-15T00:31:41.005950+0000","last_fullsized":"2024-04-15T00:31:41.005950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:39.454082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'23","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.996110+0000","last_change":"2024-04-15T00:21:08.596094+0000","last_active":"2024-04-15T00:31:40.996110+0000","last_peered":"2024-04-15T00:31:40.996110+0000","last_clean":"2024-04-15T00:31:40.996110+0000","last_became_active":"2024-04-15T00:21:08.595790+0000","last_became_peered":"2024-04-15T00:21:08.595790+0000","last_unstale":"2024-04-15T00:31:40.996110+0000","last_undegraded":"2024-04-15T00:31:40.996110+0000","last_fullsized":"2024-04-15T00:31:40.996110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'17","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.007584+0000","last_change":"2024-04-15T00:21:08.583148+0000","last_active":"2024-04-15T00:31:41.007584+0000","last_peered":"2024-04-15T00:31:41.007584+0000","last_clean":"2024-04-15T00:31:41.007584+0000","last_became_active":"2024-04-15T00:21:08.582801+0000","last_became_peered":"2024-04-15T00:21:08.582801+0000","last_unstale":"2024-04-15T00:31:41.007584+0000","last_undegraded":"2024-04-15T00:31:41.007584+0000","last_fullsized":"2024-04-15T00:31:41.007584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:01.007313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'16","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.982235+0000","last_change":"2024-04-15T00:21:08.596406+0000","last_active":"2024-04-15T00:31:40.982235+0000","last_peered":"2024-04-15T00:31:40.982235+0000","last_clean":"2024-04-15T00:31:40.982235+0000","last_became_active":"2024-04-15T00:21:08.596144+0000","last_became_peered":"2024-04-15T00:21:08.596144+0000","last_unstale":"2024-04-15T00:31:40.982235+0000","last_undegraded":"2024-04-15T00:31:40.982235+0000","last_fullsized":"2024-04-15T00:31:40.982235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'10","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.007696+0000","last_change":"2024-04-15T00:21:08.591959+0000","last_active":"2024-04-15T00:31:41.007696+0000","last_peered":"2024-04-15T00:31:41.007696+0000","last_clean":"2024-04-15T00:31:41.007696+0000","last_became_active":"2024-04-15T00:21:08.591479+0000","last_became_peered":"2024-04-15T00:21:08.591479+0000","last_unstale":"2024-04-15T00:31:41.007696+0000","last_undegraded":"2024-04-15T00:31:41.007696+0000","last_fullsized":"2024-04-15T00:31:41.007696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'12","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.006398+0000","last_change":"2024-04-15T00:21:08.577658+0000","last_active":"2024-04-15T00:31:41.006398+0000","last_peered":"2024-04-15T00:31:41.006398+0000","last_clean":"2024-04-15T00:31:41.006398+0000","last_became_active":"2024-04-15T00:21:08.577358+0000","last_became_peered":"2024-04-15T00:21:08.577358+0000","last_unstale":"2024-04-15T00:31:41.006398+0000","last_undegraded":"2024-04-15T00:31:41.006398+0000","last_fullsized":"2024-04-15T00:31:41.006398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'20","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.000021+0000","last_change":"2024-04-15T00:21:08.593462+0000","last_active":"2024-04-15T00:31:41.000021+0000","last_peered":"2024-04-15T00:31:41.000021+0000","last_clean":"2024-04-15T00:31:41.000021+0000","last_became_active":"2024-04-15T00:21:08.593174+0000","last_became_peered":"2024-04-15T00:21:08.593174+0000","last_unstale":"2024-04-15T00:31:41.000021+0000","last_undegraded":"2024-04-15T00:31:41.000021+0000","last_fullsized":"2024-04-15T00:31:41.000021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'8","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.007369+0000","last_change":"2024-04-15T00:21:08.582109+0000","last_active":"2024-04-15T00:31:41.007369+0000","last_peered":"2024-04-15T00:31:41.007369+0000","last_clean":"2024-04-15T00:31:41.007369+0000","last_became_active":"2024-04-15T00:21:08.581828+0000","last_became_peered":"2024-04-15T00:21:08.581828+0000","last_unstale":"2024-04-15T00:31:41.007369+0000","last_undegraded":"2024-04-15T00:31:41.007369+0000","last_fullsized":"2024-04-15T00:31:41.007369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:27:01.007313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'13","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.006821+0000","last_change":"2024-04-15T00:21:08.582329+0000","last_active":"2024-04-15T00:31:41.006821+0000","last_peered":"2024-04-15T00:31:41.006821+0000","last_clean":"2024-04-15T00:31:41.006821+0000","last_became_active":"2024-04-15T00:21:08.582011+0000","last_became_peered":"2024-04-15T00:21:08.582011+0000","last_unstale":"2024-04-15T00:31:41.006821+0000","last_undegraded":"2024-04-15T00:31:41.006821+0000","last_fullsized":"2024-04-15T00:31:41.006821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:44:24.498131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'18","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.007214+0000","last_change":"2024-04-15T00:21:08.581215+0000","last_active":"2024-04-15T00:31:41.007214+0000","last_peered":"2024-04-15T00:31:41.007214+0000","last_clean":"2024-04-15T00:31:41.007214+0000","last_became_active":"2024-04-15T00:21:08.579860+0000","last_became_peered":"2024-04-15T00:21:08.579860+0000","last_unstale":"2024-04-15T00:31:41.007214+0000","last_undegraded":"2024-04-15T00:31:41.007214+0000","last_fullsized":"2024-04-15T00:31:41.007214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'18","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.992439+0000","last_change":"2024-04-15T00:21:08.592785+0000","last_active":"2024-04-15T00:31:40.992439+0000","last_peered":"2024-04-15T00:31:40.992439+0000","last_clean":"2024-04-15T00:31:40.992439+0000","last_became_active":"2024-04-15T00:21:08.592110+0000","last_became_peered":"2024-04-15T00:21:08.592110+0000","last_unstale":"2024-04-15T00:31:40.992439+0000","last_undegraded":"2024-04-15T00:31:40.992439+0000","last_fullsized":"2024-04-15T00:31:40.992439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:31:45.258841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'21","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.010693+0000","last_change":"2024-04-15T00:21:08.599781+0000","last_active":"2024-04-15T00:31:41.010693+0000","last_peered":"2024-04-15T00:31:41.010693+0000","last_clean":"2024-04-15T00:31:41.010693+0000","last_became_active":"2024-04-15T00:21:08.599460+0000","last_became_peered":"2024-04-15T00:21:08.599460+0000","last_unstale":"2024-04-15T00:31:41.010693+0000","last_undegraded":"2024-04-15T00:31:41.010693+0000","last_fullsized":"2024-04-15T00:31:41.010693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:39.454082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'15","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.001054+0000","last_change":"2024-04-15T00:21:08.588233+0000","last_active":"2024-04-15T00:31:41.001054+0000","last_peered":"2024-04-15T00:31:41.001054+0000","last_clean":"2024-04-15T00:31:41.001054+0000","last_became_active":"2024-04-15T00:21:08.586235+0000","last_became_peered":"2024-04-15T00:21:08.586235+0000","last_unstale":"2024-04-15T00:31:41.001054+0000","last_undegraded":"2024-04-15T00:31:41.001054+0000","last_fullsized":"2024-04-15T00:31:41.001054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:57.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'17","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.001453+0000","last_change":"2024-04-15T00:21:08.582000+0000","last_active":"2024-04-15T00:31:41.001453+0000","last_peered":"2024-04-15T00:31:41.001453+0000","last_clean":"2024-04-15T00:31:41.001453+0000","last_became_active":"2024-04-15T00:21:08.581714+0000","last_became_peered":"2024-04-15T00:21:08.581714+0000","last_unstale":"2024-04-15T00:31:41.001453+0000","last_undegraded":"2024-04-15T00:31:41.001453+0000","last_fullsized":"2024-04-15T00:31:41.001453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:27.427117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'21","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.994251+0000","last_change":"2024-04-15T00:21:08.582994+0000","last_active":"2024-04-15T00:31:40.994251+0000","last_peered":"2024-04-15T00:31:40.994251+0000","last_clean":"2024-04-15T00:31:40.994251+0000","last_became_active":"2024-04-15T00:21:08.582594+0000","last_became_peered":"2024-04-15T00:21:08.582594+0000","last_unstale":"2024-04-15T00:31:40.994251+0000","last_undegraded":"2024-04-15T00:31:40.994251+0000","last_fullsized":"2024-04-15T00:31:40.994251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'14","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.991543+0000","last_change":"2024-04-15T00:21:08.591937+0000","last_active":"2024-04-15T00:31:40.991543+0000","last_peered":"2024-04-15T00:31:40.991543+0000","last_clean":"2024-04-15T00:31:40.991543+0000","last_became_active":"2024-04-15T00:21:08.591655+0000","last_became_peered":"2024-04-15T00:21:08.591655+0000","last_unstale":"2024-04-15T00:31:40.991543+0000","last_undegraded":"2024-04-15T00:31:40.991543+0000","last_fullsized":"2024-04-15T00:31:40.991543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:21:59.995077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'15","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.004065+0000","last_change":"2024-04-15T00:21:49.707724+0000","last_active":"2024-04-15T00:31:41.004065+0000","last_peered":"2024-04-15T00:31:41.004065+0000","last_clean":"2024-04-15T00:31:41.004065+0000","last_became_active":"2024-04-15T00:21:49.707397+0000","last_became_peered":"2024-04-15T00:21:49.707397+0000","last_unstale":"2024-04-15T00:31:41.004065+0000","last_undegraded":"2024-04-15T00:31:41.004065+0000","last_fullsized":"2024-04-15T00:31:41.004065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"27'16","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.986058+0000","last_change":"2024-04-15T00:21:08.581452+0000","last_active":"2024-04-15T00:31:40.986058+0000","last_peered":"2024-04-15T00:31:40.986058+0000","last_clean":"2024-04-15T00:31:40.986058+0000","last_became_active":"2024-04-15T00:21:08.580967+0000","last_became_peered":"2024-04-15T00:21:08.580967+0000","last_unstale":"2024-04-15T00:31:40.986058+0000","last_undegraded":"2024-04-15T00:31:40.986058+0000","last_fullsized":"2024-04-15T00:31:40.986058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:53:43.094738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'16","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.999173+0000","last_change":"2024-04-15T00:21:08.587249+0000","last_active":"2024-04-15T00:31:40.999173+0000","last_peered":"2024-04-15T00:31:40.999173+0000","last_clean":"2024-04-15T00:31:40.999173+0000","last_became_active":"2024-04-15T00:21:08.586885+0000","last_became_peered":"2024-04-15T00:21:08.586885+0000","last_unstale":"2024-04-15T00:31:40.999173+0000","last_undegraded":"2024-04-15T00:31:40.999173+0000","last_fullsized":"2024-04-15T00:31:40.999173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:44:31.020890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'17","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.001987+0000","last_change":"2024-04-15T00:21:08.579970+0000","last_active":"2024-04-15T00:31:41.001987+0000","last_peered":"2024-04-15T00:31:41.001987+0000","last_clean":"2024-04-15T00:31:41.001987+0000","last_became_active":"2024-04-15T00:21:08.579652+0000","last_became_peered":"2024-04-15T00:21:08.579652+0000","last_unstale":"2024-04-15T00:31:41.001987+0000","last_undegraded":"2024-04-15T00:31:41.001987+0000","last_fullsized":"2024-04-15T00:31:41.001987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:10:24.477646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'13","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.990451+0000","last_change":"2024-04-15T00:21:08.588376+0000","last_active":"2024-04-15T00:31:40.990451+0000","last_peered":"2024-04-15T00:31:40.990451+0000","last_clean":"2024-04-15T00:31:40.990451+0000","last_became_active":"2024-04-15T00:21:08.587712+0000","last_became_peered":"2024-04-15T00:21:08.587712+0000","last_unstale":"2024-04-15T00:31:40.990451+0000","last_undegraded":"2024-04-15T00:31:40.990451+0000","last_fullsized":"2024-04-15T00:31:40.990451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:34:27.330682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'17","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.000650+0000","last_change":"2024-04-15T00:21:08.597204+0000","last_active":"2024-04-15T00:31:41.000650+0000","last_peered":"2024-04-15T00:31:41.000650+0000","last_clean":"2024-04-15T00:31:41.000650+0000","last_became_active":"2024-04-15T00:21:08.596862+0000","last_became_peered":"2024-04-15T00:21:08.596862+0000","last_unstale":"2024-04-15T00:31:41.000650+0000","last_undegraded":"2024-04-15T00:31:41.000650+0000","last_fullsized":"2024-04-15T00:31:41.000650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:20:28.767963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'24","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.003879+0000","last_change":"2024-04-15T00:21:08.598199+0000","last_active":"2024-04-15T00:31:41.003879+0000","last_peered":"2024-04-15T00:31:41.003879+0000","last_clean":"2024-04-15T00:31:41.003879+0000","last_became_active":"2024-04-15T00:21:08.597790+0000","last_became_peered":"2024-04-15T00:21:08.597790+0000","last_unstale":"2024-04-15T00:31:41.003879+0000","last_undegraded":"2024-04-15T00:31:41.003879+0000","last_fullsized":"2024-04-15T00:31:41.003879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:13:09.275790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'21","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.004781+0000","last_change":"2024-04-15T00:21:08.600496+0000","last_active":"2024-04-15T00:31:41.004781+0000","last_peered":"2024-04-15T00:31:41.004781+0000","last_clean":"2024-04-15T00:31:41.004781+0000","last_became_active":"2024-04-15T00:21:08.600121+0000","last_became_peered":"2024-04-15T00:21:08.600121+0000","last_unstale":"2024-04-15T00:31:41.004781+0000","last_undegraded":"2024-04-15T00:31:41.004781+0000","last_fullsized":"2024-04-15T00:31:41.004781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:11:12.071153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'12","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.006063+0000","last_change":"2024-04-15T00:21:08.583866+0000","last_active":"2024-04-15T00:31:41.006063+0000","last_peered":"2024-04-15T00:31:41.006063+0000","last_clean":"2024-04-15T00:31:41.006063+0000","last_became_active":"2024-04-15T00:21:08.583563+0000","last_became_peered":"2024-04-15T00:21:08.583563+0000","last_unstale":"2024-04-15T00:31:41.006063+0000","last_undegraded":"2024-04-15T00:31:41.006063+0000","last_fullsized":"2024-04-15T00:31:41.006063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:27:41.268464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'8","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.008979+0000","last_change":"2024-04-15T00:21:08.596983+0000","last_active":"2024-04-15T00:31:41.008979+0000","last_peered":"2024-04-15T00:31:41.008979+0000","last_clean":"2024-04-15T00:31:41.008979+0000","last_became_active":"2024-04-15T00:21:08.596640+0000","last_became_peered":"2024-04-15T00:21:08.596640+0000","last_unstale":"2024-04-15T00:31:41.008979+0000","last_undegraded":"2024-04-15T00:31:41.008979+0000","last_fullsized":"2024-04-15T00:31:41.008979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:40.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'14","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.001646+0000","last_change":"2024-04-15T00:21:08.593027+0000","last_active":"2024-04-15T00:31:41.001646+0000","last_peered":"2024-04-15T00:31:41.001646+0000","last_clean":"2024-04-15T00:31:41.001646+0000","last_became_active":"2024-04-15T00:21:08.592476+0000","last_became_peered":"2024-04-15T00:21:08.592476+0000","last_unstale":"2024-04-15T00:31:41.001646+0000","last_undegraded":"2024-04-15T00:31:41.001646+0000","last_fullsized":"2024-04-15T00:31:41.001646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:10:24.477646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'9","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.001209+0000","last_change":"2024-04-15T00:21:08.591419+0000","last_active":"2024-04-15T00:31:41.001209+0000","last_peered":"2024-04-15T00:31:41.001209+0000","last_clean":"2024-04-15T00:31:41.001209+0000","last_became_active":"2024-04-15T00:21:08.591101+0000","last_became_peered":"2024-04-15T00:21:08.591101+0000","last_unstale":"2024-04-15T00:31:41.001209+0000","last_undegraded":"2024-04-15T00:31:41.001209+0000","last_fullsized":"2024-04-15T00:31:41.001209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:52:10.558592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'11","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.007363+0000","last_change":"2024-04-15T00:21:08.581621+0000","last_active":"2024-04-15T00:31:41.007363+0000","last_peered":"2024-04-15T00:31:41.007363+0000","last_clean":"2024-04-15T00:31:41.007363+0000","last_became_active":"2024-04-15T00:21:08.581316+0000","last_became_peered":"2024-04-15T00:21:08.581316+0000","last_unstale":"2024-04-15T00:31:41.007363+0000","last_undegraded":"2024-04-15T00:31:41.007363+0000","last_fullsized":"2024-04-15T00:31:41.007363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:08:27.427117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'14","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.995218+0000","last_change":"2024-04-15T00:21:08.590252+0000","last_active":"2024-04-15T00:31:40.995218+0000","last_peered":"2024-04-15T00:31:40.995218+0000","last_clean":"2024-04-15T00:31:40.995218+0000","last_became_active":"2024-04-15T00:21:08.589919+0000","last_became_peered":"2024-04-15T00:21:08.589919+0000","last_unstale":"2024-04-15T00:31:40.995218+0000","last_undegraded":"2024-04-15T00:31:40.995218+0000","last_fullsized":"2024-04-15T00:31:40.995218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:46:53.537904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'6","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:40.995528+0000","last_change":"2024-04-15T00:21:08.588530+0000","last_active":"2024-04-15T00:31:40.995528+0000","last_peered":"2024-04-15T00:31:40.995528+0000","last_clean":"2024-04-15T00:31:40.995528+0000","last_became_active":"2024-04-15T00:21:08.588208+0000","last_became_peered":"2024-04-15T00:21:08.588208+0000","last_unstale":"2024-04-15T00:31:40.995528+0000","last_undegraded":"2024-04-15T00:31:40.995528+0000","last_fullsized":"2024-04-15T00:31:40.995528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:08.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'13","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:41.002813+0000","last_change":"2024-04-15T00:21:08.588469+0000","last_active":"2024-04-15T00:31:41.002813+0000","last_peered":"2024-04-15T00:31:41.002813+0000","last_clean":"2024-04-15T00:31:41.002813+0000","last_became_active":"2024-04-15T00:21:08.587646+0000","last_became_peered":"2024-04-15T00:21:08.587646+0000","last_unstale":"2024-04-15T00:31:41.002813+0000","last_undegraded":"2024-04-15T00:31:41.002813+0000","last_fullsized":"2024-04-15T00:31:41.002813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:21:07.551856+0000","last_clean_scrub_stamp":"2024-04-15T00:21:07.551856+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:52:27.105666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":13424233995,"num_objects":3390,"num_object_clones":0,"num_object_copies":13560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3390,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148702,"num_write_kb":13691509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26850476032,"data_stored":26850476032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29948,"ondisk_log_size":29948,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":953,"ondisk_log_size":953,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":11475904,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":36,"num_read_kb":72,"num_write":2546,"num_write_kb":11997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":23011328,"data_stored":22951808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2210,"ondisk_log_size":2210,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542277,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4663072,"kb_used_data":4365464,"kb_used_omap":1,"kb_used_meta":297598,"kb_avail":89708768,"statfs":{"total":96636764160,"available":91861778432,"internally_reserved":0,"allocated":4470235136,"data_stored":4470056729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":304740807},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542278,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2797748,"kb_used_data":2626412,"kb_used_omap":1,"kb_used_meta":171326,"kb_avail":91574092,"statfs":{"total":96636764160,"available":93771870208,"internally_reserved":0,"allocated":2689445888,"data_stored":2689275001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":175438277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542277,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3076828,"kb_used_data":2887444,"kb_used_omap":1,"kb_used_meta":189374,"kb_avail":91295012,"statfs":{"total":96636764160,"available":93486092288,"internally_reserved":0,"allocated":2956742656,"data_stored":2956558926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":193919429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574982,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3118532,"kb_used_data":2920828,"kb_used_omap":1,"kb_used_meta":197694,"kb_avail":91253308,"statfs":{"total":96636764160,"available":93443387392,"internally_reserved":0,"allocated":2990927872,"data_stored":2990752079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":202439114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574982,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3681748,"kb_used_data":3443788,"kb_used_omap":1,"kb_used_meta":237950,"kb_avail":90690092,"statfs":{"total":96636764160,"available":92866654208,"internally_reserved":0,"allocated":3526438912,"data_stored":3526262864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":243661254},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574981,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2562512,"kb_used_data":2382856,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":91809328,"statfs":{"total":96636764160,"available":94012751872,"internally_reserved":0,"allocated":2440044544,"data_stored":2439872010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574981,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3506684,"kb_used_data":3268724,"kb_used_omap":1,"kb_used_meta":237950,"kb_avail":90865156,"statfs":{"total":96636764160,"available":93045919744,"internally_reserved":0,"allocated":3347173376,"data_stored":3346992487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243661253},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574981,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4647724,"kb_used_data":4351524,"kb_used_omap":1,"kb_used_meta":296190,"kb_avail":89724116,"statfs":{"total":96636764160,"available":91877494784,"internally_reserved":0,"allocated":4455960576,"data_stored":4455784016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":303299014},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":50889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8450048,"data_stored":8440169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3047424,"data_stored":3035063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7233536,"data_stored":7229823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2955849728,"data_stored":2955849728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4455665664,"data_stored":4455665664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2689105920,"data_stored":2689105920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4461498368,"data_stored":4461498368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3343839232,"data_stored":3343839232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2439753728,"data_stored":2439753728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3521949696,"data_stored":3521949696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2982813696,"data_stored":2982813696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T00:31:48.345 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-15T00:21:06.546768+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=6, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.345 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.345 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.345 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-15T00:21:06.546768+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=6, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.346 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.346 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.346 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-15T00:21:06.546768+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=6, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.346 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.346 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.346 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-15T00:21:06.546768+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=6, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.347 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.347 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.347 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.347 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-15T00:21:06.546768+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=6, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.347 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.347 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.347 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-15T00:21:06.546768+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=6, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.348 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.348 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.348 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-15T00:21:06.546768+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=6, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.348 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.348 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.348 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-15T00:21:06.546768+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=6, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.349 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.349 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.349 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-15T00:21:06.546768+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=6, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.349 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.349 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.350 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-15T00:21:06.546768+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=6, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.350 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.350 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.350 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-15T00:21:06.546768+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=6, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.350 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.353 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.353 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-15T00:21:06.546768+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=6, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.354 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.354 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.354 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-15T00:21:06.546768+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=6, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.354 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.354 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.354 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.355 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.355 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-15T00:21:06.546768+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=6, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.355 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.355 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.355 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-15T00:21:06.546768+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=6, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.355 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-15T00:20:56.517419+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=20, tm_sec=56, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.356 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.356 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.356 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-15T00:21:06.546768+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=6, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.356 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.356 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.356 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-15T00:21:06.546768+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=6, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.356 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.357 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.357 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-15T00:21:06.546768+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=6, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.357 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.357 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.357 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-15T00:21:06.546768+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=6, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.357 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.358 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.358 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-15T00:21:06.546768+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=6, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.358 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.358 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.358 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-15T00:21:06.546768+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=6, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.358 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.359 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.359 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-15T00:21:06.546768+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=6, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.359 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.359 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.359 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-04-15T00:21:06.546768+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=6, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.359 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.359 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.360 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-15T00:21:06.546768+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=6, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.360 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.360 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.360 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-15T00:21:06.546768+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=6, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.360 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.360 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.361 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-15T00:21:06.546768+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=6, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.361 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.361 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.361 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-15T00:21:06.546768+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=6, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.361 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.361 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.362 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.362 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-15T00:21:06.546768+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=6, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.362 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.362 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.362 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-15T00:21:06.546768+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=6, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.362 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-15T00:21:06.546768+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=6, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.363 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.363 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.363 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-15T00:21:06.546768+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=6, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.363 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.363 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-15T00:21:11.588566+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.363 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.364 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.364 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.364 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.364 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.364 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.364 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.364 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.365 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.365 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.365 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.365 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.365 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.366 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.366 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.366 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.366 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.366 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.366 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.367 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.367 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.367 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.367 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.367 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.367 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.368 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.368 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.368 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.368 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.368 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.368 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.368 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-15T00:21:07.551856+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=21, tm_sec=7, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=31, tm_sec=43, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T00:31:48.369 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-15T00:32:08.370 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T00:32:08.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.477+0000 7fe5e6f1e640 1 Processor -- start 2024-04-15T00:32:08.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.477+0000 7fe5e6f1e640 1 -- start start 2024-04-15T00:32:08.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.477+0000 7fe5e6f1e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe5e0067180 0x7fe5e00b0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:08.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.477+0000 7fe5e6f1e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe5e00b4c20 0x7fe5e00af930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:08.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.477+0000 7fe5e6f1e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5e0067560 con 0x7fe5e006b200 2024-04-15T00:32:08.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.477+0000 7fe5e6f1e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fe5e00b50b0 con 0x7fe5e0067180 2024-04-15T00:32:08.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.477+0000 7fe5e6f1e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe5e00af1d0 con 0x7fe5e00b4c20 2024-04-15T00:32:08.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.478+0000 7fe5e4cba640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe5e0067180 0x7fe5e00b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:08.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.478+0000 7fe5e54bb640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe5e006b200 0x7fe5e006b690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53676/0 (socket says 172.21.15.31:53676) 2024-04-15T00:32:08.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.478+0000 7fe5e54bb640 1 -- 172.21.15.31:0/3922162368 learned_addr learned my addr 172.21.15.31:0/3922162368 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:32:08.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.478+0000 7fe5dffff640 1 --2- 172.21.15.31:0/3922162368 >> v2:172.21.15.50:3300/0 conn(0x7fe5e00b4c20 0x7fe5e00af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:08.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.478+0000 7fe5e4cba640 1 -- 172.21.15.31:0/3922162368 >> v2:172.21.15.50:3300/0 conn(0x7fe5e00b4c20 msgr2=0x7fe5e00af930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:32:08.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.478+0000 7fe5e4cba640 1 --2- 172.21.15.31:0/3922162368 >> v2:172.21.15.50:3300/0 conn(0x7fe5e00b4c20 0x7fe5e00af930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:08.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.478+0000 7fe5e4cba640 1 -- 172.21.15.31:0/3922162368 >> v1:172.21.15.31:6789/0 conn(0x7fe5e006b200 legacy=0x7fe5e006b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:08.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.478+0000 7fe5e4cba640 1 -- 172.21.15.31:0/3922162368 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e009f250 con 0x7fe5e0067180 2024-04-15T00:32:08.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.478+0000 7fe5dffff640 1 --2- 172.21.15.31:0/3922162368 >> v2:172.21.15.50:3300/0 conn(0x7fe5e00b4c20 0x7fe5e00af930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:32:08.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.479+0000 7fe5e4cba640 1 --2- 172.21.15.31:0/3922162368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5e0067180 0x7fe5e00b0590 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe5e00bac10 tx=0x7fe5d402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f3bb2f1d3d4541d server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:32:08.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.479+0000 7fe5df7fe640 1 -- 172.21.15.31:0/3922162368 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d40315a0 con 0x7fe5e0067180 2024-04-15T00:32:08.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.479+0000 7fe5df7fe640 1 -- 172.21.15.31:0/3922162368 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5d4037070 con 0x7fe5e0067180 2024-04-15T00:32:08.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.479+0000 7fe5df7fe640 1 -- 172.21.15.31:0/3922162368 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4031960 con 0x7fe5e0067180 2024-04-15T00:32:08.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.479+0000 7fe5e6f1e640 1 -- 172.21.15.31:0/3922162368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5e0067180 msgr2=0x7fe5e00b0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:08.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.479+0000 7fe5e6f1e640 1 --2- 172.21.15.31:0/3922162368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5e0067180 0x7fe5e00b0590 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe5e00bac10 tx=0x7fe5d402b840 comp rx=0 tx=0).stop 2024-04-15T00:32:08.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.479+0000 7fe5e6f1e640 1 -- 172.21.15.31:0/3922162368 shutdown_connections 2024-04-15T00:32:08.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.479+0000 7fe5e6f1e640 1 --2- 172.21.15.31:0/3922162368 >> v2:172.21.15.50:3300/0 conn(0x7fe5e00b4c20 0x7fe5e00af930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:08.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.479+0000 7fe5e6f1e640 1 --2- 172.21.15.31:0/3922162368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5e0067180 0x7fe5e00b0590 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:08.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.479+0000 7fe5e6f1e640 1 -- 172.21.15.31:0/3922162368 >> 172.21.15.31:0/3922162368 conn(0x7fe5e00b6640 msgr2=0x7fe5e00b6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:32:08.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.479+0000 7fe5e6f1e640 1 -- 172.21.15.31:0/3922162368 shutdown_connections 2024-04-15T00:32:08.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.479+0000 7fe5e6f1e640 1 -- 172.21.15.31:0/3922162368 wait complete. 2024-04-15T00:32:08.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.480+0000 7fe5e6f1e640 1 Processor -- start 2024-04-15T00:32:08.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.480+0000 7fe5e6f1e640 1 -- start start 2024-04-15T00:32:08.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.481+0000 7fe5e6f1e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5e0067180 0x7fe5e00b3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:08.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.481+0000 7fe5e6f1e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5e006b200 0x7fe5e01dd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:08.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.481+0000 7fe5e6f1e640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe5e00b4c20 0x7fe5e01e0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:08.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.481+0000 7fe5e6f1e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e00b5be0 con 0x7fe5e006b200 2024-04-15T00:32:08.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.481+0000 7fe5e6f1e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e00b5a60 con 0x7fe5e0067180 2024-04-15T00:32:08.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.481+0000 7fe5e6f1e640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fe5e006bda0 con 0x7fe5e00b4c20 2024-04-15T00:32:08.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.481+0000 7fe5dffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5e006b200 0x7fe5e01dd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:08.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.481+0000 7fe5dffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5e006b200 0x7fe5e01dd3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54898/0 (socket says 172.21.15.31:54898) 2024-04-15T00:32:08.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.481+0000 7fe5dffff640 1 -- 172.21.15.31:0/3091935463 learned_addr learned my addr 172.21.15.31:0/3091935463 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:32:08.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.481+0000 7fe5e4cba640 1 --2- 172.21.15.31:0/3091935463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5e0067180 0x7fe5e00b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:08.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.482+0000 7fe5e54bb640 1 --2- 172.21.15.31:0/3091935463 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe5e00b4c20 0x7fe5e01e0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:08.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.482+0000 7fe5dffff640 1 -- 172.21.15.31:0/3091935463 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe5e00b4c20 msgr2=0x7fe5e01e0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:08.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.482+0000 7fe5dffff640 1 --2- 172.21.15.31:0/3091935463 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe5e00b4c20 0x7fe5e01e0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:08.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.482+0000 7fe5dffff640 1 -- 172.21.15.31:0/3091935463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5e0067180 msgr2=0x7fe5e00b3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:08.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.482+0000 7fe5dffff640 1 --2- 172.21.15.31:0/3091935463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5e0067180 0x7fe5e00b3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:08.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.482+0000 7fe5dffff640 1 -- 172.21.15.31:0/3091935463 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e01cd990 con 0x7fe5e006b200 2024-04-15T00:32:08.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.482+0000 7fe5e4cba640 1 --2- 172.21.15.31:0/3091935463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5e0067180 0x7fe5e00b3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:32:08.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.482+0000 7fe5dffff640 1 --2- 172.21.15.31:0/3091935463 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5e006b200 0x7fe5e01dd3b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc00d7d0 tx=0x7fe5cc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:32:08.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.482+0000 7fe5dd7fa640 1 -- 172.21.15.31:0/3091935463 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc004030 con 0x7fe5e006b200 2024-04-15T00:32:08.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.482+0000 7fe5dd7fa640 1 -- 172.21.15.31:0/3091935463 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5cc0041d0 con 0x7fe5e006b200 2024-04-15T00:32:08.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.482+0000 7fe5e6f1e640 1 -- 172.21.15.31:0/3091935463 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5e01cfb70 con 0x7fe5e006b200 2024-04-15T00:32:08.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.482+0000 7fe5dd7fa640 1 -- 172.21.15.31:0/3091935463 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc00b6c0 con 0x7fe5e006b200 2024-04-15T00:32:08.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.482+0000 7fe5e6f1e640 1 -- 172.21.15.31:0/3091935463 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5e01cdd90 con 0x7fe5e006b200 2024-04-15T00:32:08.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.483+0000 7fe5e6f1e640 1 -- 172.21.15.31:0/3091935463 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5e01ce730 con 0x7fe5e006b200 2024-04-15T00:32:08.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.483+0000 7fe5dd7fa640 1 -- 172.21.15.31:0/3091935463 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fe5cc00b860 con 0x7fe5e006b200 2024-04-15T00:32:08.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.484+0000 7fe5dd7fa640 1 --2- 172.21.15.31:0/3091935463 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe5c406b990 0x7fe5c406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:08.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.484+0000 7fe5dd7fa640 1 -- 172.21.15.31:0/3091935463 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fe5cc08aec0 con 0x7fe5e006b200 2024-04-15T00:32:08.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.484+0000 7fe5e4cba640 1 --2- 172.21.15.31:0/3091935463 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe5c406b990 0x7fe5c406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:08.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.484+0000 7fe5e4cba640 1 --2- 172.21.15.31:0/3091935463 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe5c406b990 0x7fe5c406de50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4036000 tx=0x7fe5d403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:32:08.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.489+0000 7fe5dd7fa640 1 -- 172.21.15.31:0/3091935463 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe5cc0596c0 con 0x7fe5e006b200 2024-04-15T00:32:08.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.669+0000 7fe5e6f1e640 1 -- 172.21.15.31:0/3091935463 --> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe5e009f7c0 con 0x7fe5c406b990 2024-04-15T00:32:08.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.677+0000 7fe5dd7fa640 1 -- 172.21.15.31:0/3091935463 <== mgr.4107 v2:172.21.15.31:6832/915470279 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334999 (secure 0 0 0) 0x7fe5e009f7c0 con 0x7fe5c406b990 2024-04-15T00:32:08.691 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:32:08.693 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-15T00:32:08.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.680+0000 7fe5e6f1e640 1 -- 172.21.15.31:0/3091935463 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe5c406b990 msgr2=0x7fe5c406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:08.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.680+0000 7fe5e6f1e640 1 --2- 172.21.15.31:0/3091935463 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe5c406b990 0x7fe5c406de50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4036000 tx=0x7fe5d403d040 comp rx=0 tx=0).stop 2024-04-15T00:32:08.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.680+0000 7fe5e6f1e640 1 -- 172.21.15.31:0/3091935463 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5e006b200 msgr2=0x7fe5e01dd3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:08.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.680+0000 7fe5e6f1e640 1 --2- 172.21.15.31:0/3091935463 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5e006b200 0x7fe5e01dd3b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc00d7d0 tx=0x7fe5cc00dc90 comp rx=0 tx=0).stop 2024-04-15T00:32:08.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.680+0000 7fe5e6f1e640 1 -- 172.21.15.31:0/3091935463 shutdown_connections 2024-04-15T00:32:08.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.680+0000 7fe5e6f1e640 1 --2- 172.21.15.31:0/3091935463 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe5c406b990 0x7fe5c406de50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:08.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.680+0000 7fe5e6f1e640 1 --2- 172.21.15.31:0/3091935463 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe5e00b4c20 0x7fe5e01e0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:08.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.680+0000 7fe5e6f1e640 1 --2- 172.21.15.31:0/3091935463 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5e006b200 0x7fe5e01dd3b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:08.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.680+0000 7fe5e6f1e640 1 --2- 172.21.15.31:0/3091935463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5e0067180 0x7fe5e00b3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:08.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.680+0000 7fe5e6f1e640 1 -- 172.21.15.31:0/3091935463 >> 172.21.15.31:0/3091935463 conn(0x7fe5e00b6640 msgr2=0x7fe5e006d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:32:08.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.680+0000 7fe5e6f1e640 1 -- 172.21.15.31:0/3091935463 shutdown_connections 2024-04-15T00:32:08.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.680+0000 7fe5e6f1e640 1 -- 172.21.15.31:0/3091935463 wait complete. 2024-04-15T00:32:08.699 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":357,"stamp":"2024-04-15T00:32:08.537825+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":13436312301,"num_objects":3426,"num_object_clones":0,"num_object_copies":13632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3426,"num_whiteouts":0,"num_read":152,"num_read_kb":172,"num_write":151414,"num_write_kb":13705938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":56930,"num_omap_keys":112,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33267,"ondisk_log_size":33267,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":28038232,"kb_used_data":26247064,"kb_used_omap":12,"kb_used_meta":1791091,"kb_avail":726936488,"statfs":{"total":773094113280,"available":744382963712,"internally_reserved":0,"allocated":26876993536,"data_stored":26875578180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1834077745},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5626,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003077"},"pg_stats":[{"pgid":"2.1f","version":"27'8","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:45.896267+0000","last_change":"2024-04-15T00:31:45.896314+0000","last_active":"2024-04-15T00:31:45.896267+0000","last_peered":"2024-04-15T00:31:45.896267+0000","last_clean":"2024-04-15T00:31:45.896267+0000","last_became_active":"2024-04-15T00:21:07.576921+0000","last_became_peered":"2024-04-15T00:21:07.576921+0000","last_unstale":"2024-04-15T00:31:45.896267+0000","last_undegraded":"2024-04-15T00:31:45.896267+0000","last_fullsized":"2024-04-15T00:31:45.896267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-15T00:31:45.896186+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-15T00:31:45.896186+0000","last_clean_scrub_stamp":"2024-04-15T00:31:45.896186+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:37:41.938562+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7112,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'8","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:55.504969+0000","last_change":"2024-04-15T00:31:55.505010+0000","last_active":"2024-04-15T00:31:55.504969+0000","last_peered":"2024-04-15T00:31:55.504969+0000","last_clean":"2024-04-15T00:31:55.504969+0000","last_became_active":"2024-04-15T00:21:08.579545+0000","last_became_peered":"2024-04-15T00:21:08.579545+0000","last_unstale":"2024-04-15T00:31:55.504969+0000","last_undegraded":"2024-04-15T00:31:55.504969+0000","last_fullsized":"2024-04-15T00:31:55.504969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-15T00:31:55.504854+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-15T00:31:55.504854+0000","last_clean_scrub_stamp":"2024-04-15T00:31:55.504854+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:36:25.591745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'1071","reported_seq":1106,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:32:04.951398+0000","last_change":"2024-04-15T00:32:04.951440+0000","last_active":"2024-04-15T00:32:04.951398+0000","last_peered":"2024-04-15T00:32:04.951398+0000","last_clean":"2024-04-15T00:32:04.951398+0000","last_became_active":"2024-04-15T00:21:12.633323+0000","last_became_peered":"2024-04-15T00:21:12.633323+0000","last_unstale":"2024-04-15T00:32:04.951398+0000","last_undegraded":"2024-04-15T00:32:04.951398+0000","last_fullsized":"2024-04-15T00:32:04.951398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1071","last_scrub_stamp":"2024-04-15T00:32:04.951312+0000","last_deep_scrub":"27'1071","last_deep_scrub_stamp":"2024-04-15T00:32:04.951312+0000","last_clean_scrub_stamp":"2024-04-15T00:32:04.951312+0000","objects_scrubbed":114,"log_size":1071,"log_dups_size":0,"ondisk_log_size":1071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:34:04.343684+0000","scrub_duration":474,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444643618,"num_objects":114,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5549,"num_write_kb":456057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:50.395958+0000","last_change":"2024-04-15T00:31:50.395986+0000","last_active":"2024-04-15T00:31:50.395958+0000","last_peered":"2024-04-15T00:31:50.395958+0000","last_clean":"2024-04-15T00:31:50.395958+0000","last_became_active":"2024-04-15T00:21:07.568724+0000","last_became_peered":"2024-04-15T00:21:07.568724+0000","last_unstale":"2024-04-15T00:31:50.395958+0000","last_undegraded":"2024-04-15T00:31:50.395958+0000","last_fullsized":"2024-04-15T00:31:50.395958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-04-15T00:31:50.395867+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-04-15T00:31:50.395867+0000","last_clean_scrub_stamp":"2024-04-15T00:31:50.395867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:45:27.050464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'12","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:52.942431+0000","last_change":"2024-04-15T00:31:52.942453+0000","last_active":"2024-04-15T00:31:52.942431+0000","last_peered":"2024-04-15T00:31:52.942431+0000","last_clean":"2024-04-15T00:31:52.942431+0000","last_became_active":"2024-04-15T00:21:08.597625+0000","last_became_peered":"2024-04-15T00:21:08.597625+0000","last_unstale":"2024-04-15T00:31:52.942431+0000","last_undegraded":"2024-04-15T00:31:52.942431+0000","last_fullsized":"2024-04-15T00:31:52.942431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-04-15T00:31:52.942361+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-04-15T00:31:52.942361+0000","last_clean_scrub_stamp":"2024-04-15T00:31:52.942361+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:28:36.169288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'864","reported_seq":899,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:58.600866+0000","last_change":"2024-04-15T00:31:58.600902+0000","last_active":"2024-04-15T00:31:58.600866+0000","last_peered":"2024-04-15T00:31:58.600866+0000","last_clean":"2024-04-15T00:31:58.600866+0000","last_became_active":"2024-04-15T00:21:12.624222+0000","last_became_peered":"2024-04-15T00:21:12.624222+0000","last_unstale":"2024-04-15T00:31:58.600866+0000","last_undegraded":"2024-04-15T00:31:58.600866+0000","last_fullsized":"2024-04-15T00:31:58.600866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'864","last_scrub_stamp":"2024-04-15T00:31:58.600781+0000","last_deep_scrub":"27'864","last_deep_scrub_stamp":"2024-04-15T00:31:58.600781+0000","last_clean_scrub_stamp":"2024-04-15T00:31:58.600781+0000","objects_scrubbed":108,"log_size":864,"log_dups_size":0,"ondisk_log_size":864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:09:46.036213+0000","scrub_duration":595,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432116108,"num_objects":108,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4130,"num_write_kb":438054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'9","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:51.962895+0000","last_change":"2024-04-15T00:31:51.962927+0000","last_active":"2024-04-15T00:31:51.962895+0000","last_peered":"2024-04-15T00:31:51.962895+0000","last_clean":"2024-04-15T00:31:51.962895+0000","last_became_active":"2024-04-15T00:21:07.576674+0000","last_became_peered":"2024-04-15T00:21:07.576674+0000","last_unstale":"2024-04-15T00:31:51.962895+0000","last_undegraded":"2024-04-15T00:31:51.962895+0000","last_fullsized":"2024-04-15T00:31:51.962895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-15T00:31:51.962811+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-15T00:31:51.962811+0000","last_clean_scrub_stamp":"2024-04-15T00:31:51.962811+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:29:20.054190+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'16","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:55.998479+0000","last_change":"2024-04-15T00:31:55.998502+0000","last_active":"2024-04-15T00:31:55.998479+0000","last_peered":"2024-04-15T00:31:55.998479+0000","last_clean":"2024-04-15T00:31:55.998479+0000","last_became_active":"2024-04-15T00:21:08.586825+0000","last_became_peered":"2024-04-15T00:21:08.586825+0000","last_unstale":"2024-04-15T00:31:55.998479+0000","last_undegraded":"2024-04-15T00:31:55.998479+0000","last_fullsized":"2024-04-15T00:31:55.998479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-04-15T00:31:55.998406+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-04-15T00:31:55.998406+0000","last_clean_scrub_stamp":"2024-04-15T00:31:55.998406+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:52:44.354614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'1019","reported_seq":1054,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:54.291695+0000","last_change":"2024-04-15T00:31:54.291771+0000","last_active":"2024-04-15T00:31:54.291695+0000","last_peered":"2024-04-15T00:31:54.291695+0000","last_clean":"2024-04-15T00:31:54.291695+0000","last_became_active":"2024-04-15T00:21:12.619259+0000","last_became_peered":"2024-04-15T00:21:12.619259+0000","last_unstale":"2024-04-15T00:31:54.291695+0000","last_undegraded":"2024-04-15T00:31:54.291695+0000","last_fullsized":"2024-04-15T00:31:54.291695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1019","last_scrub_stamp":"2024-04-15T00:31:54.291598+0000","last_deep_scrub":"27'1019","last_deep_scrub_stamp":"2024-04-15T00:31:54.291598+0000","last_clean_scrub_stamp":"2024-04-15T00:31:54.291598+0000","objects_scrubbed":106,"log_size":1019,"log_dups_size":0,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:09:26.677840+0000","scrub_duration":391,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411101590,"num_objects":106,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4869,"num_write_kb":420502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:54.890228+0000","last_change":"2024-04-15T00:31:54.890262+0000","last_active":"2024-04-15T00:31:54.890228+0000","last_peered":"2024-04-15T00:31:54.890228+0000","last_clean":"2024-04-15T00:31:54.890228+0000","last_became_active":"2024-04-15T00:21:07.578733+0000","last_became_peered":"2024-04-15T00:21:07.578733+0000","last_unstale":"2024-04-15T00:31:54.890228+0000","last_undegraded":"2024-04-15T00:31:54.890228+0000","last_fullsized":"2024-04-15T00:31:54.890228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-15T00:31:54.890149+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-15T00:31:54.890149+0000","last_clean_scrub_stamp":"2024-04-15T00:31:54.890149+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:53:05.445528+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5626,"num_omap_keys":11,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'21","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:57.043285+0000","last_change":"2024-04-15T00:31:57.043329+0000","last_active":"2024-04-15T00:31:57.043285+0000","last_peered":"2024-04-15T00:31:57.043285+0000","last_clean":"2024-04-15T00:31:57.043285+0000","last_became_active":"2024-04-15T00:21:08.587951+0000","last_became_peered":"2024-04-15T00:21:08.587951+0000","last_unstale":"2024-04-15T00:31:57.043285+0000","last_undegraded":"2024-04-15T00:31:57.043285+0000","last_fullsized":"2024-04-15T00:31:57.043285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2024-04-15T00:31:57.043211+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2024-04-15T00:31:57.043211+0000","last_clean_scrub_stamp":"2024-04-15T00:31:57.043211+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:30:31.087726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'897","reported_seq":931,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:53.210156+0000","last_change":"2024-04-15T00:31:53.210231+0000","last_active":"2024-04-15T00:31:53.210156+0000","last_peered":"2024-04-15T00:31:53.210156+0000","last_clean":"2024-04-15T00:31:53.210156+0000","last_became_active":"2024-04-15T00:21:12.612976+0000","last_became_peered":"2024-04-15T00:21:12.612976+0000","last_unstale":"2024-04-15T00:31:53.210156+0000","last_undegraded":"2024-04-15T00:31:53.210156+0000","last_fullsized":"2024-04-15T00:31:53.210156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'897","last_scrub_stamp":"2024-04-15T00:31:53.210055+0000","last_deep_scrub":"27'897","last_deep_scrub_stamp":"2024-04-15T00:31:53.210055+0000","last_clean_scrub_stamp":"2024-04-15T00:31:53.210055+0000","objects_scrubbed":88,"log_size":897,"log_dups_size":0,"ondisk_log_size":897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:46:29.487077+0000","scrub_duration":330,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":360723173,"num_objects":88,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4357,"num_write_kb":369330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'11","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:52.398512+0000","last_change":"2024-04-15T00:31:52.398512+0000","last_active":"2024-04-15T00:31:52.398512+0000","last_peered":"2024-04-15T00:31:52.398512+0000","last_clean":"2024-04-15T00:31:52.398512+0000","last_became_active":"2024-04-15T00:21:08.584882+0000","last_became_peered":"2024-04-15T00:21:08.584882+0000","last_unstale":"2024-04-15T00:31:52.398512+0000","last_undegraded":"2024-04-15T00:31:52.398512+0000","last_fullsized":"2024-04-15T00:31:52.398512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-04-15T00:31:52.398400+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-04-15T00:31:52.398400+0000","last_clean_scrub_stamp":"2024-04-15T00:31:52.398400+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:19:40.507513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'864","reported_seq":903,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:55.948094+0000","last_change":"2024-04-15T00:31:55.948179+0000","last_active":"2024-04-15T00:31:55.948094+0000","last_peered":"2024-04-15T00:31:55.948094+0000","last_clean":"2024-04-15T00:31:55.948094+0000","last_became_active":"2024-04-15T00:21:07.580229+0000","last_became_peered":"2024-04-15T00:21:07.580229+0000","last_unstale":"2024-04-15T00:31:55.948094+0000","last_undegraded":"2024-04-15T00:31:55.948094+0000","last_fullsized":"2024-04-15T00:31:55.948094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'864","last_scrub_stamp":"2024-04-15T00:31:55.947959+0000","last_deep_scrub":"27'864","last_deep_scrub_stamp":"2024-04-15T00:31:55.947959+0000","last_clean_scrub_stamp":"2024-04-15T00:31:55.947959+0000","objects_scrubbed":3,"log_size":864,"log_dups_size":0,"ondisk_log_size":864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:09:43.383391+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3046971,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":861,"num_write_kb":3162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5626,"num_omap_keys":11,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'817","reported_seq":852,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:57.489628+0000","last_change":"2024-04-15T00:31:57.489681+0000","last_active":"2024-04-15T00:31:57.489628+0000","last_peered":"2024-04-15T00:31:57.489628+0000","last_clean":"2024-04-15T00:31:57.489628+0000","last_became_active":"2024-04-15T00:21:12.623783+0000","last_became_peered":"2024-04-15T00:21:12.623783+0000","last_unstale":"2024-04-15T00:31:57.489628+0000","last_undegraded":"2024-04-15T00:31:57.489628+0000","last_fullsized":"2024-04-15T00:31:57.489628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'817","last_scrub_stamp":"2024-04-15T00:31:57.489550+0000","last_deep_scrub":"27'817","last_deep_scrub_stamp":"2024-04-15T00:31:57.489550+0000","last_clean_scrub_stamp":"2024-04-15T00:31:57.489550+0000","objects_scrubbed":107,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:04:36.772755+0000","scrub_duration":525,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":419652210,"num_objects":107,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4013,"num_write_kb":425701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'16","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:58.537556+0000","last_change":"2024-04-15T00:31:58.537595+0000","last_active":"2024-04-15T00:31:58.537556+0000","last_peered":"2024-04-15T00:31:58.537556+0000","last_clean":"2024-04-15T00:31:58.537556+0000","last_became_active":"2024-04-15T00:21:08.594535+0000","last_became_peered":"2024-04-15T00:21:08.594535+0000","last_unstale":"2024-04-15T00:31:58.537556+0000","last_undegraded":"2024-04-15T00:31:58.537556+0000","last_fullsized":"2024-04-15T00:31:58.537556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-04-15T00:31:58.537477+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-04-15T00:31:58.537477+0000","last_clean_scrub_stamp":"2024-04-15T00:31:58.537477+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:04:16.009029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'1","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:47.951125+0000","last_change":"2024-04-15T00:31:47.951125+0000","last_active":"2024-04-15T00:31:47.951125+0000","last_peered":"2024-04-15T00:31:47.951125+0000","last_clean":"2024-04-15T00:31:47.951125+0000","last_became_active":"2024-04-15T00:21:07.570555+0000","last_became_peered":"2024-04-15T00:21:07.570555+0000","last_unstale":"2024-04-15T00:31:47.951125+0000","last_undegraded":"2024-04-15T00:31:47.951125+0000","last_fullsized":"2024-04-15T00:31:47.951125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-04-15T00:31:47.951041+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-04-15T00:31:47.951041+0000","last_clean_scrub_stamp":"2024-04-15T00:31:47.951041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:04:51.506410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'900","reported_seq":943,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:32:00.867476+0000","last_change":"2024-04-15T00:32:00.867543+0000","last_active":"2024-04-15T00:32:00.867476+0000","last_peered":"2024-04-15T00:32:00.867476+0000","last_clean":"2024-04-15T00:32:00.867476+0000","last_became_active":"2024-04-15T00:21:50.135204+0000","last_became_peered":"2024-04-15T00:21:50.135204+0000","last_unstale":"2024-04-15T00:32:00.867476+0000","last_undegraded":"2024-04-15T00:32:00.867476+0000","last_fullsized":"2024-04-15T00:32:00.867476+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'900","last_scrub_stamp":"2024-04-15T00:32:00.867353+0000","last_deep_scrub":"27'900","last_deep_scrub_stamp":"2024-04-15T00:32:00.867353+0000","last_clean_scrub_stamp":"2024-04-15T00:32:00.867353+0000","objects_scrubbed":107,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:30:34.911868+0000","scrub_duration":860,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423642109,"num_objects":107,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4534,"num_write_kb":431423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'17","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:53.478064+0000","last_change":"2024-04-15T00:31:53.478064+0000","last_active":"2024-04-15T00:31:53.478064+0000","last_peered":"2024-04-15T00:31:53.478064+0000","last_clean":"2024-04-15T00:31:53.478064+0000","last_became_active":"2024-04-15T00:21:08.574536+0000","last_became_peered":"2024-04-15T00:21:08.574536+0000","last_unstale":"2024-04-15T00:31:53.478064+0000","last_undegraded":"2024-04-15T00:31:53.478064+0000","last_fullsized":"2024-04-15T00:31:53.478064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-04-15T00:31:53.477913+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-04-15T00:31:53.477913+0000","last_clean_scrub_stamp":"2024-04-15T00:31:53.477913+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:19:51.282420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:52.831391+0000","last_change":"2024-04-15T00:31:52.831391+0000","last_active":"2024-04-15T00:31:52.831391+0000","last_peered":"2024-04-15T00:31:52.831391+0000","last_clean":"2024-04-15T00:31:52.831391+0000","last_became_active":"2024-04-15T00:21:07.576739+0000","last_became_peered":"2024-04-15T00:21:07.576739+0000","last_unstale":"2024-04-15T00:31:52.831391+0000","last_undegraded":"2024-04-15T00:31:52.831391+0000","last_fullsized":"2024-04-15T00:31:52.831391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:31:52.831236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:31:52.831236+0000","last_clean_scrub_stamp":"2024-04-15T00:31:52.831236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:53:03.386615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'1173","reported_seq":1209,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:32:02.554884+0000","last_change":"2024-04-15T00:32:02.554931+0000","last_active":"2024-04-15T00:32:02.554884+0000","last_peered":"2024-04-15T00:32:02.554884+0000","last_clean":"2024-04-15T00:32:02.554884+0000","last_became_active":"2024-04-15T00:21:12.631900+0000","last_became_peered":"2024-04-15T00:21:12.631900+0000","last_unstale":"2024-04-15T00:32:02.554884+0000","last_undegraded":"2024-04-15T00:32:02.554884+0000","last_fullsized":"2024-04-15T00:32:02.554884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1173","last_scrub_stamp":"2024-04-15T00:32:02.554762+0000","last_deep_scrub":"27'1173","last_deep_scrub_stamp":"2024-04-15T00:32:02.554762+0000","last_clean_scrub_stamp":"2024-04-15T00:32:02.554762+0000","objects_scrubbed":125,"log_size":1173,"log_dups_size":0,"ondisk_log_size":1173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:22:11.285308+0000","scrub_duration":727,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":507526656,"num_objects":125,"num_object_clones":0,"num_object_copies":500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5839,"num_write_kb":518448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'6","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:50.839788+0000","last_change":"2024-04-15T00:31:50.839788+0000","last_active":"2024-04-15T00:31:50.839788+0000","last_peered":"2024-04-15T00:31:50.839788+0000","last_clean":"2024-04-15T00:31:50.839788+0000","last_became_active":"2024-04-15T00:21:08.589960+0000","last_became_peered":"2024-04-15T00:21:08.589960+0000","last_unstale":"2024-04-15T00:31:50.839788+0000","last_undegraded":"2024-04-15T00:31:50.839788+0000","last_fullsized":"2024-04-15T00:31:50.839788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-15T00:31:50.839671+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-15T00:31:50.839671+0000","last_clean_scrub_stamp":"2024-04-15T00:31:50.839671+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:19:38.948784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:53.907354+0000","last_change":"2024-04-15T00:31:53.907354+0000","last_active":"2024-04-15T00:31:53.907354+0000","last_peered":"2024-04-15T00:31:53.907354+0000","last_clean":"2024-04-15T00:31:53.907354+0000","last_became_active":"2024-04-15T00:21:07.576961+0000","last_became_peered":"2024-04-15T00:21:07.576961+0000","last_unstale":"2024-04-15T00:31:53.907354+0000","last_undegraded":"2024-04-15T00:31:53.907354+0000","last_fullsized":"2024-04-15T00:31:53.907354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:31:53.907186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:31:53.907186+0000","last_clean_scrub_stamp":"2024-04-15T00:31:53.907186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:45:30.561782+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'743","reported_seq":784,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:32:01.498136+0000","last_change":"2024-04-15T00:32:01.498220+0000","last_active":"2024-04-15T00:32:01.498136+0000","last_peered":"2024-04-15T00:32:01.498136+0000","last_clean":"2024-04-15T00:32:01.498136+0000","last_became_active":"2024-04-15T00:21:50.135523+0000","last_became_peered":"2024-04-15T00:21:50.135523+0000","last_unstale":"2024-04-15T00:32:01.498136+0000","last_undegraded":"2024-04-15T00:32:01.498136+0000","last_fullsized":"2024-04-15T00:32:01.498136+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'743","last_scrub_stamp":"2024-04-15T00:32:01.498051+0000","last_deep_scrub":"27'743","last_deep_scrub_stamp":"2024-04-15T00:32:01.498051+0000","last_clean_scrub_stamp":"2024-04-15T00:32:01.498051+0000","objects_scrubbed":97,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:36:16.971268+0000","scrub_duration":535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373416048,"num_objects":97,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3682,"num_write_kb":379037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'20","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:54.955971+0000","last_change":"2024-04-15T00:31:54.955971+0000","last_active":"2024-04-15T00:31:54.955971+0000","last_peered":"2024-04-15T00:31:54.955971+0000","last_clean":"2024-04-15T00:31:54.955971+0000","last_became_active":"2024-04-15T00:21:08.601048+0000","last_became_peered":"2024-04-15T00:21:08.601048+0000","last_unstale":"2024-04-15T00:31:54.955971+0000","last_undegraded":"2024-04-15T00:31:54.955971+0000","last_fullsized":"2024-04-15T00:31:54.955971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-04-15T00:31:54.955766+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-04-15T00:31:54.955766+0000","last_clean_scrub_stamp":"2024-04-15T00:31:54.955766+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:04:34.238971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'5","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:51.382664+0000","last_change":"2024-04-15T00:31:51.382664+0000","last_active":"2024-04-15T00:31:51.382664+0000","last_peered":"2024-04-15T00:31:51.382664+0000","last_clean":"2024-04-15T00:31:51.382664+0000","last_became_active":"2024-04-15T00:21:07.577472+0000","last_became_peered":"2024-04-15T00:21:07.577472+0000","last_unstale":"2024-04-15T00:31:51.382664+0000","last_undegraded":"2024-04-15T00:31:51.382664+0000","last_fullsized":"2024-04-15T00:31:51.382664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-15T00:31:51.382547+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-15T00:31:51.382547+0000","last_clean_scrub_stamp":"2024-04-15T00:31:51.382547+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:36:57.585820+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'847","reported_seq":883,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:59.578546+0000","last_change":"2024-04-15T00:31:59.578573+0000","last_active":"2024-04-15T00:31:59.578546+0000","last_peered":"2024-04-15T00:31:59.578546+0000","last_clean":"2024-04-15T00:31:59.578546+0000","last_became_active":"2024-04-15T00:21:12.633228+0000","last_became_peered":"2024-04-15T00:21:12.633228+0000","last_unstale":"2024-04-15T00:31:59.578546+0000","last_undegraded":"2024-04-15T00:31:59.578546+0000","last_fullsized":"2024-04-15T00:31:59.578546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'847","last_scrub_stamp":"2024-04-15T00:31:59.578454+0000","last_deep_scrub":"27'847","last_deep_scrub_stamp":"2024-04-15T00:31:59.578454+0000","last_clean_scrub_stamp":"2024-04-15T00:31:59.578454+0000","objects_scrubbed":101,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:19:57.382960+0000","scrub_duration":562,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411134922,"num_objects":101,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3991,"num_write_kb":416955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'13","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:32:02.832790+0000","last_change":"2024-04-15T00:32:02.832811+0000","last_active":"2024-04-15T00:32:02.832790+0000","last_peered":"2024-04-15T00:32:02.832790+0000","last_clean":"2024-04-15T00:32:02.832790+0000","last_became_active":"2024-04-15T00:21:49.708106+0000","last_became_peered":"2024-04-15T00:21:49.708106+0000","last_unstale":"2024-04-15T00:32:02.832790+0000","last_undegraded":"2024-04-15T00:32:02.832790+0000","last_fullsized":"2024-04-15T00:32:02.832790+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-04-15T00:32:02.832717+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-04-15T00:32:02.832717+0000","last_clean_scrub_stamp":"2024-04-15T00:32:02.832717+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:25:12.388418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"27'322","reported_seq":362,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:49.930280+0000","last_change":"2024-04-15T00:31:49.930280+0000","last_active":"2024-04-15T00:31:49.930280+0000","last_peered":"2024-04-15T00:31:49.930280+0000","last_clean":"2024-04-15T00:31:49.930280+0000","last_became_active":"2024-04-15T00:21:07.572973+0000","last_became_peered":"2024-04-15T00:21:07.572973+0000","last_unstale":"2024-04-15T00:31:49.930280+0000","last_undegraded":"2024-04-15T00:31:49.930280+0000","last_fullsized":"2024-04-15T00:31:49.930280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'322","last_scrub_stamp":"2024-04-15T00:31:49.930165+0000","last_deep_scrub":"27'322","last_deep_scrub_stamp":"2024-04-15T00:31:49.930165+0000","last_clean_scrub_stamp":"2024-04-15T00:31:49.930165+0000","objects_scrubbed":1,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:34:28.081646+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":665,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'847","reported_seq":883,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:32:02.176711+0000","last_change":"2024-04-15T00:32:02.176821+0000","last_active":"2024-04-15T00:32:02.176711+0000","last_peered":"2024-04-15T00:32:02.176711+0000","last_clean":"2024-04-15T00:32:02.176711+0000","last_became_active":"2024-04-15T00:21:12.633178+0000","last_became_peered":"2024-04-15T00:21:12.633178+0000","last_unstale":"2024-04-15T00:32:02.176711+0000","last_undegraded":"2024-04-15T00:32:02.176711+0000","last_fullsized":"2024-04-15T00:32:02.176711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'847","last_scrub_stamp":"2024-04-15T00:32:02.176573+0000","last_deep_scrub":"27'847","last_deep_scrub_stamp":"2024-04-15T00:32:02.176573+0000","last_clean_scrub_stamp":"2024-04-15T00:32:02.176573+0000","objects_scrubbed":113,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:22:39.823673+0000","scrub_duration":638,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448855783,"num_objects":113,"num_object_clones":0,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4294,"num_write_kb":455043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'14","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:46.995498+0000","last_change":"2024-04-15T00:31:46.995520+0000","last_active":"2024-04-15T00:31:46.995498+0000","last_peered":"2024-04-15T00:31:46.995498+0000","last_clean":"2024-04-15T00:31:46.995498+0000","last_became_active":"2024-04-15T00:21:08.580418+0000","last_became_peered":"2024-04-15T00:21:08.580418+0000","last_unstale":"2024-04-15T00:31:46.995498+0000","last_undegraded":"2024-04-15T00:31:46.995498+0000","last_fullsized":"2024-04-15T00:31:46.995498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-04-15T00:31:46.995430+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-04-15T00:31:46.995430+0000","last_clean_scrub_stamp":"2024-04-15T00:31:46.995430+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:19:35.104543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'1","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:51.010147+0000","last_change":"2024-04-15T00:31:51.010177+0000","last_active":"2024-04-15T00:31:51.010147+0000","last_peered":"2024-04-15T00:31:51.010147+0000","last_clean":"2024-04-15T00:31:51.010147+0000","last_became_active":"2024-04-15T00:21:07.575562+0000","last_became_peered":"2024-04-15T00:21:07.575562+0000","last_unstale":"2024-04-15T00:31:51.010147+0000","last_undegraded":"2024-04-15T00:31:51.010147+0000","last_fullsized":"2024-04-15T00:31:51.010147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-04-15T00:31:51.010055+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-04-15T00:31:51.010055+0000","last_clean_scrub_stamp":"2024-04-15T00:31:51.010055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:34:29.161536+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'992","reported_seq":1027,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:58.490967+0000","last_change":"2024-04-15T00:31:58.491088+0000","last_active":"2024-04-15T00:31:58.490967+0000","last_peered":"2024-04-15T00:31:58.490967+0000","last_clean":"2024-04-15T00:31:58.490967+0000","last_became_active":"2024-04-15T00:21:12.633277+0000","last_became_peered":"2024-04-15T00:21:12.633277+0000","last_unstale":"2024-04-15T00:31:58.490967+0000","last_undegraded":"2024-04-15T00:31:58.490967+0000","last_fullsized":"2024-04-15T00:31:58.490967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'992","last_scrub_stamp":"2024-04-15T00:31:58.490816+0000","last_deep_scrub":"27'992","last_deep_scrub_stamp":"2024-04-15T00:31:58.490816+0000","last_clean_scrub_stamp":"2024-04-15T00:31:58.490816+0000","objects_scrubbed":93,"log_size":992,"log_dups_size":0,"ondisk_log_size":992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:30:32.535331+0000","scrub_duration":591,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":382066035,"num_objects":93,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4954,"num_write_kb":392450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'10","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:53.055033+0000","last_change":"2024-04-15T00:31:53.055053+0000","last_active":"2024-04-15T00:31:53.055033+0000","last_peered":"2024-04-15T00:31:53.055033+0000","last_clean":"2024-04-15T00:31:53.055033+0000","last_became_active":"2024-04-15T00:21:08.578017+0000","last_became_peered":"2024-04-15T00:21:08.578017+0000","last_unstale":"2024-04-15T00:31:53.055033+0000","last_undegraded":"2024-04-15T00:31:53.055033+0000","last_fullsized":"2024-04-15T00:31:53.055033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-15T00:31:53.054956+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-15T00:31:53.054956+0000","last_clean_scrub_stamp":"2024-04-15T00:31:53.054956+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:45:29.709553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:51.880207+0000","last_change":"2024-04-15T00:31:51.880233+0000","last_active":"2024-04-15T00:31:51.880207+0000","last_peered":"2024-04-15T00:31:51.880207+0000","last_clean":"2024-04-15T00:31:51.880207+0000","last_became_active":"2024-04-15T00:21:07.574822+0000","last_became_peered":"2024-04-15T00:21:07.574822+0000","last_unstale":"2024-04-15T00:31:51.880207+0000","last_undegraded":"2024-04-15T00:31:51.880207+0000","last_fullsized":"2024-04-15T00:31:51.880207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-04-15T00:31:51.880121+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-04-15T00:31:51.880121+0000","last_clean_scrub_stamp":"2024-04-15T00:31:51.880121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:54:01.123872+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'1180","reported_seq":1216,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:59.545721+0000","last_change":"2024-04-15T00:31:59.545769+0000","last_active":"2024-04-15T00:31:59.545721+0000","last_peered":"2024-04-15T00:31:59.545721+0000","last_clean":"2024-04-15T00:31:59.545721+0000","last_became_active":"2024-04-15T00:21:12.619694+0000","last_became_peered":"2024-04-15T00:21:12.619694+0000","last_unstale":"2024-04-15T00:31:59.545721+0000","last_undegraded":"2024-04-15T00:31:59.545721+0000","last_fullsized":"2024-04-15T00:31:59.545721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1180","last_scrub_stamp":"2024-04-15T00:31:59.545588+0000","last_deep_scrub":"27'1180","last_deep_scrub_stamp":"2024-04-15T00:31:59.545588+0000","last_clean_scrub_stamp":"2024-04-15T00:31:59.545588+0000","objects_scrubbed":120,"log_size":1180,"log_dups_size":0,"ondisk_log_size":1180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:41:35.835732+0000","scrub_duration":659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474051932,"num_objects":120,"num_object_clones":0,"num_object_copies":480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":120,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5768,"num_write_kb":485640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'13","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:51.863849+0000","last_change":"2024-04-15T00:31:51.863878+0000","last_active":"2024-04-15T00:31:51.863849+0000","last_peered":"2024-04-15T00:31:51.863849+0000","last_clean":"2024-04-15T00:31:51.863849+0000","last_became_active":"2024-04-15T00:21:08.596678+0000","last_became_peered":"2024-04-15T00:21:08.596678+0000","last_unstale":"2024-04-15T00:31:51.863849+0000","last_undegraded":"2024-04-15T00:31:51.863849+0000","last_fullsized":"2024-04-15T00:31:51.863849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-04-15T00:31:51.863756+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-04-15T00:31:51.863756+0000","last_clean_scrub_stamp":"2024-04-15T00:31:51.863756+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:04:55.419125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:51.089934+0000","last_change":"2024-04-15T00:31:51.089957+0000","last_active":"2024-04-15T00:31:51.089934+0000","last_peered":"2024-04-15T00:31:51.089934+0000","last_clean":"2024-04-15T00:31:51.089934+0000","last_became_active":"2024-04-15T00:21:07.574228+0000","last_became_peered":"2024-04-15T00:21:07.574228+0000","last_unstale":"2024-04-15T00:31:51.089934+0000","last_undegraded":"2024-04-15T00:31:51.089934+0000","last_fullsized":"2024-04-15T00:31:51.089934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:31:51.089849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:31:51.089849+0000","last_clean_scrub_stamp":"2024-04-15T00:31:51.089849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:09:23.476091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'1049","reported_seq":1085,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:58.493869+0000","last_change":"2024-04-15T00:31:58.493944+0000","last_active":"2024-04-15T00:31:58.493869+0000","last_peered":"2024-04-15T00:31:58.493869+0000","last_clean":"2024-04-15T00:31:58.493869+0000","last_became_active":"2024-04-15T00:21:12.619307+0000","last_became_peered":"2024-04-15T00:21:12.619307+0000","last_unstale":"2024-04-15T00:31:58.493869+0000","last_undegraded":"2024-04-15T00:31:58.493869+0000","last_fullsized":"2024-04-15T00:31:58.493869+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1049","last_scrub_stamp":"2024-04-15T00:31:58.493774+0000","last_deep_scrub":"27'1049","last_deep_scrub_stamp":"2024-04-15T00:31:58.493774+0000","last_clean_scrub_stamp":"2024-04-15T00:31:58.493774+0000","objects_scrubbed":103,"log_size":1049,"log_dups_size":0,"ondisk_log_size":1049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:13:42.644380+0000","scrub_duration":636,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415249523,"num_objects":103,"num_object_clones":0,"num_object_copies":412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5497,"num_write_kb":427157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'18","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:56.815996+0000","last_change":"2024-04-15T00:31:56.816032+0000","last_active":"2024-04-15T00:31:56.815996+0000","last_peered":"2024-04-15T00:31:56.815996+0000","last_clean":"2024-04-15T00:31:56.815996+0000","last_became_active":"2024-04-15T00:21:08.588920+0000","last_became_peered":"2024-04-15T00:21:08.588920+0000","last_unstale":"2024-04-15T00:31:56.815996+0000","last_undegraded":"2024-04-15T00:31:56.815996+0000","last_fullsized":"2024-04-15T00:31:56.815996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-04-15T00:31:56.815894+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-04-15T00:31:56.815894+0000","last_clean_scrub_stamp":"2024-04-15T00:31:56.815894+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:02:33.029623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'38","reported_seq":114,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:46.492052+0000","last_change":"2024-04-15T00:31:46.492076+0000","last_active":"2024-04-15T00:31:46.492052+0000","last_peered":"2024-04-15T00:31:46.492052+0000","last_clean":"2024-04-15T00:31:46.492052+0000","last_became_active":"2024-04-15T00:21:07.566240+0000","last_became_peered":"2024-04-15T00:21:07.566240+0000","last_unstale":"2024-04-15T00:31:46.492052+0000","last_undegraded":"2024-04-15T00:31:46.492052+0000","last_fullsized":"2024-04-15T00:31:46.492052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2024-04-15T00:31:46.491982+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2024-04-15T00:31:46.491982+0000","last_clean_scrub_stamp":"2024-04-15T00:31:46.491982+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:41:40.312173+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50889,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":72,"num_write":36,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'862","reported_seq":898,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:32:01.533437+0000","last_change":"2024-04-15T00:32:01.533437+0000","last_active":"2024-04-15T00:32:01.533437+0000","last_peered":"2024-04-15T00:32:01.533437+0000","last_clean":"2024-04-15T00:32:01.533437+0000","last_became_active":"2024-04-15T00:21:12.623066+0000","last_became_peered":"2024-04-15T00:21:12.623066+0000","last_unstale":"2024-04-15T00:32:01.533437+0000","last_undegraded":"2024-04-15T00:32:01.533437+0000","last_fullsized":"2024-04-15T00:32:01.533437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'862","last_scrub_stamp":"2024-04-15T00:32:01.533253+0000","last_deep_scrub":"27'862","last_deep_scrub_stamp":"2024-04-15T00:32:01.533253+0000","last_clean_scrub_stamp":"2024-04-15T00:32:01.533253+0000","objects_scrubbed":117,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:04:19.004806+0000","scrub_duration":668,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":453040013,"num_objects":117,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4260,"num_write_kb":459037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'8","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:46.897619+0000","last_change":"2024-04-15T00:31:46.897642+0000","last_active":"2024-04-15T00:31:46.897619+0000","last_peered":"2024-04-15T00:31:46.897619+0000","last_clean":"2024-04-15T00:31:46.897619+0000","last_became_active":"2024-04-15T00:21:08.586054+0000","last_became_peered":"2024-04-15T00:21:08.586054+0000","last_unstale":"2024-04-15T00:31:46.897619+0000","last_undegraded":"2024-04-15T00:31:46.897619+0000","last_fullsized":"2024-04-15T00:31:46.897619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-15T00:31:46.897549+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-15T00:31:46.897549+0000","last_clean_scrub_stamp":"2024-04-15T00:31:46.897549+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:36:53.100822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:52.948556+0000","last_change":"2024-04-15T00:31:52.948575+0000","last_active":"2024-04-15T00:31:52.948556+0000","last_peered":"2024-04-15T00:31:52.948556+0000","last_clean":"2024-04-15T00:31:52.948556+0000","last_became_active":"2024-04-15T00:21:07.576602+0000","last_became_peered":"2024-04-15T00:21:07.576602+0000","last_unstale":"2024-04-15T00:31:52.948556+0000","last_undegraded":"2024-04-15T00:31:52.948556+0000","last_fullsized":"2024-04-15T00:31:52.948556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:31:52.948484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:31:52.948484+0000","last_clean_scrub_stamp":"2024-04-15T00:31:52.948484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:28:36.175411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'902","reported_seq":937,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:59.404680+0000","last_change":"2024-04-15T00:31:59.404680+0000","last_active":"2024-04-15T00:31:59.404680+0000","last_peered":"2024-04-15T00:31:59.404680+0000","last_clean":"2024-04-15T00:31:59.404680+0000","last_became_active":"2024-04-15T00:21:12.633239+0000","last_became_peered":"2024-04-15T00:21:12.633239+0000","last_unstale":"2024-04-15T00:31:59.404680+0000","last_undegraded":"2024-04-15T00:31:59.404680+0000","last_fullsized":"2024-04-15T00:31:59.404680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'902","last_scrub_stamp":"2024-04-15T00:31:59.404537+0000","last_deep_scrub":"27'902","last_deep_scrub_stamp":"2024-04-15T00:31:59.404537+0000","last_clean_scrub_stamp":"2024-04-15T00:31:59.404537+0000","objects_scrubbed":92,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:36:14.877754+0000","scrub_duration":479,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356541982,"num_objects":92,"num_object_clones":0,"num_object_copies":368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4244,"num_write_kb":364740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'12","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:46.391979+0000","last_change":"2024-04-15T00:31:46.392000+0000","last_active":"2024-04-15T00:31:46.391979+0000","last_peered":"2024-04-15T00:31:46.391979+0000","last_clean":"2024-04-15T00:31:46.391979+0000","last_became_active":"2024-04-15T00:21:08.590781+0000","last_became_peered":"2024-04-15T00:21:08.590781+0000","last_unstale":"2024-04-15T00:31:46.391979+0000","last_undegraded":"2024-04-15T00:31:46.391979+0000","last_fullsized":"2024-04-15T00:31:46.391979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-04-15T00:31:46.391911+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-04-15T00:31:46.391911+0000","last_clean_scrub_stamp":"2024-04-15T00:31:46.391911+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:04:49.947280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:49.114948+0000","last_change":"2024-04-15T00:31:49.114973+0000","last_active":"2024-04-15T00:31:49.114948+0000","last_peered":"2024-04-15T00:31:49.114948+0000","last_clean":"2024-04-15T00:31:49.114948+0000","last_became_active":"2024-04-15T00:21:07.573308+0000","last_became_peered":"2024-04-15T00:21:07.573308+0000","last_unstale":"2024-04-15T00:31:49.114948+0000","last_undegraded":"2024-04-15T00:31:49.114948+0000","last_fullsized":"2024-04-15T00:31:49.114948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:31:49.114859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:31:49.114859+0000","last_clean_scrub_stamp":"2024-04-15T00:31:49.114859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:24:33.446128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":198,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:49.973397+0000","last_change":"2024-04-15T00:31:49.973455+0000","last_active":"2024-04-15T00:31:49.973397+0000","last_peered":"2024-04-15T00:31:49.973397+0000","last_clean":"2024-04-15T00:31:49.973397+0000","last_became_active":"2024-04-15T00:20:57.936329+0000","last_became_peered":"2024-04-15T00:20:57.936329+0000","last_unstale":"2024-04-15T00:31:49.973397+0000","last_undegraded":"2024-04-15T00:31:49.973397+0000","last_fullsized":"2024-04-15T00:31:49.973397+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-04-15T00:31:49.973302+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-04-15T00:31:49.973302+0000","last_clean_scrub_stamp":"2024-04-15T00:31:49.973302+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:47:24.353845+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'923","reported_seq":960,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:32:01.196109+0000","last_change":"2024-04-15T00:32:01.196180+0000","last_active":"2024-04-15T00:32:01.196109+0000","last_peered":"2024-04-15T00:32:01.196109+0000","last_clean":"2024-04-15T00:32:01.196109+0000","last_became_active":"2024-04-15T00:21:12.633124+0000","last_became_peered":"2024-04-15T00:21:12.633124+0000","last_unstale":"2024-04-15T00:32:01.196109+0000","last_undegraded":"2024-04-15T00:32:01.196109+0000","last_fullsized":"2024-04-15T00:32:01.196109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'923","last_scrub_stamp":"2024-04-15T00:32:01.195980+0000","last_deep_scrub":"27'923","last_deep_scrub_stamp":"2024-04-15T00:32:01.195980+0000","last_clean_scrub_stamp":"2024-04-15T00:32:01.195980+0000","objects_scrubbed":106,"log_size":923,"log_dups_size":0,"ondisk_log_size":923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:09:48.631413+0000","scrub_duration":743,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406896485,"num_objects":106,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4652,"num_write_kb":415602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'13","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:48.001252+0000","last_change":"2024-04-15T00:31:48.001276+0000","last_active":"2024-04-15T00:31:48.001252+0000","last_peered":"2024-04-15T00:31:48.001252+0000","last_clean":"2024-04-15T00:31:48.001252+0000","last_became_active":"2024-04-15T00:21:08.583143+0000","last_became_peered":"2024-04-15T00:21:08.583143+0000","last_unstale":"2024-04-15T00:31:48.001252+0000","last_undegraded":"2024-04-15T00:31:48.001252+0000","last_fullsized":"2024-04-15T00:31:48.001252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-04-15T00:31:48.001170+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-04-15T00:31:48.001170+0000","last_clean_scrub_stamp":"2024-04-15T00:31:48.001170+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:09:23.379974+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:49.503612+0000","last_change":"2024-04-15T00:31:49.503669+0000","last_active":"2024-04-15T00:31:49.503612+0000","last_peered":"2024-04-15T00:31:49.503612+0000","last_clean":"2024-04-15T00:31:49.503612+0000","last_became_active":"2024-04-15T00:21:07.579024+0000","last_became_peered":"2024-04-15T00:21:07.579024+0000","last_unstale":"2024-04-15T00:31:49.503612+0000","last_undegraded":"2024-04-15T00:31:49.503612+0000","last_fullsized":"2024-04-15T00:31:49.503612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:31:49.503514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:31:49.503514+0000","last_clean_scrub_stamp":"2024-04-15T00:31:49.503514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:30:50.815161+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'783","reported_seq":819,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:32:02.062168+0000","last_change":"2024-04-15T00:32:02.062168+0000","last_active":"2024-04-15T00:32:02.062168+0000","last_peered":"2024-04-15T00:32:02.062168+0000","last_clean":"2024-04-15T00:32:02.062168+0000","last_became_active":"2024-04-15T00:21:12.634689+0000","last_became_peered":"2024-04-15T00:21:12.634689+0000","last_unstale":"2024-04-15T00:32:02.062168+0000","last_undegraded":"2024-04-15T00:32:02.062168+0000","last_fullsized":"2024-04-15T00:32:02.062168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'783","last_scrub_stamp":"2024-04-15T00:32:02.061989+0000","last_deep_scrub":"27'783","last_deep_scrub_stamp":"2024-04-15T00:32:02.061989+0000","last_clean_scrub_stamp":"2024-04-15T00:32:02.061989+0000","objects_scrubbed":105,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:52:50.418197+0000","scrub_duration":558,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":419485282,"num_objects":105,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3792,"num_write_kb":424412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'13","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:55.537151+0000","last_change":"2024-04-15T00:31:55.537175+0000","last_active":"2024-04-15T00:31:55.537151+0000","last_peered":"2024-04-15T00:31:55.537151+0000","last_clean":"2024-04-15T00:31:55.537151+0000","last_became_active":"2024-04-15T00:21:49.708252+0000","last_became_peered":"2024-04-15T00:21:49.708252+0000","last_unstale":"2024-04-15T00:31:55.537151+0000","last_undegraded":"2024-04-15T00:31:55.537151+0000","last_fullsized":"2024-04-15T00:31:55.537151+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-04-15T00:31:55.537074+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-04-15T00:31:55.537074+0000","last_clean_scrub_stamp":"2024-04-15T00:31:55.537074+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:37:01.740347+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:48.922966+0000","last_change":"2024-04-15T00:31:48.922998+0000","last_active":"2024-04-15T00:31:48.922966+0000","last_peered":"2024-04-15T00:31:48.922966+0000","last_clean":"2024-04-15T00:31:48.922966+0000","last_became_active":"2024-04-15T00:21:07.571238+0000","last_became_peered":"2024-04-15T00:21:07.571238+0000","last_unstale":"2024-04-15T00:31:48.922966+0000","last_undegraded":"2024-04-15T00:31:48.922966+0000","last_fullsized":"2024-04-15T00:31:48.922966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-15T00:31:48.922889+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-15T00:31:48.922889+0000","last_clean_scrub_stamp":"2024-04-15T00:31:48.922889+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:47:23.303432+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'910","reported_seq":945,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:57.411327+0000","last_change":"2024-04-15T00:31:57.411364+0000","last_active":"2024-04-15T00:31:57.411327+0000","last_peered":"2024-04-15T00:31:57.411327+0000","last_clean":"2024-04-15T00:31:57.411327+0000","last_became_active":"2024-04-15T00:21:12.619263+0000","last_became_peered":"2024-04-15T00:21:12.619263+0000","last_unstale":"2024-04-15T00:31:57.411327+0000","last_undegraded":"2024-04-15T00:31:57.411327+0000","last_fullsized":"2024-04-15T00:31:57.411327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'910","last_scrub_stamp":"2024-04-15T00:31:57.411204+0000","last_deep_scrub":"27'910","last_deep_scrub_stamp":"2024-04-15T00:31:57.411204+0000","last_clean_scrub_stamp":"2024-04-15T00:31:57.411204+0000","objects_scrubbed":102,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:19:55.215711+0000","scrub_duration":497,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394550963,"num_objects":102,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4303,"num_write_kb":402124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'17","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:32:02.993901+0000","last_change":"2024-04-15T00:32:02.993929+0000","last_active":"2024-04-15T00:32:02.993901+0000","last_peered":"2024-04-15T00:32:02.993901+0000","last_clean":"2024-04-15T00:32:02.993901+0000","last_became_active":"2024-04-15T00:21:08.599132+0000","last_became_peered":"2024-04-15T00:21:08.599132+0000","last_unstale":"2024-04-15T00:32:02.993901+0000","last_undegraded":"2024-04-15T00:32:02.993901+0000","last_fullsized":"2024-04-15T00:32:02.993901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-04-15T00:32:02.993836+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-04-15T00:32:02.993836+0000","last_clean_scrub_stamp":"2024-04-15T00:32:02.993836+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:22:11.724381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:48.484465+0000","last_change":"2024-04-15T00:31:48.484506+0000","last_active":"2024-04-15T00:31:48.484465+0000","last_peered":"2024-04-15T00:31:48.484465+0000","last_clean":"2024-04-15T00:31:48.484465+0000","last_became_active":"2024-04-15T00:21:07.567673+0000","last_became_peered":"2024-04-15T00:21:07.567673+0000","last_unstale":"2024-04-15T00:31:48.484465+0000","last_undegraded":"2024-04-15T00:31:48.484465+0000","last_fullsized":"2024-04-15T00:31:48.484465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-15T00:31:48.484390+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-15T00:31:48.484390+0000","last_clean_scrub_stamp":"2024-04-15T00:31:48.484390+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:22:28.566382+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'711","reported_seq":746,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:32:03.373241+0000","last_change":"2024-04-15T00:32:03.373241+0000","last_active":"2024-04-15T00:32:03.373241+0000","last_peered":"2024-04-15T00:32:03.373241+0000","last_clean":"2024-04-15T00:32:03.373241+0000","last_became_active":"2024-04-15T00:21:12.632508+0000","last_became_peered":"2024-04-15T00:21:12.632508+0000","last_unstale":"2024-04-15T00:32:03.373241+0000","last_undegraded":"2024-04-15T00:32:03.373241+0000","last_fullsized":"2024-04-15T00:32:03.373241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'711","last_scrub_stamp":"2024-04-15T00:32:03.373001+0000","last_deep_scrub":"27'711","last_deep_scrub_stamp":"2024-04-15T00:32:03.373001+0000","last_clean_scrub_stamp":"2024-04-15T00:32:03.373001+0000","objects_scrubbed":96,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:25:12.928702+0000","scrub_duration":330,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":385889695,"num_objects":96,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3516,"num_write_kb":390521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'9","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:32:03.977879+0000","last_change":"2024-04-15T00:32:03.977902+0000","last_active":"2024-04-15T00:32:03.977879+0000","last_peered":"2024-04-15T00:32:03.977879+0000","last_clean":"2024-04-15T00:32:03.977879+0000","last_became_active":"2024-04-15T00:21:08.600142+0000","last_became_peered":"2024-04-15T00:21:08.600142+0000","last_unstale":"2024-04-15T00:32:03.977879+0000","last_undegraded":"2024-04-15T00:32:03.977879+0000","last_fullsized":"2024-04-15T00:32:03.977879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-15T00:32:03.977802+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-15T00:32:03.977802+0000","last_clean_scrub_stamp":"2024-04-15T00:32:03.977802+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:25:13.533503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'3","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:46.802035+0000","last_change":"2024-04-15T00:31:46.802064+0000","last_active":"2024-04-15T00:31:46.802035+0000","last_peered":"2024-04-15T00:31:46.802035+0000","last_clean":"2024-04-15T00:31:46.802035+0000","last_became_active":"2024-04-15T00:21:07.576491+0000","last_became_peered":"2024-04-15T00:21:07.576491+0000","last_unstale":"2024-04-15T00:31:46.802035+0000","last_undegraded":"2024-04-15T00:31:46.802035+0000","last_fullsized":"2024-04-15T00:31:46.802035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-15T00:31:46.801944+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-15T00:31:46.801944+0000","last_clean_scrub_stamp":"2024-04-15T00:31:46.801944+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:09:32.490271+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'793","reported_seq":829,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:55.303660+0000","last_change":"2024-04-15T00:31:55.303660+0000","last_active":"2024-04-15T00:31:55.303660+0000","last_peered":"2024-04-15T00:31:55.303660+0000","last_clean":"2024-04-15T00:31:55.303660+0000","last_became_active":"2024-04-15T00:21:12.619257+0000","last_became_peered":"2024-04-15T00:21:12.619257+0000","last_unstale":"2024-04-15T00:31:55.303660+0000","last_undegraded":"2024-04-15T00:31:55.303660+0000","last_fullsized":"2024-04-15T00:31:55.303660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'793","last_scrub_stamp":"2024-04-15T00:31:55.303510+0000","last_deep_scrub":"27'793","last_deep_scrub_stamp":"2024-04-15T00:31:55.303510+0000","last_clean_scrub_stamp":"2024-04-15T00:31:55.303510+0000","objects_scrubbed":100,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:54:51.876115+0000","scrub_duration":390,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398629714,"num_objects":100,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3893,"num_write_kb":404464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'15","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:58.932550+0000","last_change":"2024-04-15T00:31:58.932570+0000","last_active":"2024-04-15T00:31:58.932550+0000","last_peered":"2024-04-15T00:31:58.932550+0000","last_clean":"2024-04-15T00:31:58.932550+0000","last_became_active":"2024-04-15T00:21:08.590450+0000","last_became_peered":"2024-04-15T00:21:08.590450+0000","last_unstale":"2024-04-15T00:31:58.932550+0000","last_undegraded":"2024-04-15T00:31:58.932550+0000","last_fullsized":"2024-04-15T00:31:58.932550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-04-15T00:31:58.932472+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-04-15T00:31:58.932472+0000","last_clean_scrub_stamp":"2024-04-15T00:31:58.932472+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:36:29.019363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'14","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:47.448867+0000","last_change":"2024-04-15T00:31:47.448897+0000","last_active":"2024-04-15T00:31:47.448867+0000","last_peered":"2024-04-15T00:31:47.448867+0000","last_clean":"2024-04-15T00:31:47.448867+0000","last_became_active":"2024-04-15T00:21:07.566681+0000","last_became_peered":"2024-04-15T00:21:07.566681+0000","last_unstale":"2024-04-15T00:31:47.448867+0000","last_undegraded":"2024-04-15T00:31:47.448867+0000","last_fullsized":"2024-04-15T00:31:47.448867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-04-15T00:31:47.448805+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-04-15T00:31:47.448805+0000","last_clean_scrub_stamp":"2024-04-15T00:31:47.448805+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:14:39.263162+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'1080","reported_seq":1115,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:56.466860+0000","last_change":"2024-04-15T00:31:56.467082+0000","last_active":"2024-04-15T00:31:56.466860+0000","last_peered":"2024-04-15T00:31:56.466860+0000","last_clean":"2024-04-15T00:31:56.466860+0000","last_became_active":"2024-04-15T00:21:12.615577+0000","last_became_peered":"2024-04-15T00:21:12.615577+0000","last_unstale":"2024-04-15T00:31:56.466860+0000","last_undegraded":"2024-04-15T00:31:56.466860+0000","last_fullsized":"2024-04-15T00:31:56.466860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1080","last_scrub_stamp":"2024-04-15T00:31:56.466774+0000","last_deep_scrub":"27'1080","last_deep_scrub_stamp":"2024-04-15T00:31:56.466774+0000","last_clean_scrub_stamp":"2024-04-15T00:31:56.466774+0000","objects_scrubbed":114,"log_size":1080,"log_dups_size":0,"ondisk_log_size":1080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:09:43.902207+0000","scrub_duration":526,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440503524,"num_objects":114,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5539,"num_write_kb":451979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'11","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:54.414810+0000","last_change":"2024-04-15T00:31:54.414832+0000","last_active":"2024-04-15T00:31:54.414810+0000","last_peered":"2024-04-15T00:31:54.414810+0000","last_clean":"2024-04-15T00:31:54.414810+0000","last_became_active":"2024-04-15T00:21:08.587962+0000","last_became_peered":"2024-04-15T00:21:08.587962+0000","last_unstale":"2024-04-15T00:31:54.414810+0000","last_undegraded":"2024-04-15T00:31:54.414810+0000","last_fullsized":"2024-04-15T00:31:54.414810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-04-15T00:31:54.414748+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-04-15T00:31:54.414748+0000","last_clean_scrub_stamp":"2024-04-15T00:31:54.414748+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:47:28.795292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'1","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:48.466256+0000","last_change":"2024-04-15T00:31:48.466297+0000","last_active":"2024-04-15T00:31:48.466256+0000","last_peered":"2024-04-15T00:31:48.466256+0000","last_clean":"2024-04-15T00:31:48.466256+0000","last_became_active":"2024-04-15T00:21:07.573325+0000","last_became_peered":"2024-04-15T00:21:07.573325+0000","last_unstale":"2024-04-15T00:31:48.466256+0000","last_undegraded":"2024-04-15T00:31:48.466256+0000","last_fullsized":"2024-04-15T00:31:48.466256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-04-15T00:31:48.466167+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-04-15T00:31:48.466167+0000","last_clean_scrub_stamp":"2024-04-15T00:31:48.466167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:09:34.154494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'921","reported_seq":963,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:32:05.853435+0000","last_change":"2024-04-15T00:32:05.853484+0000","last_active":"2024-04-15T00:32:05.853435+0000","last_peered":"2024-04-15T00:32:05.853435+0000","last_clean":"2024-04-15T00:32:05.853435+0000","last_became_active":"2024-04-15T00:21:50.135899+0000","last_became_peered":"2024-04-15T00:21:50.135899+0000","last_unstale":"2024-04-15T00:32:05.853435+0000","last_undegraded":"2024-04-15T00:32:05.853435+0000","last_fullsized":"2024-04-15T00:32:05.853435+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'921","last_scrub_stamp":"2024-04-15T00:32:05.853350+0000","last_deep_scrub":"27'921","last_deep_scrub_stamp":"2024-04-15T00:32:05.853350+0000","last_clean_scrub_stamp":"2024-04-15T00:32:05.853350+0000","objects_scrubbed":110,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:43:50.735013+0000","scrub_duration":407,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444634187,"num_objects":110,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4674,"num_write_kb":452484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'25","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:32:00.921212+0000","last_change":"2024-04-15T00:32:00.921234+0000","last_active":"2024-04-15T00:32:00.921212+0000","last_peered":"2024-04-15T00:32:00.921212+0000","last_clean":"2024-04-15T00:32:00.921212+0000","last_became_active":"2024-04-15T00:21:08.593112+0000","last_became_peered":"2024-04-15T00:21:08.593112+0000","last_unstale":"2024-04-15T00:32:00.921212+0000","last_undegraded":"2024-04-15T00:32:00.921212+0000","last_fullsized":"2024-04-15T00:32:00.921212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-04-15T00:32:00.921151+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-04-15T00:32:00.921151+0000","last_clean_scrub_stamp":"2024-04-15T00:32:00.921151+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:37:30.644482+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'1","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:52.062008+0000","last_change":"2024-04-15T00:31:52.062037+0000","last_active":"2024-04-15T00:31:52.062008+0000","last_peered":"2024-04-15T00:31:52.062008+0000","last_clean":"2024-04-15T00:31:52.062008+0000","last_became_active":"2024-04-15T00:21:07.576501+0000","last_became_peered":"2024-04-15T00:21:07.576501+0000","last_unstale":"2024-04-15T00:31:52.062008+0000","last_undegraded":"2024-04-15T00:31:52.062008+0000","last_fullsized":"2024-04-15T00:31:52.062008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-04-15T00:31:52.061914+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-04-15T00:31:52.061914+0000","last_clean_scrub_stamp":"2024-04-15T00:31:52.061914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:54:48.634519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'976","reported_seq":1011,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:32:03.938579+0000","last_change":"2024-04-15T00:32:03.938678+0000","last_active":"2024-04-15T00:32:03.938579+0000","last_peered":"2024-04-15T00:32:03.938579+0000","last_clean":"2024-04-15T00:32:03.938579+0000","last_became_active":"2024-04-15T00:21:12.633242+0000","last_became_peered":"2024-04-15T00:21:12.633242+0000","last_unstale":"2024-04-15T00:32:03.938579+0000","last_undegraded":"2024-04-15T00:32:03.938579+0000","last_fullsized":"2024-04-15T00:32:03.938579+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'976","last_scrub_stamp":"2024-04-15T00:32:03.938475+0000","last_deep_scrub":"27'976","last_deep_scrub_stamp":"2024-04-15T00:32:03.938475+0000","last_clean_scrub_stamp":"2024-04-15T00:32:03.938475+0000","objects_scrubbed":118,"log_size":976,"log_dups_size":0,"ondisk_log_size":976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:01:24.047663+0000","scrub_duration":478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":453069136,"num_objects":118,"num_object_clones":0,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4842,"num_write_kb":461390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'19","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:53.524880+0000","last_change":"2024-04-15T00:31:53.524944+0000","last_active":"2024-04-15T00:31:53.524880+0000","last_peered":"2024-04-15T00:31:53.524880+0000","last_clean":"2024-04-15T00:31:53.524880+0000","last_became_active":"2024-04-15T00:21:49.705916+0000","last_became_peered":"2024-04-15T00:21:49.705916+0000","last_unstale":"2024-04-15T00:31:53.524880+0000","last_undegraded":"2024-04-15T00:31:53.524880+0000","last_fullsized":"2024-04-15T00:31:53.524880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-04-15T00:31:53.524780+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-04-15T00:31:53.524780+0000","last_clean_scrub_stamp":"2024-04-15T00:31:53.524780+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:14:31.934021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.13","version":"27'7","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:44.860110+0000","last_change":"2024-04-15T00:31:44.860155+0000","last_active":"2024-04-15T00:31:44.860110+0000","last_peered":"2024-04-15T00:31:44.860110+0000","last_clean":"2024-04-15T00:31:44.860110+0000","last_became_active":"2024-04-15T00:21:07.572749+0000","last_became_peered":"2024-04-15T00:21:07.572749+0000","last_unstale":"2024-04-15T00:31:44.860110+0000","last_undegraded":"2024-04-15T00:31:44.860110+0000","last_fullsized":"2024-04-15T00:31:44.860110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-15T00:31:44.860030+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-15T00:31:44.860030+0000","last_clean_scrub_stamp":"2024-04-15T00:31:44.860030+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:14:23.269271+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10588,"num_omap_keys":21,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'1053","reported_seq":1087,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:32:02.588223+0000","last_change":"2024-04-15T00:32:02.588312+0000","last_active":"2024-04-15T00:32:02.588223+0000","last_peered":"2024-04-15T00:32:02.588223+0000","last_clean":"2024-04-15T00:32:02.588223+0000","last_became_active":"2024-04-15T00:21:12.631982+0000","last_became_peered":"2024-04-15T00:21:12.631982+0000","last_unstale":"2024-04-15T00:32:02.588223+0000","last_undegraded":"2024-04-15T00:32:02.588223+0000","last_fullsized":"2024-04-15T00:32:02.588223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1053","last_scrub_stamp":"2024-04-15T00:32:02.588119+0000","last_deep_scrub":"27'1053","last_deep_scrub_stamp":"2024-04-15T00:32:02.588119+0000","last_clean_scrub_stamp":"2024-04-15T00:32:02.588119+0000","objects_scrubbed":96,"log_size":1053,"log_dups_size":0,"ondisk_log_size":1053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:22:11.318664+0000","scrub_duration":511,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402653184,"num_objects":96,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5184,"num_write_kb":413411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'15","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:48.981581+0000","last_change":"2024-04-15T00:31:48.981609+0000","last_active":"2024-04-15T00:31:48.981581+0000","last_peered":"2024-04-15T00:31:48.981581+0000","last_clean":"2024-04-15T00:31:48.981581+0000","last_became_active":"2024-04-15T00:21:08.582531+0000","last_became_peered":"2024-04-15T00:21:08.582531+0000","last_unstale":"2024-04-15T00:31:48.981581+0000","last_undegraded":"2024-04-15T00:31:48.981581+0000","last_fullsized":"2024-04-15T00:31:48.981581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-04-15T00:31:48.981493+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-04-15T00:31:48.981493+0000","last_clean_scrub_stamp":"2024-04-15T00:31:48.981493+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:44:46.923636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'293","reported_seq":332,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:50.413195+0000","last_change":"2024-04-15T00:31:50.413230+0000","last_active":"2024-04-15T00:31:50.413195+0000","last_peered":"2024-04-15T00:31:50.413195+0000","last_clean":"2024-04-15T00:31:50.413195+0000","last_became_active":"2024-04-15T00:21:07.576380+0000","last_became_peered":"2024-04-15T00:21:07.576380+0000","last_unstale":"2024-04-15T00:31:50.413195+0000","last_undegraded":"2024-04-15T00:31:50.413195+0000","last_fullsized":"2024-04-15T00:31:50.413195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'293","last_scrub_stamp":"2024-04-15T00:31:50.413093+0000","last_deep_scrub":"27'293","last_deep_scrub_stamp":"2024-04-15T00:31:50.413093+0000","last_clean_scrub_stamp":"2024-04-15T00:31:50.413093+0000","objects_scrubbed":6,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:42:58.349970+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":289,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18796,"num_omap_keys":37,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'986","reported_seq":1021,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:32:00.750212+0000","last_change":"2024-04-15T00:32:00.750266+0000","last_active":"2024-04-15T00:32:00.750212+0000","last_peered":"2024-04-15T00:32:00.750212+0000","last_clean":"2024-04-15T00:32:00.750212+0000","last_became_active":"2024-04-15T00:21:12.620536+0000","last_became_peered":"2024-04-15T00:21:12.620536+0000","last_unstale":"2024-04-15T00:32:00.750212+0000","last_undegraded":"2024-04-15T00:32:00.750212+0000","last_fullsized":"2024-04-15T00:32:00.750212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'986","last_scrub_stamp":"2024-04-15T00:32:00.749974+0000","last_deep_scrub":"27'986","last_deep_scrub_stamp":"2024-04-15T00:32:00.749974+0000","last_clean_scrub_stamp":"2024-04-15T00:32:00.749974+0000","objects_scrubbed":101,"log_size":986,"log_dups_size":0,"ondisk_log_size":986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:37:30.473305+0000","scrub_duration":863,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402669397,"num_objects":101,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4803,"num_write_kb":412051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'14","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:48.825396+0000","last_change":"2024-04-15T00:31:48.825423+0000","last_active":"2024-04-15T00:31:48.825396+0000","last_peered":"2024-04-15T00:31:48.825396+0000","last_clean":"2024-04-15T00:31:48.825396+0000","last_became_active":"2024-04-15T00:21:08.587383+0000","last_became_peered":"2024-04-15T00:21:08.587383+0000","last_unstale":"2024-04-15T00:31:48.825396+0000","last_undegraded":"2024-04-15T00:31:48.825396+0000","last_fullsized":"2024-04-15T00:31:48.825396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-04-15T00:31:48.825307+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-04-15T00:31:48.825307+0000","last_clean_scrub_stamp":"2024-04-15T00:31:48.825307+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:19:58.277617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'24","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:50.907823+0000","last_change":"2024-04-15T00:31:50.907854+0000","last_active":"2024-04-15T00:31:50.907823+0000","last_peered":"2024-04-15T00:31:50.907823+0000","last_clean":"2024-04-15T00:31:50.907823+0000","last_became_active":"2024-04-15T00:21:07.574389+0000","last_became_peered":"2024-04-15T00:21:07.574389+0000","last_unstale":"2024-04-15T00:31:50.907823+0000","last_undegraded":"2024-04-15T00:31:50.907823+0000","last_fullsized":"2024-04-15T00:31:50.907823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2024-04-15T00:31:50.907743+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2024-04-15T00:31:50.907743+0000","last_clean_scrub_stamp":"2024-04-15T00:31:50.907743+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:54:47.480348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2540,"num_omap_keys":5,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'1044","reported_seq":1079,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:56.415737+0000","last_change":"2024-04-15T00:31:56.415787+0000","last_active":"2024-04-15T00:31:56.415737+0000","last_peered":"2024-04-15T00:31:56.415737+0000","last_clean":"2024-04-15T00:31:56.415737+0000","last_became_active":"2024-04-15T00:21:12.619218+0000","last_became_peered":"2024-04-15T00:21:12.619218+0000","last_unstale":"2024-04-15T00:31:56.415737+0000","last_undegraded":"2024-04-15T00:31:56.415737+0000","last_fullsized":"2024-04-15T00:31:56.415737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1044","last_scrub_stamp":"2024-04-15T00:31:56.415605+0000","last_deep_scrub":"27'1044","last_deep_scrub_stamp":"2024-04-15T00:31:56.415605+0000","last_clean_scrub_stamp":"2024-04-15T00:31:56.415605+0000","objects_scrubbed":112,"log_size":1044,"log_dups_size":0,"ondisk_log_size":1044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:45:33.070202+0000","scrub_duration":497,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423735680,"num_objects":112,"num_object_clones":0,"num_object_copies":448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5284,"num_write_kb":434520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'18","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:51.946257+0000","last_change":"2024-04-15T00:31:51.946325+0000","last_active":"2024-04-15T00:31:51.946257+0000","last_peered":"2024-04-15T00:31:51.946257+0000","last_clean":"2024-04-15T00:31:51.946257+0000","last_became_active":"2024-04-15T00:21:08.597262+0000","last_became_peered":"2024-04-15T00:21:08.597262+0000","last_unstale":"2024-04-15T00:31:51.946257+0000","last_undegraded":"2024-04-15T00:31:51.946257+0000","last_fullsized":"2024-04-15T00:31:51.946257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-04-15T00:31:51.946153+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-04-15T00:31:51.946153+0000","last_clean_scrub_stamp":"2024-04-15T00:31:51.946153+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:29:20.037532+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'1","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:50.079563+0000","last_change":"2024-04-15T00:31:50.079609+0000","last_active":"2024-04-15T00:31:50.079563+0000","last_peered":"2024-04-15T00:31:50.079563+0000","last_clean":"2024-04-15T00:31:50.079563+0000","last_became_active":"2024-04-15T00:21:07.573469+0000","last_became_peered":"2024-04-15T00:21:07.573469+0000","last_unstale":"2024-04-15T00:31:50.079563+0000","last_undegraded":"2024-04-15T00:31:50.079563+0000","last_fullsized":"2024-04-15T00:31:50.079563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-04-15T00:31:50.079451+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-04-15T00:31:50.079451+0000","last_clean_scrub_stamp":"2024-04-15T00:31:50.079451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:46:26.356472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'945","reported_seq":980,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:32:01.270351+0000","last_change":"2024-04-15T00:32:01.270403+0000","last_active":"2024-04-15T00:32:01.270351+0000","last_peered":"2024-04-15T00:32:01.270351+0000","last_clean":"2024-04-15T00:32:01.270351+0000","last_became_active":"2024-04-15T00:21:12.624484+0000","last_became_peered":"2024-04-15T00:21:12.624484+0000","last_unstale":"2024-04-15T00:32:01.270351+0000","last_undegraded":"2024-04-15T00:32:01.270351+0000","last_fullsized":"2024-04-15T00:32:01.270351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'945","last_scrub_stamp":"2024-04-15T00:32:01.270239+0000","last_deep_scrub":"27'945","last_deep_scrub_stamp":"2024-04-15T00:32:01.270239+0000","last_clean_scrub_stamp":"2024-04-15T00:32:01.270239+0000","objects_scrubbed":101,"log_size":945,"log_dups_size":0,"ondisk_log_size":945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:24:48.152245+0000","scrub_duration":733,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402666169,"num_objects":101,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4734,"num_write_kb":411824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'15","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:57.998641+0000","last_change":"2024-04-15T00:31:57.998680+0000","last_active":"2024-04-15T00:31:57.998641+0000","last_peered":"2024-04-15T00:31:57.998641+0000","last_clean":"2024-04-15T00:31:57.998641+0000","last_became_active":"2024-04-15T00:21:08.591407+0000","last_became_peered":"2024-04-15T00:21:08.591407+0000","last_unstale":"2024-04-15T00:31:57.998641+0000","last_undegraded":"2024-04-15T00:31:57.998641+0000","last_fullsized":"2024-04-15T00:31:57.998641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-04-15T00:31:57.998554+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-04-15T00:31:57.998554+0000","last_clean_scrub_stamp":"2024-04-15T00:31:57.998554+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:36:28.085445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'1","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:49.417695+0000","last_change":"2024-04-15T00:31:49.417720+0000","last_active":"2024-04-15T00:31:49.417695+0000","last_peered":"2024-04-15T00:31:49.417695+0000","last_clean":"2024-04-15T00:31:49.417695+0000","last_became_active":"2024-04-15T00:21:07.574656+0000","last_became_peered":"2024-04-15T00:21:07.574656+0000","last_unstale":"2024-04-15T00:31:49.417695+0000","last_undegraded":"2024-04-15T00:31:49.417695+0000","last_fullsized":"2024-04-15T00:31:49.417695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-04-15T00:31:49.417613+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-04-15T00:31:49.417613+0000","last_clean_scrub_stamp":"2024-04-15T00:31:49.417613+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:42:12.127275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'741","reported_seq":776,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:32:02.841138+0000","last_change":"2024-04-15T00:32:02.841170+0000","last_active":"2024-04-15T00:32:02.841138+0000","last_peered":"2024-04-15T00:32:02.841138+0000","last_clean":"2024-04-15T00:32:02.841138+0000","last_became_active":"2024-04-15T00:21:12.633262+0000","last_became_peered":"2024-04-15T00:21:12.633262+0000","last_unstale":"2024-04-15T00:32:02.841138+0000","last_undegraded":"2024-04-15T00:32:02.841138+0000","last_fullsized":"2024-04-15T00:32:02.841138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'741","last_scrub_stamp":"2024-04-15T00:32:02.841028+0000","last_deep_scrub":"27'741","last_deep_scrub_stamp":"2024-04-15T00:32:02.841028+0000","last_clean_scrub_stamp":"2024-04-15T00:32:02.841028+0000","objects_scrubbed":105,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:54:10.306253+0000","scrub_duration":346,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":419466538,"num_objects":105,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3547,"num_write_kb":423381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'1101","reported_seq":1137,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:32:00.915521+0000","last_change":"2024-04-15T00:32:00.915675+0000","last_active":"2024-04-15T00:32:00.915521+0000","last_peered":"2024-04-15T00:32:00.915521+0000","last_clean":"2024-04-15T00:32:00.915521+0000","last_became_active":"2024-04-15T00:21:12.633824+0000","last_became_peered":"2024-04-15T00:21:12.633824+0000","last_unstale":"2024-04-15T00:32:00.915521+0000","last_undegraded":"2024-04-15T00:32:00.915521+0000","last_fullsized":"2024-04-15T00:32:00.915521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1101","last_scrub_stamp":"2024-04-15T00:32:00.915320+0000","last_deep_scrub":"27'1101","last_deep_scrub_stamp":"2024-04-15T00:32:00.915320+0000","last_clean_scrub_stamp":"2024-04-15T00:32:00.915320+0000","objects_scrubbed":121,"log_size":1101,"log_dups_size":0,"ondisk_log_size":1101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:13:45.065925+0000","scrub_duration":1008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482370782,"num_objects":121,"num_object_clones":0,"num_object_copies":484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5837,"num_write_kb":494050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'15","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:54.830070+0000","last_change":"2024-04-15T00:31:54.830097+0000","last_active":"2024-04-15T00:31:54.830070+0000","last_peered":"2024-04-15T00:31:54.830070+0000","last_clean":"2024-04-15T00:31:54.830070+0000","last_became_active":"2024-04-15T00:21:08.577692+0000","last_became_peered":"2024-04-15T00:21:08.577692+0000","last_unstale":"2024-04-15T00:31:54.830070+0000","last_undegraded":"2024-04-15T00:31:54.830070+0000","last_fullsized":"2024-04-15T00:31:54.830070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-04-15T00:31:54.829963+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-04-15T00:31:54.829963+0000","last_clean_scrub_stamp":"2024-04-15T00:31:54.829963+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:21:30.525730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:48.070575+0000","last_change":"2024-04-15T00:31:48.070602+0000","last_active":"2024-04-15T00:31:48.070575+0000","last_peered":"2024-04-15T00:31:48.070575+0000","last_clean":"2024-04-15T00:31:48.070575+0000","last_became_active":"2024-04-15T00:21:07.562747+0000","last_became_peered":"2024-04-15T00:21:07.562747+0000","last_unstale":"2024-04-15T00:31:48.070575+0000","last_undegraded":"2024-04-15T00:31:48.070575+0000","last_fullsized":"2024-04-15T00:31:48.070575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:31:48.070492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:31:48.070492+0000","last_clean_scrub_stamp":"2024-04-15T00:31:48.070492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:44:46.012635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'958","reported_seq":994,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:32:00.086462+0000","last_change":"2024-04-15T00:32:00.086502+0000","last_active":"2024-04-15T00:32:00.086462+0000","last_peered":"2024-04-15T00:32:00.086462+0000","last_clean":"2024-04-15T00:32:00.086462+0000","last_became_active":"2024-04-15T00:21:12.624245+0000","last_became_peered":"2024-04-15T00:21:12.624245+0000","last_unstale":"2024-04-15T00:32:00.086462+0000","last_undegraded":"2024-04-15T00:32:00.086462+0000","last_fullsized":"2024-04-15T00:32:00.086462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'958","last_scrub_stamp":"2024-04-15T00:32:00.086391+0000","last_deep_scrub":"27'958","last_deep_scrub_stamp":"2024-04-15T00:32:00.086391+0000","last_clean_scrub_stamp":"2024-04-15T00:32:00.086391+0000","objects_scrubbed":111,"log_size":958,"log_dups_size":0,"ondisk_log_size":958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:04:39.369596+0000","scrub_duration":680,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432096512,"num_objects":111,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4784,"num_write_kb":440700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'22","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:47.373911+0000","last_change":"2024-04-15T00:31:47.373931+0000","last_active":"2024-04-15T00:31:47.373911+0000","last_peered":"2024-04-15T00:31:47.373911+0000","last_clean":"2024-04-15T00:31:47.373911+0000","last_became_active":"2024-04-15T00:21:08.590333+0000","last_became_peered":"2024-04-15T00:21:08.590333+0000","last_unstale":"2024-04-15T00:31:47.373911+0000","last_undegraded":"2024-04-15T00:31:47.373911+0000","last_fullsized":"2024-04-15T00:31:47.373911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-04-15T00:31:47.373843+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-04-15T00:31:47.373843+0000","last_clean_scrub_stamp":"2024-04-15T00:31:47.373843+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:46:23.650865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'1","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:51.421695+0000","last_change":"2024-04-15T00:31:51.421721+0000","last_active":"2024-04-15T00:31:51.421695+0000","last_peered":"2024-04-15T00:31:51.421695+0000","last_clean":"2024-04-15T00:31:51.421695+0000","last_became_active":"2024-04-15T00:21:07.576008+0000","last_became_peered":"2024-04-15T00:21:07.576008+0000","last_unstale":"2024-04-15T00:31:51.421695+0000","last_undegraded":"2024-04-15T00:31:51.421695+0000","last_fullsized":"2024-04-15T00:31:51.421695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-04-15T00:31:51.421605+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-04-15T00:31:51.421605+0000","last_clean_scrub_stamp":"2024-04-15T00:31:51.421605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:04:30.704809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:47.455559+0000","last_change":"2024-04-15T00:31:47.455599+0000","last_active":"2024-04-15T00:31:47.455559+0000","last_peered":"2024-04-15T00:31:47.455559+0000","last_clean":"2024-04-15T00:31:47.455559+0000","last_became_active":"2024-04-15T00:21:07.572273+0000","last_became_peered":"2024-04-15T00:21:07.572273+0000","last_unstale":"2024-04-15T00:31:47.455559+0000","last_undegraded":"2024-04-15T00:31:47.455559+0000","last_fullsized":"2024-04-15T00:31:47.455559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-04-15T00:31:47.455471+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-04-15T00:31:47.455471+0000","last_clean_scrub_stamp":"2024-04-15T00:31:47.455471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:41:57.824545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'16","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:47.894575+0000","last_change":"2024-04-15T00:31:47.894596+0000","last_active":"2024-04-15T00:31:47.894575+0000","last_peered":"2024-04-15T00:31:47.894575+0000","last_clean":"2024-04-15T00:31:47.894575+0000","last_became_active":"2024-04-15T00:21:08.586910+0000","last_became_peered":"2024-04-15T00:21:08.586910+0000","last_unstale":"2024-04-15T00:31:47.894575+0000","last_undegraded":"2024-04-15T00:31:47.894575+0000","last_fullsized":"2024-04-15T00:31:47.894575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-04-15T00:31:47.894508+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-04-15T00:31:47.894508+0000","last_clean_scrub_stamp":"2024-04-15T00:31:47.894508+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:44:52.692312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'803","reported_seq":837,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:52.896186+0000","last_change":"2024-04-15T00:31:52.896222+0000","last_active":"2024-04-15T00:31:52.896186+0000","last_peered":"2024-04-15T00:31:52.896186+0000","last_clean":"2024-04-15T00:31:52.896186+0000","last_became_active":"2024-04-15T00:21:12.621682+0000","last_became_peered":"2024-04-15T00:21:12.621682+0000","last_unstale":"2024-04-15T00:31:52.896186+0000","last_undegraded":"2024-04-15T00:31:52.896186+0000","last_fullsized":"2024-04-15T00:31:52.896186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'803","last_scrub_stamp":"2024-04-15T00:31:52.896097+0000","last_deep_scrub":"27'803","last_deep_scrub_stamp":"2024-04-15T00:31:52.896097+0000","last_clean_scrub_stamp":"2024-04-15T00:31:52.896097+0000","objects_scrubbed":83,"log_size":803,"log_dups_size":0,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:42:03.265172+0000","scrub_duration":368,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":339750667,"num_objects":83,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4004,"num_write_kb":347535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'638","reported_seq":677,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:52.467199+0000","last_change":"2024-04-15T00:31:52.467249+0000","last_active":"2024-04-15T00:31:52.467199+0000","last_peered":"2024-04-15T00:31:52.467199+0000","last_clean":"2024-04-15T00:31:52.467199+0000","last_became_active":"2024-04-15T00:21:07.576791+0000","last_became_peered":"2024-04-15T00:21:07.576791+0000","last_unstale":"2024-04-15T00:31:52.467199+0000","last_undegraded":"2024-04-15T00:31:52.467199+0000","last_fullsized":"2024-04-15T00:31:52.467199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'638","last_scrub_stamp":"2024-04-15T00:31:52.467090+0000","last_deep_scrub":"27'638","last_deep_scrub_stamp":"2024-04-15T00:31:52.467090+0000","last_clean_scrub_stamp":"2024-04-15T00:31:52.467090+0000","objects_scrubbed":2,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:09:39.902523+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":636,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6642,"num_omap_keys":13,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'16","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:47.849939+0000","last_change":"2024-04-15T00:31:47.849965+0000","last_active":"2024-04-15T00:31:47.849939+0000","last_peered":"2024-04-15T00:31:47.849939+0000","last_clean":"2024-04-15T00:31:47.849939+0000","last_became_active":"2024-04-15T00:21:08.583909+0000","last_became_peered":"2024-04-15T00:21:08.583909+0000","last_unstale":"2024-04-15T00:31:47.849939+0000","last_undegraded":"2024-04-15T00:31:47.849939+0000","last_fullsized":"2024-04-15T00:31:47.849939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-04-15T00:31:47.849853+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-04-15T00:31:47.849853+0000","last_clean_scrub_stamp":"2024-04-15T00:31:47.849853+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:42:10.559515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'1057","reported_seq":1092,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:32:00.347135+0000","last_change":"2024-04-15T00:32:00.347308+0000","last_active":"2024-04-15T00:32:00.347135+0000","last_peered":"2024-04-15T00:32:00.347135+0000","last_clean":"2024-04-15T00:32:00.347135+0000","last_became_active":"2024-04-15T00:21:12.623756+0000","last_became_peered":"2024-04-15T00:21:12.623756+0000","last_unstale":"2024-04-15T00:32:00.347135+0000","last_undegraded":"2024-04-15T00:32:00.347135+0000","last_fullsized":"2024-04-15T00:32:00.347135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1057","last_scrub_stamp":"2024-04-15T00:32:00.346973+0000","last_deep_scrub":"27'1057","last_deep_scrub_stamp":"2024-04-15T00:32:00.346973+0000","last_clean_scrub_stamp":"2024-04-15T00:32:00.346973+0000","objects_scrubbed":118,"log_size":1057,"log_dups_size":0,"ondisk_log_size":1057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:22:09.077518+0000","scrub_duration":797,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":461404378,"num_objects":118,"num_object_clones":0,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5333,"num_write_kb":471487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'16","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:55.368425+0000","last_change":"2024-04-15T00:31:55.368464+0000","last_active":"2024-04-15T00:31:55.368425+0000","last_peered":"2024-04-15T00:31:55.368425+0000","last_clean":"2024-04-15T00:31:55.368425+0000","last_became_active":"2024-04-15T00:21:08.587719+0000","last_became_peered":"2024-04-15T00:21:08.587719+0000","last_unstale":"2024-04-15T00:31:55.368425+0000","last_undegraded":"2024-04-15T00:31:55.368425+0000","last_fullsized":"2024-04-15T00:31:55.368425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-04-15T00:31:55.368344+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-04-15T00:31:55.368344+0000","last_clean_scrub_stamp":"2024-04-15T00:31:55.368344+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:34:33.519825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'23","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:51.553510+0000","last_change":"2024-04-15T00:31:51.553548+0000","last_active":"2024-04-15T00:31:51.553510+0000","last_peered":"2024-04-15T00:31:51.553510+0000","last_clean":"2024-04-15T00:31:51.553510+0000","last_became_active":"2024-04-15T00:21:08.595790+0000","last_became_peered":"2024-04-15T00:21:08.595790+0000","last_unstale":"2024-04-15T00:31:51.553510+0000","last_undegraded":"2024-04-15T00:31:51.553510+0000","last_fullsized":"2024-04-15T00:31:51.553510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2024-04-15T00:31:51.553415+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2024-04-15T00:31:51.553415+0000","last_clean_scrub_stamp":"2024-04-15T00:31:51.553415+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:48:47.965997+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'17","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:47.053064+0000","last_change":"2024-04-15T00:31:47.053091+0000","last_active":"2024-04-15T00:31:47.053064+0000","last_peered":"2024-04-15T00:31:47.053064+0000","last_clean":"2024-04-15T00:31:47.053064+0000","last_became_active":"2024-04-15T00:21:08.582801+0000","last_became_peered":"2024-04-15T00:21:08.582801+0000","last_unstale":"2024-04-15T00:31:47.053064+0000","last_undegraded":"2024-04-15T00:31:47.053064+0000","last_fullsized":"2024-04-15T00:31:47.053064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-04-15T00:31:47.052971+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-04-15T00:31:47.052971+0000","last_clean_scrub_stamp":"2024-04-15T00:31:47.052971+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:44:51.850775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'16","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:50.902836+0000","last_change":"2024-04-15T00:31:50.902863+0000","last_active":"2024-04-15T00:31:50.902836+0000","last_peered":"2024-04-15T00:31:50.902836+0000","last_clean":"2024-04-15T00:31:50.902836+0000","last_became_active":"2024-04-15T00:21:08.596144+0000","last_became_peered":"2024-04-15T00:21:08.596144+0000","last_unstale":"2024-04-15T00:31:50.902836+0000","last_undegraded":"2024-04-15T00:31:50.902836+0000","last_fullsized":"2024-04-15T00:31:50.902836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-04-15T00:31:50.902743+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-04-15T00:31:50.902743+0000","last_clean_scrub_stamp":"2024-04-15T00:31:50.902743+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:34:29.054224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'10","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:48.399534+0000","last_change":"2024-04-15T00:31:48.399534+0000","last_active":"2024-04-15T00:31:48.399534+0000","last_peered":"2024-04-15T00:31:48.399534+0000","last_clean":"2024-04-15T00:31:48.399534+0000","last_became_active":"2024-04-15T00:21:08.591479+0000","last_became_peered":"2024-04-15T00:21:08.591479+0000","last_unstale":"2024-04-15T00:31:48.399534+0000","last_undegraded":"2024-04-15T00:31:48.399534+0000","last_fullsized":"2024-04-15T00:31:48.399534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-15T00:31:48.399438+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-15T00:31:48.399438+0000","last_clean_scrub_stamp":"2024-04-15T00:31:48.399438+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:09:20.785679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'12","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:53.861602+0000","last_change":"2024-04-15T00:31:53.861602+0000","last_active":"2024-04-15T00:31:53.861602+0000","last_peered":"2024-04-15T00:31:53.861602+0000","last_clean":"2024-04-15T00:31:53.861602+0000","last_became_active":"2024-04-15T00:21:08.577358+0000","last_became_peered":"2024-04-15T00:21:08.577358+0000","last_unstale":"2024-04-15T00:31:53.861602+0000","last_undegraded":"2024-04-15T00:31:53.861602+0000","last_fullsized":"2024-04-15T00:31:53.861602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-04-15T00:31:53.861482+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-04-15T00:31:53.861482+0000","last_clean_scrub_stamp":"2024-04-15T00:31:53.861482+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:05:47.138329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'20","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:56.366725+0000","last_change":"2024-04-15T00:31:56.366725+0000","last_active":"2024-04-15T00:31:56.366725+0000","last_peered":"2024-04-15T00:31:56.366725+0000","last_clean":"2024-04-15T00:31:56.366725+0000","last_became_active":"2024-04-15T00:21:08.593174+0000","last_became_peered":"2024-04-15T00:21:08.593174+0000","last_unstale":"2024-04-15T00:31:56.366725+0000","last_undegraded":"2024-04-15T00:31:56.366725+0000","last_fullsized":"2024-04-15T00:31:56.366725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-04-15T00:31:56.366614+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-04-15T00:31:56.366614+0000","last_clean_scrub_stamp":"2024-04-15T00:31:56.366614+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:29:24.457993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'8","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:57.546676+0000","last_change":"2024-04-15T00:31:57.546676+0000","last_active":"2024-04-15T00:31:57.546676+0000","last_peered":"2024-04-15T00:31:57.546676+0000","last_clean":"2024-04-15T00:31:57.546676+0000","last_became_active":"2024-04-15T00:21:08.581828+0000","last_became_peered":"2024-04-15T00:21:08.581828+0000","last_unstale":"2024-04-15T00:31:57.546676+0000","last_undegraded":"2024-04-15T00:31:57.546676+0000","last_fullsized":"2024-04-15T00:31:57.546676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-15T00:31:57.546584+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-15T00:31:57.546584+0000","last_clean_scrub_stamp":"2024-04-15T00:31:57.546584+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:37:27.269914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'13","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:55.034716+0000","last_change":"2024-04-15T00:31:55.034716+0000","last_active":"2024-04-15T00:31:55.034716+0000","last_peered":"2024-04-15T00:31:55.034716+0000","last_clean":"2024-04-15T00:31:55.034716+0000","last_became_active":"2024-04-15T00:21:08.582011+0000","last_became_peered":"2024-04-15T00:21:08.582011+0000","last_unstale":"2024-04-15T00:31:55.034716+0000","last_undegraded":"2024-04-15T00:31:55.034716+0000","last_fullsized":"2024-04-15T00:31:55.034716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-04-15T00:31:55.034560+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-04-15T00:31:55.034560+0000","last_clean_scrub_stamp":"2024-04-15T00:31:55.034560+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:09:42.469993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'18","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:56.518202+0000","last_change":"2024-04-15T00:31:56.518224+0000","last_active":"2024-04-15T00:31:56.518202+0000","last_peered":"2024-04-15T00:31:56.518202+0000","last_clean":"2024-04-15T00:31:56.518202+0000","last_became_active":"2024-04-15T00:21:08.579860+0000","last_became_peered":"2024-04-15T00:21:08.579860+0000","last_unstale":"2024-04-15T00:31:56.518202+0000","last_undegraded":"2024-04-15T00:31:56.518202+0000","last_fullsized":"2024-04-15T00:31:56.518202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-04-15T00:31:56.518051+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-04-15T00:31:56.518051+0000","last_clean_scrub_stamp":"2024-04-15T00:31:56.518051+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:41:32.808195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'18","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:32:00.071414+0000","last_change":"2024-04-15T00:32:00.071453+0000","last_active":"2024-04-15T00:32:00.071414+0000","last_peered":"2024-04-15T00:32:00.071414+0000","last_clean":"2024-04-15T00:32:00.071414+0000","last_became_active":"2024-04-15T00:21:08.592110+0000","last_became_peered":"2024-04-15T00:21:08.592110+0000","last_unstale":"2024-04-15T00:32:00.071414+0000","last_undegraded":"2024-04-15T00:32:00.071414+0000","last_fullsized":"2024-04-15T00:32:00.071414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-04-15T00:32:00.071324+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-04-15T00:32:00.071324+0000","last_clean_scrub_stamp":"2024-04-15T00:32:00.071324+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:51:19.600734+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'21","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:53.986856+0000","last_change":"2024-04-15T00:31:53.986881+0000","last_active":"2024-04-15T00:31:53.986856+0000","last_peered":"2024-04-15T00:31:53.986856+0000","last_clean":"2024-04-15T00:31:53.986856+0000","last_became_active":"2024-04-15T00:21:08.599460+0000","last_became_peered":"2024-04-15T00:21:08.599460+0000","last_unstale":"2024-04-15T00:31:53.986856+0000","last_undegraded":"2024-04-15T00:31:53.986856+0000","last_fullsized":"2024-04-15T00:31:53.986856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2024-04-15T00:31:53.986767+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2024-04-15T00:31:53.986767+0000","last_clean_scrub_stamp":"2024-04-15T00:31:53.986767+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:45:30.641364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'15","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:53.414208+0000","last_change":"2024-04-15T00:31:53.414233+0000","last_active":"2024-04-15T00:31:53.414208+0000","last_peered":"2024-04-15T00:31:53.414208+0000","last_clean":"2024-04-15T00:31:53.414208+0000","last_became_active":"2024-04-15T00:21:08.586235+0000","last_became_peered":"2024-04-15T00:21:08.586235+0000","last_unstale":"2024-04-15T00:31:53.414208+0000","last_undegraded":"2024-04-15T00:31:53.414208+0000","last_fullsized":"2024-04-15T00:31:53.414208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-04-15T00:31:53.414142+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-04-15T00:31:53.414142+0000","last_clean_scrub_stamp":"2024-04-15T00:31:53.414142+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:04:56.969511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'17","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:56.909291+0000","last_change":"2024-04-15T00:31:56.909318+0000","last_active":"2024-04-15T00:31:56.909291+0000","last_peered":"2024-04-15T00:31:56.909291+0000","last_clean":"2024-04-15T00:31:56.909291+0000","last_became_active":"2024-04-15T00:21:08.581714+0000","last_became_peered":"2024-04-15T00:21:08.581714+0000","last_unstale":"2024-04-15T00:31:56.909291+0000","last_undegraded":"2024-04-15T00:31:56.909291+0000","last_fullsized":"2024-04-15T00:31:56.909291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-04-15T00:31:56.909207+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-04-15T00:31:56.909207+0000","last_clean_scrub_stamp":"2024-04-15T00:31:56.909207+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:25:49.672782+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'21","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:50.540154+0000","last_change":"2024-04-15T00:31:50.540181+0000","last_active":"2024-04-15T00:31:50.540154+0000","last_peered":"2024-04-15T00:31:50.540154+0000","last_clean":"2024-04-15T00:31:50.540154+0000","last_became_active":"2024-04-15T00:21:08.582594+0000","last_became_peered":"2024-04-15T00:21:08.582594+0000","last_unstale":"2024-04-15T00:31:50.540154+0000","last_undegraded":"2024-04-15T00:31:50.540154+0000","last_fullsized":"2024-04-15T00:31:50.540154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2024-04-15T00:31:50.540064+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2024-04-15T00:31:50.540064+0000","last_clean_scrub_stamp":"2024-04-15T00:31:50.540064+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:48:33.584785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'14","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:59.047630+0000","last_change":"2024-04-15T00:31:59.047674+0000","last_active":"2024-04-15T00:31:59.047630+0000","last_peered":"2024-04-15T00:31:59.047630+0000","last_clean":"2024-04-15T00:31:59.047630+0000","last_became_active":"2024-04-15T00:21:08.591655+0000","last_became_peered":"2024-04-15T00:21:08.591655+0000","last_unstale":"2024-04-15T00:31:59.047630+0000","last_undegraded":"2024-04-15T00:31:59.047630+0000","last_fullsized":"2024-04-15T00:31:59.047630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-04-15T00:31:59.047503+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-04-15T00:31:59.047503+0000","last_clean_scrub_stamp":"2024-04-15T00:31:59.047503+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:24:23.973010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'15","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:54.534528+0000","last_change":"2024-04-15T00:31:54.534569+0000","last_active":"2024-04-15T00:31:54.534528+0000","last_peered":"2024-04-15T00:31:54.534528+0000","last_clean":"2024-04-15T00:31:54.534528+0000","last_became_active":"2024-04-15T00:21:49.707397+0000","last_became_peered":"2024-04-15T00:21:49.707397+0000","last_unstale":"2024-04-15T00:31:54.534528+0000","last_undegraded":"2024-04-15T00:31:54.534528+0000","last_fullsized":"2024-04-15T00:31:54.534528+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-04-15T00:31:54.534417+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-04-15T00:31:54.534417+0000","last_clean_scrub_stamp":"2024-04-15T00:31:54.534417+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:37:50.576793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"27'16","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:45.998670+0000","last_change":"2024-04-15T00:31:45.998720+0000","last_active":"2024-04-15T00:31:45.998670+0000","last_peered":"2024-04-15T00:31:45.998670+0000","last_clean":"2024-04-15T00:31:45.998670+0000","last_became_active":"2024-04-15T00:21:08.580967+0000","last_became_peered":"2024-04-15T00:21:08.580967+0000","last_unstale":"2024-04-15T00:31:45.998670+0000","last_undegraded":"2024-04-15T00:31:45.998670+0000","last_fullsized":"2024-04-15T00:31:45.998670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-04-15T00:31:45.998571+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-04-15T00:31:45.998571+0000","last_clean_scrub_stamp":"2024-04-15T00:31:45.998571+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:09:21.377375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'16","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:48.890900+0000","last_change":"2024-04-15T00:31:48.890927+0000","last_active":"2024-04-15T00:31:48.890900+0000","last_peered":"2024-04-15T00:31:48.890900+0000","last_clean":"2024-04-15T00:31:48.890900+0000","last_became_active":"2024-04-15T00:21:08.586885+0000","last_became_peered":"2024-04-15T00:21:08.586885+0000","last_unstale":"2024-04-15T00:31:48.890900+0000","last_undegraded":"2024-04-15T00:31:48.890900+0000","last_fullsized":"2024-04-15T00:31:48.890900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-04-15T00:31:48.890809+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-04-15T00:31:48.890809+0000","last_clean_scrub_stamp":"2024-04-15T00:31:48.890809+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:04:52.446178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'17","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:54.482522+0000","last_change":"2024-04-15T00:31:54.482544+0000","last_active":"2024-04-15T00:31:54.482522+0000","last_peered":"2024-04-15T00:31:54.482522+0000","last_clean":"2024-04-15T00:31:54.482522+0000","last_became_active":"2024-04-15T00:21:08.579652+0000","last_became_peered":"2024-04-15T00:21:08.579652+0000","last_unstale":"2024-04-15T00:31:54.482522+0000","last_undegraded":"2024-04-15T00:31:54.482522+0000","last_fullsized":"2024-04-15T00:31:54.482522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-04-15T00:31:54.482447+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-04-15T00:31:54.482447+0000","last_clean_scrub_stamp":"2024-04-15T00:31:54.482447+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:02:30.696175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'13","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:49.826494+0000","last_change":"2024-04-15T00:31:49.826540+0000","last_active":"2024-04-15T00:31:49.826494+0000","last_peered":"2024-04-15T00:31:49.826494+0000","last_clean":"2024-04-15T00:31:49.826494+0000","last_became_active":"2024-04-15T00:21:08.587712+0000","last_became_peered":"2024-04-15T00:21:08.587712+0000","last_unstale":"2024-04-15T00:31:49.826494+0000","last_undegraded":"2024-04-15T00:31:49.826494+0000","last_fullsized":"2024-04-15T00:31:49.826494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-04-15T00:31:49.826363+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-04-15T00:31:49.826363+0000","last_clean_scrub_stamp":"2024-04-15T00:31:49.826363+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:09:25.205167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'17","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:57.404183+0000","last_change":"2024-04-15T00:31:57.404221+0000","last_active":"2024-04-15T00:31:57.404183+0000","last_peered":"2024-04-15T00:31:57.404183+0000","last_clean":"2024-04-15T00:31:57.404183+0000","last_became_active":"2024-04-15T00:21:08.596862+0000","last_became_peered":"2024-04-15T00:21:08.596862+0000","last_unstale":"2024-04-15T00:31:57.404183+0000","last_undegraded":"2024-04-15T00:31:57.404183+0000","last_fullsized":"2024-04-15T00:31:57.404183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-04-15T00:31:57.404082+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-04-15T00:31:57.404082+0000","last_clean_scrub_stamp":"2024-04-15T00:31:57.404082+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:28:40.631009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'24","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:58.399081+0000","last_change":"2024-04-15T00:31:58.399105+0000","last_active":"2024-04-15T00:31:58.399081+0000","last_peered":"2024-04-15T00:31:58.399081+0000","last_clean":"2024-04-15T00:31:58.399081+0000","last_became_active":"2024-04-15T00:21:08.597790+0000","last_became_peered":"2024-04-15T00:21:08.597790+0000","last_unstale":"2024-04-15T00:31:58.399081+0000","last_undegraded":"2024-04-15T00:31:58.399081+0000","last_fullsized":"2024-04-15T00:31:58.399081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2024-04-15T00:31:58.398939+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2024-04-15T00:31:58.398939+0000","last_clean_scrub_stamp":"2024-04-15T00:31:58.398939+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:49:08.631085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'21","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:32:04.937930+0000","last_change":"2024-04-15T00:32:04.937954+0000","last_active":"2024-04-15T00:32:04.937930+0000","last_peered":"2024-04-15T00:32:04.937930+0000","last_clean":"2024-04-15T00:32:04.937930+0000","last_became_active":"2024-04-15T00:21:08.600121+0000","last_became_peered":"2024-04-15T00:21:08.600121+0000","last_unstale":"2024-04-15T00:32:04.937930+0000","last_undegraded":"2024-04-15T00:32:04.937930+0000","last_fullsized":"2024-04-15T00:32:04.937930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2024-04-15T00:32:04.937858+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2024-04-15T00:32:04.937858+0000","last_clean_scrub_stamp":"2024-04-15T00:32:04.937858+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:57:29.176176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'12","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:49.359750+0000","last_change":"2024-04-15T00:31:49.359805+0000","last_active":"2024-04-15T00:31:49.359750+0000","last_peered":"2024-04-15T00:31:49.359750+0000","last_clean":"2024-04-15T00:31:49.359750+0000","last_became_active":"2024-04-15T00:21:08.583563+0000","last_became_peered":"2024-04-15T00:21:08.583563+0000","last_unstale":"2024-04-15T00:31:49.359750+0000","last_undegraded":"2024-04-15T00:31:49.359750+0000","last_fullsized":"2024-04-15T00:31:49.359750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-04-15T00:31:49.359650+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-04-15T00:31:49.359650+0000","last_clean_scrub_stamp":"2024-04-15T00:31:49.359650+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:54:45.932255+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'8","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:32:01.944642+0000","last_change":"2024-04-15T00:32:01.944668+0000","last_active":"2024-04-15T00:32:01.944642+0000","last_peered":"2024-04-15T00:32:01.944642+0000","last_clean":"2024-04-15T00:32:01.944642+0000","last_became_active":"2024-04-15T00:21:08.596640+0000","last_became_peered":"2024-04-15T00:21:08.596640+0000","last_unstale":"2024-04-15T00:32:01.944642+0000","last_undegraded":"2024-04-15T00:32:01.944642+0000","last_fullsized":"2024-04-15T00:32:01.944642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-15T00:32:01.944567+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-15T00:32:01.944567+0000","last_clean_scrub_stamp":"2024-04-15T00:32:01.944567+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:04:19.416120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'14","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:32:01.102237+0000","last_change":"2024-04-15T00:32:01.102281+0000","last_active":"2024-04-15T00:32:01.102237+0000","last_peered":"2024-04-15T00:32:01.102237+0000","last_clean":"2024-04-15T00:32:01.102237+0000","last_became_active":"2024-04-15T00:21:08.592476+0000","last_became_peered":"2024-04-15T00:21:08.592476+0000","last_unstale":"2024-04-15T00:32:01.102237+0000","last_undegraded":"2024-04-15T00:32:01.102237+0000","last_fullsized":"2024-04-15T00:32:01.102237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-04-15T00:32:01.102117+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-04-15T00:32:01.102117+0000","last_clean_scrub_stamp":"2024-04-15T00:32:01.102117+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:04:18.573670+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'9","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:59.896331+0000","last_change":"2024-04-15T00:31:59.896351+0000","last_active":"2024-04-15T00:31:59.896331+0000","last_peered":"2024-04-15T00:31:59.896331+0000","last_clean":"2024-04-15T00:31:59.896331+0000","last_became_active":"2024-04-15T00:21:08.591101+0000","last_became_peered":"2024-04-15T00:21:08.591101+0000","last_unstale":"2024-04-15T00:31:59.896331+0000","last_undegraded":"2024-04-15T00:31:59.896331+0000","last_fullsized":"2024-04-15T00:31:59.896331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-15T00:31:59.896269+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-15T00:31:59.896269+0000","last_clean_scrub_stamp":"2024-04-15T00:31:59.896269+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:24:24.821776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'11","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:54.016118+0000","last_change":"2024-04-15T00:31:54.016168+0000","last_active":"2024-04-15T00:31:54.016118+0000","last_peered":"2024-04-15T00:31:54.016118+0000","last_clean":"2024-04-15T00:31:54.016118+0000","last_became_active":"2024-04-15T00:21:08.581316+0000","last_became_peered":"2024-04-15T00:21:08.581316+0000","last_unstale":"2024-04-15T00:31:54.016118+0000","last_undegraded":"2024-04-15T00:31:54.016118+0000","last_fullsized":"2024-04-15T00:31:54.016118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-04-15T00:31:54.016007+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-04-15T00:31:54.016007+0000","last_clean_scrub_stamp":"2024-04-15T00:31:54.016007+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:04:33.299211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'14","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:49.856738+0000","last_change":"2024-04-15T00:31:49.856780+0000","last_active":"2024-04-15T00:31:49.856738+0000","last_peered":"2024-04-15T00:31:49.856738+0000","last_clean":"2024-04-15T00:31:49.856738+0000","last_became_active":"2024-04-15T00:21:08.589919+0000","last_became_peered":"2024-04-15T00:21:08.589919+0000","last_unstale":"2024-04-15T00:31:49.856738+0000","last_undegraded":"2024-04-15T00:31:49.856738+0000","last_fullsized":"2024-04-15T00:31:49.856738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-04-15T00:31:49.856616+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-04-15T00:31:49.856616+0000","last_clean_scrub_stamp":"2024-04-15T00:31:49.856616+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:47:24.237159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'6","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:55.791536+0000","last_change":"2024-04-15T00:31:55.791562+0000","last_active":"2024-04-15T00:31:55.791536+0000","last_peered":"2024-04-15T00:31:55.791536+0000","last_clean":"2024-04-15T00:31:55.791536+0000","last_became_active":"2024-04-15T00:21:08.588208+0000","last_became_peered":"2024-04-15T00:21:08.588208+0000","last_unstale":"2024-04-15T00:31:55.791536+0000","last_undegraded":"2024-04-15T00:31:55.791536+0000","last_fullsized":"2024-04-15T00:31:55.791536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-15T00:31:55.791444+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-15T00:31:55.791444+0000","last_clean_scrub_stamp":"2024-04-15T00:31:55.791444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:19:53.595951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'13","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:31:57.894815+0000","last_change":"2024-04-15T00:31:57.894854+0000","last_active":"2024-04-15T00:31:57.894815+0000","last_peered":"2024-04-15T00:31:57.894815+0000","last_clean":"2024-04-15T00:31:57.894815+0000","last_became_active":"2024-04-15T00:21:08.587646+0000","last_became_peered":"2024-04-15T00:21:08.587646+0000","last_unstale":"2024-04-15T00:31:57.894815+0000","last_undegraded":"2024-04-15T00:31:57.894815+0000","last_fullsized":"2024-04-15T00:31:57.894815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-04-15T00:31:57.894728+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-04-15T00:31:57.894728+0000","last_clean_scrub_stamp":"2024-04-15T00:31:57.894728+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:02:34.108457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":13424233995,"num_objects":3390,"num_object_clones":0,"num_object_copies":13560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3390,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148702,"num_write_kb":13691509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26850476032,"data_stored":26850476032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29948,"ondisk_log_size":29948,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":953,"ondisk_log_size":953,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":11487938,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":36,"num_read_kb":72,"num_write":2553,"num_write_kb":12013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":56930,"num_omap_keys":112,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":23035904,"data_stored":22975876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2247,"ondisk_log_size":2247,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542282,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4663072,"kb_used_data":4365464,"kb_used_omap":1,"kb_used_meta":297598,"kb_avail":89708768,"statfs":{"total":96636764160,"available":91861778432,"internally_reserved":0,"allocated":4470235136,"data_stored":4470056729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":304740807},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542282,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2797748,"kb_used_data":2626412,"kb_used_omap":1,"kb_used_meta":171326,"kb_avail":91574092,"statfs":{"total":96636764160,"available":93771870208,"internally_reserved":0,"allocated":2689445888,"data_stored":2689275001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":175438277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542282,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3076828,"kb_used_data":2887444,"kb_used_omap":1,"kb_used_meta":189374,"kb_avail":91295012,"statfs":{"total":96636764160,"available":93486092288,"internally_reserved":0,"allocated":2956742656,"data_stored":2956558926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":193919429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574986,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3118544,"kb_used_data":2920840,"kb_used_omap":1,"kb_used_meta":197694,"kb_avail":91253296,"statfs":{"total":96636764160,"available":93443375104,"internally_reserved":0,"allocated":2990940160,"data_stored":2990764113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":202439114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574986,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3681748,"kb_used_data":3443788,"kb_used_omap":1,"kb_used_meta":237950,"kb_avail":90690092,"statfs":{"total":96636764160,"available":92866654208,"internally_reserved":0,"allocated":3526438912,"data_stored":3526262864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":243661254},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574985,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2562512,"kb_used_data":2382856,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":91809328,"statfs":{"total":96636764160,"available":94012751872,"internally_reserved":0,"allocated":2440044544,"data_stored":2439872010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574985,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3506696,"kb_used_data":3268736,"kb_used_omap":1,"kb_used_meta":237950,"kb_avail":90865144,"statfs":{"total":96636764160,"available":93045907456,"internally_reserved":0,"allocated":3347185664,"data_stored":3347004521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243661253},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574986,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4631084,"kb_used_data":4351524,"kb_used_omap":1,"kb_used_meta":279550,"kb_avail":89740756,"statfs":{"total":96636764160,"available":91894534144,"internally_reserved":0,"allocated":4455960576,"data_stored":4455784016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":286259654},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":50889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8450048,"data_stored":8440169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3059712,"data_stored":3047097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7245824,"data_stored":7241857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2955849728,"data_stored":2955849728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4455665664,"data_stored":4455665664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2689105920,"data_stored":2689105920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4461498368,"data_stored":4461498368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3343839232,"data_stored":3343839232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2439753728,"data_stored":2439753728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3521949696,"data_stored":3521949696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2982813696,"data_stored":2982813696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T00:32:08.709 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-15T00:32:08.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.834+0000 7fb4185c8640 1 Processor -- start 2024-04-15T00:32:08.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.834+0000 7fb4185c8640 1 -- start start 2024-04-15T00:32:08.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.835+0000 7fb4185c8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb4100b8ab0 0x7fb4100b8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:08.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.835+0000 7fb4185c8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb410150180 0x7fb410152570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:08.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.835+0000 7fb4185c8640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb410072b30 con 0x7fb410072750 2024-04-15T00:32:08.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.835+0000 7fb4185c8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fb4100b0580 con 0x7fb4100b8ab0 2024-04-15T00:32:08.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.835+0000 7fb4185c8640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fb4100bad90 con 0x7fb410150180 2024-04-15T00:32:08.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.835+0000 7fb415b63640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb4100b8ab0 0x7fb4100b8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:08.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.835+0000 7fb415b63640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb4100b8ab0 0x7fb4100b8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54910/0 (socket says 172.21.15.31:54910) 2024-04-15T00:32:08.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.835+0000 7fb416364640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb410072750 0x7fb41009bf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53690/0 (socket says 172.21.15.31:53690) 2024-04-15T00:32:08.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.835+0000 7fb415b63640 1 -- 172.21.15.31:0/3679255988 learned_addr learned my addr 172.21.15.31:0/3679255988 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:32:08.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.836+0000 7fb416b65640 1 --2- 172.21.15.31:0/3679255988 >> v2:172.21.15.50:3300/0 conn(0x7fb410150180 0x7fb410152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:08.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.836+0000 7fb415b63640 1 -- 172.21.15.31:0/3679255988 >> v2:172.21.15.50:3300/0 conn(0x7fb410150180 msgr2=0x7fb410152570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:32:08.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.836+0000 7fb415b63640 1 --2- 172.21.15.31:0/3679255988 >> v2:172.21.15.50:3300/0 conn(0x7fb410150180 0x7fb410152570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:08.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.836+0000 7fb415b63640 1 -- 172.21.15.31:0/3679255988 >> v1:172.21.15.31:6789/0 conn(0x7fb410072750 legacy=0x7fb41009bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:08.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.836+0000 7fb415b63640 1 -- 172.21.15.31:0/3679255988 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4100bb070 con 0x7fb4100b8ab0 2024-04-15T00:32:08.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.836+0000 7fb415b63640 1 --2- 172.21.15.31:0/3679255988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4100b8ab0 0x7fb4100b8f10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb4100b7440 tx=0x7fb40402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f85a77a71564dc28 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:32:08.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.836+0000 7fb415362640 1 -- 172.21.15.31:0/3679255988 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb404035020 con 0x7fb4100b8ab0 2024-04-15T00:32:08.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.836+0000 7fb415362640 1 -- 172.21.15.31:0/3679255988 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb404031870 con 0x7fb4100b8ab0 2024-04-15T00:32:08.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.836+0000 7fb415362640 1 -- 172.21.15.31:0/3679255988 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb404031c40 con 0x7fb4100b8ab0 2024-04-15T00:32:08.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.837+0000 7fb4185c8640 1 -- 172.21.15.31:0/3679255988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4100b8ab0 msgr2=0x7fb4100b8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:08.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.837+0000 7fb4185c8640 1 --2- 172.21.15.31:0/3679255988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4100b8ab0 0x7fb4100b8f10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb4100b7440 tx=0x7fb40402b910 comp rx=0 tx=0).stop 2024-04-15T00:32:08.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.837+0000 7fb4185c8640 1 -- 172.21.15.31:0/3679255988 shutdown_connections 2024-04-15T00:32:08.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.837+0000 7fb4185c8640 1 --2- 172.21.15.31:0/3679255988 >> v2:172.21.15.50:3300/0 conn(0x7fb410150180 0x7fb410152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:08.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.837+0000 7fb4185c8640 1 --2- 172.21.15.31:0/3679255988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4100b8ab0 0x7fb4100b8f10 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:08.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.837+0000 7fb4185c8640 1 -- 172.21.15.31:0/3679255988 >> 172.21.15.31:0/3679255988 conn(0x7fb4100bcef0 msgr2=0x7fb4100bd300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:32:08.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.837+0000 7fb4185c8640 1 -- 172.21.15.31:0/3679255988 shutdown_connections 2024-04-15T00:32:08.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.837+0000 7fb4185c8640 1 -- 172.21.15.31:0/3679255988 wait complete. 2024-04-15T00:32:08.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.838+0000 7fb4185c8640 1 Processor -- start 2024-04-15T00:32:08.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.838+0000 7fb4185c8640 1 -- start start 2024-04-15T00:32:08.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.839+0000 7fb4185c8640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb410072750 0x7fb4100b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:08.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.839+0000 7fb4185c8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4100b8ab0 0x7fb4100a1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:08.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.839+0000 7fb4185c8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb410150180 0x7fb41014a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:08.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.839+0000 7fb4185c8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb4101478f0 con 0x7fb410150180 2024-04-15T00:32:08.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.839+0000 7fb4185c8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb41009c6a0 con 0x7fb4100b8ab0 2024-04-15T00:32:08.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.839+0000 7fb4185c8640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fb410074530 con 0x7fb410072750 2024-04-15T00:32:08.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.839+0000 7fb416b65640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb410150180 0x7fb41014a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:08.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.839+0000 7fb416b65640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb410150180 0x7fb41014a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54922/0 (socket says 172.21.15.31:54922) 2024-04-15T00:32:08.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.839+0000 7fb416b65640 1 -- 172.21.15.31:0/4116007773 learned_addr learned my addr 172.21.15.31:0/4116007773 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:32:08.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.839+0000 7fb415b63640 1 --2- 172.21.15.31:0/4116007773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4100b8ab0 0x7fb4100a1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:08.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.839+0000 7fb416364640 1 --2- 172.21.15.31:0/4116007773 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb410072750 0x7fb4100b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:08.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.839+0000 7fb416b65640 1 -- 172.21.15.31:0/4116007773 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb410072750 msgr2=0x7fb4100b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:08.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.839+0000 7fb416b65640 1 --2- 172.21.15.31:0/4116007773 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb410072750 0x7fb4100b36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:08.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.839+0000 7fb416b65640 1 -- 172.21.15.31:0/4116007773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4100b8ab0 msgr2=0x7fb4100a1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:08.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.839+0000 7fb416b65640 1 --2- 172.21.15.31:0/4116007773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4100b8ab0 0x7fb4100a1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:08.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.839+0000 7fb416b65640 1 -- 172.21.15.31:0/4116007773 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb410149fb0 con 0x7fb410150180 2024-04-15T00:32:08.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.839+0000 7fb415b63640 1 --2- 172.21.15.31:0/4116007773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4100b8ab0 0x7fb4100a1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:32:08.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.839+0000 7fb416b65640 1 --2- 172.21.15.31:0/4116007773 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb410150180 0x7fb41014a440 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb400009fd0 tx=0x7fb40000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:32:08.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.839+0000 7fb40effd640 1 -- 172.21.15.31:0/4116007773 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb400014420 con 0x7fb410150180 2024-04-15T00:32:08.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.839+0000 7fb40effd640 1 -- 172.21.15.31:0/4116007773 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb400019070 con 0x7fb410150180 2024-04-15T00:32:08.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.839+0000 7fb4185c8640 1 -- 172.21.15.31:0/4116007773 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4100a27f0 con 0x7fb410150180 2024-04-15T00:32:08.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.839+0000 7fb40effd640 1 -- 172.21.15.31:0/4116007773 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb400014800 con 0x7fb410150180 2024-04-15T00:32:08.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.840+0000 7fb4185c8640 1 -- 172.21.15.31:0/4116007773 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb410148af0 con 0x7fb410150180 2024-04-15T00:32:08.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.841+0000 7fb4185c8640 1 -- 172.21.15.31:0/4116007773 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb410074820 con 0x7fb410150180 2024-04-15T00:32:08.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.841+0000 7fb40effd640 1 -- 172.21.15.31:0/4116007773 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fb4000149a0 con 0x7fb410150180 2024-04-15T00:32:08.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.841+0000 7fb40effd640 1 --2- 172.21.15.31:0/4116007773 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb3fc06b990 0x7fb3fc06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:08.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.841+0000 7fb40effd640 1 -- 172.21.15.31:0/4116007773 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fb40008b420 con 0x7fb410150180 2024-04-15T00:32:08.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.841+0000 7fb416364640 1 --2- 172.21.15.31:0/4116007773 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb3fc06b990 0x7fb3fc06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:08.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.842+0000 7fb416364640 1 --2- 172.21.15.31:0/4116007773 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb3fc06b990 0x7fb3fc06de50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb4100b3c50 tx=0x7fb408009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:32:08.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:08.846+0000 7fb40effd640 1 -- 172.21.15.31:0/4116007773 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb410074820 con 0x7fb410150180 2024-04-15T00:32:09.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.028+0000 7fb4185c8640 1 -- 172.21.15.31:0/4116007773 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fb41004f540 con 0x7fb410150180 2024-04-15T00:32:09.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.031+0000 7fb40effd640 1 -- 172.21.15.31:0/4116007773 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7fb400059cc0 con 0x7fb410150180 2024-04-15T00:32:09.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.031+0000 7fb40effd640 1 -- 172.21.15.31:0/4116007773 <== mon.0 v2:172.21.15.31:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb4000595c0 con 0x7fb410150180 2024-04-15T00:32:09.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.033+0000 7fb4185c8640 1 -- 172.21.15.31:0/4116007773 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb3fc06b990 msgr2=0x7fb3fc06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:09.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.033+0000 7fb4185c8640 1 --2- 172.21.15.31:0/4116007773 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb3fc06b990 0x7fb3fc06de50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb4100b3c50 tx=0x7fb408009040 comp rx=0 tx=0).stop 2024-04-15T00:32:09.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.033+0000 7fb4185c8640 1 -- 172.21.15.31:0/4116007773 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb410150180 msgr2=0x7fb41014a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:09.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.033+0000 7fb4185c8640 1 --2- 172.21.15.31:0/4116007773 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb410150180 0x7fb41014a440 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb400009fd0 tx=0x7fb40000e4b0 comp rx=0 tx=0).stop 2024-04-15T00:32:09.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.033+0000 7fb4185c8640 1 -- 172.21.15.31:0/4116007773 shutdown_connections 2024-04-15T00:32:09.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.033+0000 7fb4185c8640 1 --2- 172.21.15.31:0/4116007773 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb410150180 0x7fb41014a440 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:09.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.033+0000 7fb4185c8640 1 --2- 172.21.15.31:0/4116007773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4100b8ab0 0x7fb4100a1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:09.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.033+0000 7fb4185c8640 1 --2- 172.21.15.31:0/4116007773 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb3fc06b990 0x7fb3fc06de50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:09.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.033+0000 7fb4185c8640 1 --2- 172.21.15.31:0/4116007773 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb410072750 0x7fb4100b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:09.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.033+0000 7fb4185c8640 1 -- 172.21.15.31:0/4116007773 >> 172.21.15.31:0/4116007773 conn(0x7fb4100bcef0 msgr2=0x7fb4101470a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:32:09.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.034+0000 7fb4185c8640 1 -- 172.21.15.31:0/4116007773 shutdown_connections 2024-04-15T00:32:09.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.034+0000 7fb4185c8640 1 -- 172.21.15.31:0/4116007773 wait complete. 2024-04-15T00:32:09.053 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-15T00:32:09.054 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T00:32:09.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.147+0000 7f41171cf640 1 Processor -- start 2024-04-15T00:32:09.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.147+0000 7f41171cf640 1 -- start start 2024-04-15T00:32:09.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.147+0000 7f41171cf640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f411014b8e0 0x7f41100b9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:09.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.147+0000 7f41171cf640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f41100b8bf0 0x7f4110151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:09.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.147+0000 7f41171cf640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41100bb2d0 con 0x7f41100baef0 2024-04-15T00:32:09.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.147+0000 7f41171cf640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f411014ae00 con 0x7f41100b8bf0 2024-04-15T00:32:09.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.147+0000 7f41171cf640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f411014b0e0 con 0x7f411014b8e0 2024-04-15T00:32:09.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.148+0000 7f411576c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f41100b8bf0 0x7f4110151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:09.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.148+0000 7f411576c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f41100b8bf0 0x7f4110151ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54936/0 (socket says 172.21.15.31:54936) 2024-04-15T00:32:09.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.148+0000 7f411576c640 1 -- 172.21.15.31:0/519177859 learned_addr learned my addr 172.21.15.31:0/519177859 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:32:09.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.148+0000 7f4114f6b640 1 --1- 172.21.15.31:0/519177859 >> v1:172.21.15.31:6789/0 conn(0x7f41100baef0 0x7f4110147670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53694/0 (socket says 172.21.15.31:53694) 2024-04-15T00:32:09.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.148+0000 7f410ffff640 1 --2- 172.21.15.31:0/519177859 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f411014b8e0 0x7f41100b9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:09.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.148+0000 7f411576c640 1 -- 172.21.15.31:0/519177859 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f411014b8e0 msgr2=0x7f41100b9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:32:09.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.148+0000 7f411576c640 1 --2- 172.21.15.31:0/519177859 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f411014b8e0 0x7f41100b9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:09.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.148+0000 7f411576c640 1 -- 172.21.15.31:0/519177859 >> v1:172.21.15.31:6789/0 conn(0x7f41100baef0 legacy=0x7f4110147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:09.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.148+0000 7f411576c640 1 -- 172.21.15.31:0/519177859 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41100bcbb0 con 0x7f41100b8bf0 2024-04-15T00:32:09.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.148+0000 7f410f7fe640 1 -- 172.21.15.31:0/519177859 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3940213815 0 0) 0x7f41100bb2d0 con 0x7f41100baef0 2024-04-15T00:32:09.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.148+0000 7f410ffff640 1 --2- 172.21.15.31:0/519177859 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f411014b8e0 0x7f41100b9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T00:32:09.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.149+0000 7f411576c640 1 --2- 172.21.15.31:0/519177859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41100b8bf0 0x7f4110151ff0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4108009e50 tx=0x7f410802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8878e1394e6ccca server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:32:09.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.149+0000 7f410f7fe640 1 -- 172.21.15.31:0/519177859 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f410802ca70 con 0x7f41100b8bf0 2024-04-15T00:32:09.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.149+0000 7f410f7fe640 1 -- 172.21.15.31:0/519177859 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f410802cc10 con 0x7f41100b8bf0 2024-04-15T00:32:09.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.149+0000 7f410f7fe640 1 -- 172.21.15.31:0/519177859 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41080343f0 con 0x7f41100b8bf0 2024-04-15T00:32:09.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.149+0000 7f41171cf640 1 -- 172.21.15.31:0/519177859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41100b8bf0 msgr2=0x7f4110151ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:09.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.149+0000 7f41171cf640 1 --2- 172.21.15.31:0/519177859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41100b8bf0 0x7f4110151ff0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4108009e50 tx=0x7f410802bed0 comp rx=0 tx=0).stop 2024-04-15T00:32:09.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.149+0000 7f41171cf640 1 -- 172.21.15.31:0/519177859 shutdown_connections 2024-04-15T00:32:09.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.149+0000 7f41171cf640 1 --2- 172.21.15.31:0/519177859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41100b8bf0 0x7f4110151ff0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:09.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.149+0000 7f41171cf640 1 --2- 172.21.15.31:0/519177859 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f411014b8e0 0x7f41100b9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:09.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.149+0000 7f41171cf640 1 -- 172.21.15.31:0/519177859 >> 172.21.15.31:0/519177859 conn(0x7f411009ed70 msgr2=0x7f411009f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:32:09.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.149+0000 7f41171cf640 1 -- 172.21.15.31:0/519177859 shutdown_connections 2024-04-15T00:32:09.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.149+0000 7f41171cf640 1 -- 172.21.15.31:0/519177859 wait complete. 2024-04-15T00:32:09.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.150+0000 7f41171cf640 1 Processor -- start 2024-04-15T00:32:09.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.150+0000 7f41171cf640 1 -- start start 2024-04-15T00:32:09.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.151+0000 7f41171cf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41100b8bf0 0x7f41101444e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:09.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.151+0000 7f41171cf640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41100baef0 0x7f41101e0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:09.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.151+0000 7f41171cf640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f411014b8e0 0x7f41101e1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:09.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.151+0000 7f41171cf640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f41100b91e0 con 0x7f41100baef0 2024-04-15T00:32:09.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.151+0000 7f41171cf640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f41100b9060 con 0x7f41100b8bf0 2024-04-15T00:32:09.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.151+0000 7f41171cf640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f41100b9360 con 0x7f411014b8e0 2024-04-15T00:32:09.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.151+0000 7f410ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41100baef0 0x7f41101e0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:09.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.151+0000 7f410ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41100baef0 0x7f41101e0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54952/0 (socket says 172.21.15.31:54952) 2024-04-15T00:32:09.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.151+0000 7f410ffff640 1 -- 172.21.15.31:0/3153346291 learned_addr learned my addr 172.21.15.31:0/3153346291 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:32:09.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.152+0000 7f4114f6b640 1 --2- 172.21.15.31:0/3153346291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41100b8bf0 0x7f41101444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:09.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.152+0000 7f411576c640 1 --2- 172.21.15.31:0/3153346291 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f411014b8e0 0x7f41101e1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:09.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.152+0000 7f410ffff640 1 -- 172.21.15.31:0/3153346291 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f411014b8e0 msgr2=0x7f41101e1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:09.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.152+0000 7f410ffff640 1 --2- 172.21.15.31:0/3153346291 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f411014b8e0 0x7f41101e1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:09.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.152+0000 7f410ffff640 1 -- 172.21.15.31:0/3153346291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41100b8bf0 msgr2=0x7f41101444e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:09.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.152+0000 7f410ffff640 1 --2- 172.21.15.31:0/3153346291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41100b8bf0 0x7f41101444e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:09.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.152+0000 7f410ffff640 1 -- 172.21.15.31:0/3153346291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4110145160 con 0x7f41100baef0 2024-04-15T00:32:09.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.152+0000 7f410ffff640 1 --2- 172.21.15.31:0/3153346291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41100baef0 0x7f41101e0cf0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f40fc00c820 tx=0x7f40fc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:32:09.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.152+0000 7f410d7fa640 1 -- 172.21.15.31:0/3153346291 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40fc015070 con 0x7f41100baef0 2024-04-15T00:32:09.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.152+0000 7f410d7fa640 1 -- 172.21.15.31:0/3153346291 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f40fc007a30 con 0x7f41100baef0 2024-04-15T00:32:09.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.152+0000 7f41171cf640 1 -- 172.21.15.31:0/3153346291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41101e07d0 con 0x7f41100baef0 2024-04-15T00:32:09.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.152+0000 7f410d7fa640 1 -- 172.21.15.31:0/3153346291 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40fc007e20 con 0x7f41100baef0 2024-04-15T00:32:09.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.152+0000 7f41171cf640 1 -- 172.21.15.31:0/3153346291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41100a2700 con 0x7f41100baef0 2024-04-15T00:32:09.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.153+0000 7f41171cf640 1 -- 172.21.15.31:0/3153346291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41101e09a0 con 0x7f41100baef0 2024-04-15T00:32:09.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.153+0000 7f410d7fa640 1 -- 172.21.15.31:0/3153346291 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f40fc018070 con 0x7f41100baef0 2024-04-15T00:32:09.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.154+0000 7f410d7fa640 1 --2- 172.21.15.31:0/3153346291 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f40f406b990 0x7f40f406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:09.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.154+0000 7f410d7fa640 1 -- 172.21.15.31:0/3153346291 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f40fc08ab50 con 0x7f41100baef0 2024-04-15T00:32:09.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.154+0000 7f4114f6b640 1 --2- 172.21.15.31:0/3153346291 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f40f406b990 0x7f40f406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:09.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.154+0000 7f4114f6b640 1 --2- 172.21.15.31:0/3153346291 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f40f406b990 0x7f40f406de50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4104000f60 tx=0x7f4104007b50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:32:09.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.158+0000 7f410d7fa640 1 -- 172.21.15.31:0/3153346291 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f40fc0593f0 con 0x7f41100baef0 2024-04-15T00:32:09.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.378+0000 7f41171cf640 1 -- 172.21.15.31:0/3153346291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4110148a40 con 0x7f41100baef0 2024-04-15T00:32:09.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.378+0000 7f410d7fa640 1 -- 172.21.15.31:0/3153346291 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3520 (secure 0 0 0) 0x7f40fc058cf0 con 0x7f41100baef0 2024-04-15T00:32:09.386 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:32:09.387 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/921487249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":921487249},{"type":"v1","addr":"172.21.15.50:6833","nonce":921487249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T00:21:07.925196+0000","modified":"2024-04-15T00:21:23.993707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/93464605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":93464605},{"type":"v1","addr":"172.21.15.31:6835","nonce":93464605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-04-15T00:32:09.387 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-04-15T00:32:09.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.380+0000 7f41171cf640 1 -- 172.21.15.31:0/3153346291 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f40f406b990 msgr2=0x7f40f406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:09.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.380+0000 7f41171cf640 1 --2- 172.21.15.31:0/3153346291 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f40f406b990 0x7f40f406de50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4104000f60 tx=0x7f4104007b50 comp rx=0 tx=0).stop 2024-04-15T00:32:09.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.380+0000 7f41171cf640 1 -- 172.21.15.31:0/3153346291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41100baef0 msgr2=0x7f41101e0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:09.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.380+0000 7f41171cf640 1 --2- 172.21.15.31:0/3153346291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41100baef0 0x7f41101e0cf0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f40fc00c820 tx=0x7f40fc00cc20 comp rx=0 tx=0).stop 2024-04-15T00:32:09.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.380+0000 7f41171cf640 1 -- 172.21.15.31:0/3153346291 shutdown_connections 2024-04-15T00:32:09.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.380+0000 7f41171cf640 1 --2- 172.21.15.31:0/3153346291 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f40f406b990 0x7f40f406de50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:09.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.380+0000 7f41171cf640 1 --2- 172.21.15.31:0/3153346291 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f411014b8e0 0x7f41101e1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:09.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.380+0000 7f41171cf640 1 --2- 172.21.15.31:0/3153346291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41100baef0 0x7f41101e0cf0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:09.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.380+0000 7f41171cf640 1 --2- 172.21.15.31:0/3153346291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41100b8bf0 0x7f41101444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:09.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.380+0000 7f41171cf640 1 -- 172.21.15.31:0/3153346291 >> 172.21.15.31:0/3153346291 conn(0x7f411009ed70 msgr2=0x7f41100bd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:32:09.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.380+0000 7f41171cf640 1 -- 172.21.15.31:0/3153346291 shutdown_connections 2024-04-15T00:32:09.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.381+0000 7f41171cf640 1 -- 172.21.15.31:0/3153346291 wait complete. 2024-04-15T00:32:09.400 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T00:32:09.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.494+0000 7ff219de0640 1 Processor -- start 2024-04-15T00:32:09.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.494+0000 7ff219de0640 1 -- start start 2024-04-15T00:32:09.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.494+0000 7ff219de0640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2140af260 0x7ff2141446d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:09.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.494+0000 7ff219de0640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff2140b3450 0x7ff2140af640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:09.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.494+0000 7ff219de0640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff214143c60 con 0x7ff2140b2480 2024-04-15T00:32:09.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.494+0000 7ff219de0640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7ff2140b38b0 con 0x7ff2140b3450 2024-04-15T00:32:09.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.494+0000 7ff219de0640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7ff214072f80 con 0x7ff2140af260 2024-04-15T00:32:09.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.494+0000 7ff212ffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff2140b3450 0x7ff2140af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:09.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.494+0000 7ff212ffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff2140b3450 0x7ff2140af640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54956/0 (socket says 172.21.15.31:54956) 2024-04-15T00:32:09.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.494+0000 7ff212ffd640 1 -- 172.21.15.31:0/588941020 learned_addr learned my addr 172.21.15.31:0/588941020 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:32:09.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.495+0000 7ff2137fe640 1 --2- 172.21.15.31:0/588941020 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2140af260 0x7ff2141446d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:09.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.495+0000 7ff212ffd640 1 -- 172.21.15.31:0/588941020 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2140af260 msgr2=0x7ff2141446d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:32:09.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.495+0000 7ff212ffd640 1 --2- 172.21.15.31:0/588941020 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2140af260 0x7ff2141446d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:09.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.495+0000 7ff212ffd640 1 -- 172.21.15.31:0/588941020 >> v1:172.21.15.50:6789/0 conn(0x7ff2140b2480 legacy=0x7ff2140b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:09.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.495+0000 7ff212ffd640 1 -- 172.21.15.31:0/588941020 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2140b0a40 con 0x7ff2140b3450 2024-04-15T00:32:09.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.495+0000 7ff212ffd640 1 --2- 172.21.15.31:0/588941020 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2140b3450 0x7ff2140af640 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff20800bb10 tx=0x7ff20802e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a742f6729d7a8d5b server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:32:09.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.496+0000 7ff2127fc640 1 -- 172.21.15.31:0/588941020 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20803b070 con 0x7ff2140b3450 2024-04-15T00:32:09.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.496+0000 7ff2127fc640 1 -- 172.21.15.31:0/588941020 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff208036440 con 0x7ff2140b3450 2024-04-15T00:32:09.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.496+0000 7ff2127fc640 1 -- 172.21.15.31:0/588941020 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff208036830 con 0x7ff2140b3450 2024-04-15T00:32:09.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.496+0000 7ff219de0640 1 -- 172.21.15.31:0/588941020 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2140b3450 msgr2=0x7ff2140af640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:09.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.496+0000 7ff219de0640 1 --2- 172.21.15.31:0/588941020 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2140b3450 0x7ff2140af640 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff20800bb10 tx=0x7ff20802e0c0 comp rx=0 tx=0).stop 2024-04-15T00:32:09.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.496+0000 7ff219de0640 1 -- 172.21.15.31:0/588941020 shutdown_connections 2024-04-15T00:32:09.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.496+0000 7ff219de0640 1 --2- 172.21.15.31:0/588941020 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2140b3450 0x7ff2140af640 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:09.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.496+0000 7ff219de0640 1 --2- 172.21.15.31:0/588941020 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2140af260 0x7ff2141446d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:09.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.496+0000 7ff219de0640 1 -- 172.21.15.31:0/588941020 >> 172.21.15.31:0/588941020 conn(0x7ff21406c470 msgr2=0x7ff21406c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:32:09.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.496+0000 7ff219de0640 1 -- 172.21.15.31:0/588941020 shutdown_connections 2024-04-15T00:32:09.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.496+0000 7ff219de0640 1 -- 172.21.15.31:0/588941020 wait complete. 2024-04-15T00:32:09.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.497+0000 7ff219de0640 1 Processor -- start 2024-04-15T00:32:09.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.497+0000 7ff219de0640 1 -- start start 2024-04-15T00:32:09.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.498+0000 7ff219de0640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2140af260 0x7ff21406fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:09.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.498+0000 7ff219de0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2140b2480 0x7ff214071980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:09.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.498+0000 7ff219de0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2140b3450 0x7ff21413e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:09.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.498+0000 7ff219de0640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff2141441b0 con 0x7ff2140b3450 2024-04-15T00:32:09.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.498+0000 7ff219de0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff214143ed0 con 0x7ff2140b2480 2024-04-15T00:32:09.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.498+0000 7ff219de0640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7ff2140aeb90 con 0x7ff2140af260 2024-04-15T00:32:09.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.498+0000 7ff213fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2140b3450 0x7ff21413e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:09.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.498+0000 7ff213fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2140b3450 0x7ff21413e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54966/0 (socket says 172.21.15.31:54966) 2024-04-15T00:32:09.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.498+0000 7ff213fff640 1 -- 172.21.15.31:0/3039475740 learned_addr learned my addr 172.21.15.31:0/3039475740 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:32:09.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.498+0000 7ff212ffd640 1 --2- 172.21.15.31:0/3039475740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2140b2480 0x7ff214071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:09.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.498+0000 7ff2137fe640 1 --2- 172.21.15.31:0/3039475740 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2140af260 0x7ff21406fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:09.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.498+0000 7ff213fff640 1 -- 172.21.15.31:0/3039475740 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2140af260 msgr2=0x7ff21406fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:09.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.498+0000 7ff213fff640 1 --2- 172.21.15.31:0/3039475740 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2140af260 0x7ff21406fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:09.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.498+0000 7ff213fff640 1 -- 172.21.15.31:0/3039475740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2140b2480 msgr2=0x7ff214071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:09.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.498+0000 7ff213fff640 1 --2- 172.21.15.31:0/3039475740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2140b2480 0x7ff214071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:09.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.499+0000 7ff213fff640 1 -- 172.21.15.31:0/3039475740 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2141cd720 con 0x7ff2140b3450 2024-04-15T00:32:09.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.499+0000 7ff2137fe640 1 --2- 172.21.15.31:0/3039475740 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2140af260 0x7ff21406fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:32:09.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.499+0000 7ff213fff640 1 --2- 172.21.15.31:0/3039475740 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2140b3450 0x7ff21413e8f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00c760 tx=0x7ff20c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:32:09.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.499+0000 7ff1fbfff640 1 -- 172.21.15.31:0/3039475740 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20c003b70 con 0x7ff2140b3450 2024-04-15T00:32:09.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.499+0000 7ff1fbfff640 1 -- 172.21.15.31:0/3039475740 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff20c003d30 con 0x7ff2140b3450 2024-04-15T00:32:09.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.499+0000 7ff219de0640 1 -- 172.21.15.31:0/3039475740 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2141cda70 con 0x7ff2140b3450 2024-04-15T00:32:09.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.499+0000 7ff1fbfff640 1 -- 172.21.15.31:0/3039475740 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20c00aab0 con 0x7ff2140b3450 2024-04-15T00:32:09.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.499+0000 7ff219de0640 1 -- 172.21.15.31:0/3039475740 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2141dd070 con 0x7ff2140b3450 2024-04-15T00:32:09.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.500+0000 7ff219de0640 1 -- 172.21.15.31:0/3039475740 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff214144a60 con 0x7ff2140b3450 2024-04-15T00:32:09.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.500+0000 7ff1fbfff640 1 -- 172.21.15.31:0/3039475740 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7ff20c00ac50 con 0x7ff2140b3450 2024-04-15T00:32:09.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.501+0000 7ff1fbfff640 1 --2- 172.21.15.31:0/3039475740 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7ff20006b990 0x7ff20006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:09.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.501+0000 7ff2137fe640 1 --2- 172.21.15.31:0/3039475740 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7ff20006b990 0x7ff20006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:09.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.501+0000 7ff1fbfff640 1 -- 172.21.15.31:0/3039475740 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff20c08aa40 con 0x7ff2140b3450 2024-04-15T00:32:09.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.501+0000 7ff2137fe640 1 --2- 172.21.15.31:0/3039475740 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7ff20006b990 0x7ff20006de50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff204006fd0 tx=0x7ff204008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:32:09.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.505+0000 7ff1fbfff640 1 -- 172.21.15.31:0/3039475740 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff214144a60 con 0x7ff2140b3450 2024-04-15T00:32:09.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.726+0000 7ff219de0640 1 -- 172.21.15.31:0/3039475740 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff21404f620 con 0x7ff2140b3450 2024-04-15T00:32:09.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.726+0000 7ff1fbfff640 1 -- 172.21.15.31:0/3039475740 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3520 (secure 0 0 0) 0x7ff20c08ae20 con 0x7ff2140b3450 2024-04-15T00:32:09.735 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:32:09.735 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/921487249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":921487249},{"type":"v1","addr":"172.21.15.50:6833","nonce":921487249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T00:21:07.925196+0000","modified":"2024-04-15T00:21:23.993707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/93464605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":93464605},{"type":"v1","addr":"172.21.15.31:6835","nonce":93464605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-04-15T00:32:09.735 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-04-15T00:32:09.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.728+0000 7ff219de0640 1 -- 172.21.15.31:0/3039475740 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7ff20006b990 msgr2=0x7ff20006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:09.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.728+0000 7ff219de0640 1 --2- 172.21.15.31:0/3039475740 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7ff20006b990 0x7ff20006de50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff204006fd0 tx=0x7ff204008040 comp rx=0 tx=0).stop 2024-04-15T00:32:09.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.728+0000 7ff219de0640 1 -- 172.21.15.31:0/3039475740 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2140b3450 msgr2=0x7ff21413e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:09.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.728+0000 7ff219de0640 1 --2- 172.21.15.31:0/3039475740 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2140b3450 0x7ff21413e8f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00c760 tx=0x7ff20c00cc20 comp rx=0 tx=0).stop 2024-04-15T00:32:09.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.728+0000 7ff219de0640 1 -- 172.21.15.31:0/3039475740 shutdown_connections 2024-04-15T00:32:09.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.728+0000 7ff219de0640 1 --2- 172.21.15.31:0/3039475740 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2140b3450 0x7ff21413e8f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:09.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.728+0000 7ff219de0640 1 --2- 172.21.15.31:0/3039475740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2140b2480 0x7ff214071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:09.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.728+0000 7ff219de0640 1 --2- 172.21.15.31:0/3039475740 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7ff20006b990 0x7ff20006de50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:09.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.728+0000 7ff219de0640 1 --2- 172.21.15.31:0/3039475740 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7ff2140af260 0x7ff21406fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:09.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.728+0000 7ff219de0640 1 -- 172.21.15.31:0/3039475740 >> 172.21.15.31:0/3039475740 conn(0x7ff21406c470 msgr2=0x7ff214069090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:32:09.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.728+0000 7ff219de0640 1 -- 172.21.15.31:0/3039475740 shutdown_connections 2024-04-15T00:32:09.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.728+0000 7ff219de0640 1 -- 172.21.15.31:0/3039475740 wait complete. 2024-04-15T00:32:09.747 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:32:09.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.840+0000 7fe1eb5ed640 1 Processor -- start 2024-04-15T00:32:09.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.841+0000 7fe1eb5ed640 1 -- start start 2024-04-15T00:32:09.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.841+0000 7fe1eb5ed640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe1e4072690 0x7fe1e414ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:09.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.841+0000 7fe1eb5ed640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1e4072a70 con 0x7fe1e4141bb0 2024-04-15T00:32:09.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.841+0000 7fe1eb5ed640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1e406f1d0 con 0x7fe1e406fde0 2024-04-15T00:32:09.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.841+0000 7fe1eb5ed640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe1e4142000 con 0x7fe1e4072690 2024-04-15T00:32:09.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.842+0000 7fe1e9b8a640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe1e4141bb0 0x7fe1e41520b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53708/0 (socket says 172.21.15.31:53708) 2024-04-15T00:32:09.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.842+0000 7fe1e9b8a640 1 -- 172.21.15.31:0/582388348 learned_addr learned my addr 172.21.15.31:0/582388348 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:32:09.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.842+0000 7fe1e9389640 1 --2- 172.21.15.31:0/582388348 >> v2:172.21.15.50:3300/0 conn(0x7fe1e4072690 0x7fe1e414ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:09.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.842+0000 7fe1dbfff640 1 -- 172.21.15.31:0/582388348 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1701521111 0 0) 0x7fe1e4072a70 con 0x7fe1e4141bb0 2024-04-15T00:32:09.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.842+0000 7fe1dbfff640 1 -- 172.21.15.31:0/582388348 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1d0003520 con 0x7fe1e4141bb0 2024-04-15T00:32:09.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.842+0000 7fe1e9389640 1 -- 172.21.15.31:0/582388348 >> v1:172.21.15.50:6789/0 conn(0x7fe1e406fde0 legacy=0x7fe1e41414a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:09.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.842+0000 7fe1e9389640 1 -- 172.21.15.31:0/582388348 >> v1:172.21.15.31:6789/0 conn(0x7fe1e4141bb0 legacy=0x7fe1e41520b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:09.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.842+0000 7fe1e9389640 1 -- 172.21.15.31:0/582388348 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e406f4b0 con 0x7fe1e4072690 2024-04-15T00:32:09.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.843+0000 7fe1e9389640 1 --2- 172.21.15.31:0/582388348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1e4072690 0x7fe1e414ae60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0009790 tx=0x7fe1e002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee01ae0e28914051 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:32:09.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.843+0000 7fe1dbfff640 1 -- 172.21.15.31:0/582388348 <== mon.1 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0034070 con 0x7fe1e4072690 2024-04-15T00:32:09.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.843+0000 7fe1dbfff640 1 -- 172.21.15.31:0/582388348 <== mon.1 v2:172.21.15.50:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe1e0030610 con 0x7fe1e4072690 2024-04-15T00:32:09.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.843+0000 7fe1dbfff640 1 -- 172.21.15.31:0/582388348 <== mon.1 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e00309c0 con 0x7fe1e4072690 2024-04-15T00:32:09.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.843+0000 7fe1eb5ed640 1 -- 172.21.15.31:0/582388348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1e4072690 msgr2=0x7fe1e414ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:09.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.843+0000 7fe1eb5ed640 1 --2- 172.21.15.31:0/582388348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1e4072690 0x7fe1e414ae60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0009790 tx=0x7fe1e002b960 comp rx=0 tx=0).stop 2024-04-15T00:32:09.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.843+0000 7fe1eb5ed640 1 -- 172.21.15.31:0/582388348 shutdown_connections 2024-04-15T00:32:09.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.843+0000 7fe1eb5ed640 1 --2- 172.21.15.31:0/582388348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1e4072690 0x7fe1e414ae60 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:09.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.843+0000 7fe1eb5ed640 1 -- 172.21.15.31:0/582388348 >> 172.21.15.31:0/582388348 conn(0x7fe1e40b7840 msgr2=0x7fe1e40b7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:32:09.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.844+0000 7fe1eb5ed640 1 -- 172.21.15.31:0/582388348 shutdown_connections 2024-04-15T00:32:09.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.844+0000 7fe1eb5ed640 1 -- 172.21.15.31:0/582388348 wait complete. 2024-04-15T00:32:09.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.845+0000 7fe1eb5ed640 1 Processor -- start 2024-04-15T00:32:09.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.845+0000 7fe1eb5ed640 1 -- start start 2024-04-15T00:32:09.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.845+0000 7fe1eb5ed640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe1e406fde0 0x7fe1e4143de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:09.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.845+0000 7fe1eb5ed640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1e4072690 0x7fe1e41dd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:09.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.845+0000 7fe1eb5ed640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1e4141bb0 0x7fe1e41dda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:09.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.845+0000 7fe1eb5ed640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e40b74a0 con 0x7fe1e4072690 2024-04-15T00:32:09.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.845+0000 7fe1eb5ed640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e406f820 con 0x7fe1e4141bb0 2024-04-15T00:32:09.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.845+0000 7fe1eb5ed640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fe1e40b7620 con 0x7fe1e406fde0 2024-04-15T00:32:09.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.845+0000 7fe1e8b88640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1e4072690 0x7fe1e41dd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:09.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.845+0000 7fe1e8b88640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1e4072690 0x7fe1e41dd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54970/0 (socket says 172.21.15.31:54970) 2024-04-15T00:32:09.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.845+0000 7fe1e8b88640 1 -- 172.21.15.31:0/1620702961 learned_addr learned my addr 172.21.15.31:0/1620702961 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:32:09.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.845+0000 7fe1e9b8a640 1 --2- 172.21.15.31:0/1620702961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1e4141bb0 0x7fe1e41dda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:09.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.845+0000 7fe1e9389640 1 --2- 172.21.15.31:0/1620702961 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe1e406fde0 0x7fe1e4143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:09.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.846+0000 7fe1e8b88640 1 -- 172.21.15.31:0/1620702961 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe1e406fde0 msgr2=0x7fe1e4143de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:09.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.846+0000 7fe1e8b88640 1 --2- 172.21.15.31:0/1620702961 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe1e406fde0 0x7fe1e4143de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:09.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.846+0000 7fe1e8b88640 1 -- 172.21.15.31:0/1620702961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1e4141bb0 msgr2=0x7fe1e41dda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:09.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.846+0000 7fe1e8b88640 1 --2- 172.21.15.31:0/1620702961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1e4141bb0 0x7fe1e41dda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:09.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.846+0000 7fe1e8b88640 1 -- 172.21.15.31:0/1620702961 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e4144770 con 0x7fe1e4072690 2024-04-15T00:32:09.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.846+0000 7fe1e8b88640 1 --2- 172.21.15.31:0/1620702961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1e4072690 0x7fe1e41dd4e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe1d400c3c0 tx=0x7fe1d400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:32:09.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.846+0000 7fe1d9ffb640 1 -- 172.21.15.31:0/1620702961 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d40052d0 con 0x7fe1e4072690 2024-04-15T00:32:09.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.846+0000 7fe1d9ffb640 1 -- 172.21.15.31:0/1620702961 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe1d4005490 con 0x7fe1e4072690 2024-04-15T00:32:09.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.846+0000 7fe1eb5ed640 1 -- 172.21.15.31:0/1620702961 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1e40b00e0 con 0x7fe1e4072690 2024-04-15T00:32:09.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.846+0000 7fe1d9ffb640 1 -- 172.21.15.31:0/1620702961 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4007280 con 0x7fe1e4072690 2024-04-15T00:32:09.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.846+0000 7fe1eb5ed640 1 -- 172.21.15.31:0/1620702961 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1e40afe00 con 0x7fe1e4072690 2024-04-15T00:32:09.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.847+0000 7fe1eb5ed640 1 -- 172.21.15.31:0/1620702961 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1e414b1b0 con 0x7fe1e4072690 2024-04-15T00:32:09.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.847+0000 7fe1d9ffb640 1 -- 172.21.15.31:0/1620702961 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fe1d4007420 con 0x7fe1e4072690 2024-04-15T00:32:09.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.848+0000 7fe1d9ffb640 1 --2- 172.21.15.31:0/1620702961 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe1c806b9c0 0x7fe1c806de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:09.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.848+0000 7fe1d9ffb640 1 -- 172.21.15.31:0/1620702961 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fe1d408a0d0 con 0x7fe1e4072690 2024-04-15T00:32:09.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.848+0000 7fe1e9389640 1 --2- 172.21.15.31:0/1620702961 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe1c806b9c0 0x7fe1c806de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:09.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.848+0000 7fe1e9389640 1 --2- 172.21.15.31:0/1620702961 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe1c806b9c0 0x7fe1c806de80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0036000 tx=0x7fe1e0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:32:09.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:09.852+0000 7fe1d9ffb640 1 -- 172.21.15.31:0/1620702961 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe1d40588f0 con 0x7fe1e4072690 2024-04-15T00:32:10.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.033+0000 7fe1eb5ed640 1 -- 172.21.15.31:0/1620702961 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe1e404f620 con 0x7fe1e4072690 2024-04-15T00:32:10.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.035+0000 7fe1d9ffb640 1 -- 172.21.15.31:0/1620702961 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18841 (secure 0 0 0) 0x7fe1d40581f0 con 0x7fe1e4072690 2024-04-15T00:32:10.044 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-15T00:32:10.044 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":27,"fsid":"b57c03ab-2810-4ea5-b233-6164468328c0","created":"2024-04-15T00:20:44.073217+0000","modified":"2024-04-15T00:21:49.696289+0000","last_up_change":"2024-04-15T00:20:55.515596+0000","last_in_change":"2024-04-15T00:20:46.364541+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:20:56.423161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:21:06.436169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:21:06.888505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:21:10.610300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b085a2f4-5565-4ccc-a98e-e56180791550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6817","nonce":2355720818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6819","nonce":2355720818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6823","nonce":2355720818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2355720818},{"type":"v1","addr":"172.21.15.31:6821","nonce":2355720818}]},"public_addr":"172.21.15.31:6817/2355720818","cluster_addr":"172.21.15.31:6819/2355720818","heartbeat_back_addr":"172.21.15.31:6823/2355720818","heartbeat_front_addr":"172.21.15.31:6821/2355720818","state":["exists","up"]},{"osd":1,"uuid":"0f751557-3f18-464f-8b78-614d19549f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6809","nonce":2705297130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6811","nonce":2705297130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6815","nonce":2705297130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2705297130},{"type":"v1","addr":"172.21.15.31:6813","nonce":2705297130}]},"public_addr":"172.21.15.31:6809/2705297130","cluster_addr":"172.21.15.31:6811/2705297130","heartbeat_back_addr":"172.21.15.31:6815/2705297130","heartbeat_front_addr":"172.21.15.31:6813/2705297130","state":["exists","up"]},{"osd":2,"uuid":"17371b09-2bd7-4ef7-926f-e7706319f064","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6801","nonce":225061474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6803","nonce":225061474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6807","nonce":225061474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":225061474},{"type":"v1","addr":"172.21.15.31:6805","nonce":225061474}]},"public_addr":"172.21.15.31:6801/225061474","cluster_addr":"172.21.15.31:6803/225061474","heartbeat_back_addr":"172.21.15.31:6807/225061474","heartbeat_front_addr":"172.21.15.31:6805/225061474","state":["exists","up"]},{"osd":3,"uuid":"315b6949-f009-4291-9581-aa4912642dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6825","nonce":3722449780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6827","nonce":3722449780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6831","nonce":3722449780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3722449780},{"type":"v1","addr":"172.21.15.31:6829","nonce":3722449780}]},"public_addr":"172.21.15.31:6825/3722449780","cluster_addr":"172.21.15.31:6827/3722449780","heartbeat_back_addr":"172.21.15.31:6831/3722449780","heartbeat_front_addr":"172.21.15.31:6829/3722449780","state":["exists","up"]},{"osd":4,"uuid":"e3659369-cc78-4aa8-bd10-a199d4a1569d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6801","nonce":1279970071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6803","nonce":1279970071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6807","nonce":1279970071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":1279970071},{"type":"v1","addr":"172.21.15.50:6805","nonce":1279970071}]},"public_addr":"172.21.15.50:6801/1279970071","cluster_addr":"172.21.15.50:6803/1279970071","heartbeat_back_addr":"172.21.15.50:6807/1279970071","heartbeat_front_addr":"172.21.15.50:6805/1279970071","state":["exists","up"]},{"osd":5,"uuid":"35c3a4c0-0b45-45d2-85b9-301c347602f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6809","nonce":1589417182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6811","nonce":1589417182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6815","nonce":1589417182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":1589417182},{"type":"v1","addr":"172.21.15.50:6813","nonce":1589417182}]},"public_addr":"172.21.15.50:6809/1589417182","cluster_addr":"172.21.15.50:6811/1589417182","heartbeat_back_addr":"172.21.15.50:6815/1589417182","heartbeat_front_addr":"172.21.15.50:6813/1589417182","state":["exists","up"]},{"osd":6,"uuid":"20df7a76-245f-4946-9624-6ca9e949227b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6817","nonce":682288274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6819","nonce":682288274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6823","nonce":682288274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":682288274},{"type":"v1","addr":"172.21.15.50:6821","nonce":682288274}]},"public_addr":"172.21.15.50:6817/682288274","cluster_addr":"172.21.15.50:6819/682288274","heartbeat_back_addr":"172.21.15.50:6823/682288274","heartbeat_front_addr":"172.21.15.50:6821/682288274","state":["exists","up"]},{"osd":7,"uuid":"95a504b7-e13a-49e6-8484-9dff4d5fc048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6825","nonce":4129060906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6827","nonce":4129060906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6831","nonce":4129060906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4129060906},{"type":"v1","addr":"172.21.15.50:6829","nonce":4129060906}]},"public_addr":"172.21.15.50:6825/4129060906","cluster_addr":"172.21.15.50:6827/4129060906","heartbeat_back_addr":"172.21.15.50:6831/4129060906","heartbeat_front_addr":"172.21.15.50:6829/4129060906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.501980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.529961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.540913+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.521396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.448364+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.514136+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.527229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:20:51.508950+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:32:10.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.037+0000 7fe1eb5ed640 1 -- 172.21.15.31:0/1620702961 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe1c806b9c0 msgr2=0x7fe1c806de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:10.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.037+0000 7fe1eb5ed640 1 --2- 172.21.15.31:0/1620702961 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe1c806b9c0 0x7fe1c806de80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0036000 tx=0x7fe1e0008030 comp rx=0 tx=0).stop 2024-04-15T00:32:10.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.037+0000 7fe1eb5ed640 1 -- 172.21.15.31:0/1620702961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1e4072690 msgr2=0x7fe1e41dd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:10.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.037+0000 7fe1eb5ed640 1 --2- 172.21.15.31:0/1620702961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1e4072690 0x7fe1e41dd4e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe1d400c3c0 tx=0x7fe1d400c880 comp rx=0 tx=0).stop 2024-04-15T00:32:10.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.037+0000 7fe1eb5ed640 1 -- 172.21.15.31:0/1620702961 shutdown_connections 2024-04-15T00:32:10.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.037+0000 7fe1eb5ed640 1 --2- 172.21.15.31:0/1620702961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1e4141bb0 0x7fe1e41dda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:10.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.037+0000 7fe1eb5ed640 1 --2- 172.21.15.31:0/1620702961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1e4072690 0x7fe1e41dd4e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:10.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.037+0000 7fe1eb5ed640 1 --2- 172.21.15.31:0/1620702961 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fe1c806b9c0 0x7fe1c806de80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:10.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.037+0000 7fe1eb5ed640 1 --2- 172.21.15.31:0/1620702961 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fe1e406fde0 0x7fe1e4143de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:10.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.037+0000 7fe1eb5ed640 1 -- 172.21.15.31:0/1620702961 >> 172.21.15.31:0/1620702961 conn(0x7fe1e40b7840 msgr2=0x7fe1e40b7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:32:10.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.037+0000 7fe1eb5ed640 1 -- 172.21.15.31:0/1620702961 shutdown_connections 2024-04-15T00:32:10.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.037+0000 7fe1eb5ed640 1 -- 172.21.15.31:0/1620702961 wait complete. 2024-04-15T00:32:10.058 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-15T00:32:10.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.153+0000 7fc3418de640 1 Processor -- start 2024-04-15T00:32:10.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.153+0000 7fc3418de640 1 -- start start 2024-04-15T00:32:10.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.153+0000 7fc3418de640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc33c067180 0x7fc33c09fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:10.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.153+0000 7fc3418de640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc33c14ada0 0x7fc33c0b5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:10.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.153+0000 7fc3418de640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc33c0b5860 con 0x7fc33c1480e0 2024-04-15T00:32:10.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.153+0000 7fc3418de640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fc33c09f6d0 con 0x7fc33c14ada0 2024-04-15T00:32:10.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.153+0000 7fc3418de640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc33c14b210 con 0x7fc33c067180 2024-04-15T00:32:10.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.153+0000 7fc33a7fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc33c14ada0 0x7fc33c0b5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:10.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.153+0000 7fc33a7fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc33c14ada0 0x7fc33c0b5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54986/0 (socket says 172.21.15.31:54986) 2024-04-15T00:32:10.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.153+0000 7fc33a7fc640 1 -- 172.21.15.31:0/3055180059 learned_addr learned my addr 172.21.15.31:0/3055180059 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:32:10.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.154+0000 7fc33affd640 1 --2- 172.21.15.31:0/3055180059 >> v2:172.21.15.50:3300/0 conn(0x7fc33c067180 0x7fc33c09fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:10.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.154+0000 7fc33a7fc640 1 -- 172.21.15.31:0/3055180059 >> v2:172.21.15.50:3300/0 conn(0x7fc33c067180 msgr2=0x7fc33c09fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:32:10.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.154+0000 7fc33a7fc640 1 --2- 172.21.15.31:0/3055180059 >> v2:172.21.15.50:3300/0 conn(0x7fc33c067180 0x7fc33c09fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:10.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.154+0000 7fc33a7fc640 1 -- 172.21.15.31:0/3055180059 >> v1:172.21.15.50:6789/0 conn(0x7fc33c1480e0 legacy=0x7fc33c06b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:10.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.154+0000 7fc33a7fc640 1 -- 172.21.15.31:0/3055180059 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc33c0b55c0 con 0x7fc33c14ada0 2024-04-15T00:32:10.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.154+0000 7fc33affd640 1 --2- 172.21.15.31:0/3055180059 >> v2:172.21.15.50:3300/0 conn(0x7fc33c067180 0x7fc33c09fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:32:10.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.154+0000 7fc33a7fc640 1 --2- 172.21.15.31:0/3055180059 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc33c14ada0 0x7fc33c0b5dc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc33c06c350 tx=0x7fc32402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e24e288b6c0994 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:32:10.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.155+0000 7fc339ffb640 1 -- 172.21.15.31:0/3055180059 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32402e070 con 0x7fc33c14ada0 2024-04-15T00:32:10.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.155+0000 7fc339ffb640 1 -- 172.21.15.31:0/3055180059 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc324037070 con 0x7fc33c14ada0 2024-04-15T00:32:10.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.155+0000 7fc339ffb640 1 -- 172.21.15.31:0/3055180059 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc324031a20 con 0x7fc33c14ada0 2024-04-15T00:32:10.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.155+0000 7fc3418de640 1 -- 172.21.15.31:0/3055180059 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc33c14ada0 msgr2=0x7fc33c0b5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:10.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.155+0000 7fc3418de640 1 --2- 172.21.15.31:0/3055180059 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc33c14ada0 0x7fc33c0b5dc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc33c06c350 tx=0x7fc32402b880 comp rx=0 tx=0).stop 2024-04-15T00:32:10.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.155+0000 7fc3418de640 1 -- 172.21.15.31:0/3055180059 shutdown_connections 2024-04-15T00:32:10.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.155+0000 7fc3418de640 1 --2- 172.21.15.31:0/3055180059 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc33c14ada0 0x7fc33c0b5dc0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:10.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.155+0000 7fc3418de640 1 --2- 172.21.15.31:0/3055180059 >> v2:172.21.15.50:3300/0 conn(0x7fc33c067180 0x7fc33c09fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:10.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.155+0000 7fc3418de640 1 -- 172.21.15.31:0/3055180059 >> 172.21.15.31:0/3055180059 conn(0x7fc33c06d270 msgr2=0x7fc33c06d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:32:10.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.155+0000 7fc3418de640 1 -- 172.21.15.31:0/3055180059 shutdown_connections 2024-04-15T00:32:10.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.155+0000 7fc3418de640 1 -- 172.21.15.31:0/3055180059 wait complete. 2024-04-15T00:32:10.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.156+0000 7fc3418de640 1 Processor -- start 2024-04-15T00:32:10.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.156+0000 7fc3418de640 1 -- start start 2024-04-15T00:32:10.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.157+0000 7fc3418de640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc33c067180 0x7fc33c1d0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:10.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.157+0000 7fc3418de640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc33c1480e0 0x7fc33c0b8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:10.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.157+0000 7fc3418de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc33c14ada0 0x7fc33c13d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:10.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.157+0000 7fc3418de640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c0af0d0 con 0x7fc33c067180 2024-04-15T00:32:10.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.157+0000 7fc3418de640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c0aedf0 con 0x7fc33c14ada0 2024-04-15T00:32:10.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.157+0000 7fc3418de640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fc33c0b44d0 con 0x7fc33c1480e0 2024-04-15T00:32:10.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.157+0000 7fc33affd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc33c067180 0x7fc33c1d0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:10.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.157+0000 7fc33affd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc33c067180 0x7fc33c1d0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54994/0 (socket says 172.21.15.31:54994) 2024-04-15T00:32:10.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.157+0000 7fc33affd640 1 -- 172.21.15.31:0/3388127169 learned_addr learned my addr 172.21.15.31:0/3388127169 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:32:10.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.157+0000 7fc33b7fe640 1 --2- 172.21.15.31:0/3388127169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc33c14ada0 0x7fc33c13d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:10.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.157+0000 7fc33a7fc640 1 --2- 172.21.15.31:0/3388127169 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc33c1480e0 0x7fc33c0b8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:10.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.157+0000 7fc33affd640 1 -- 172.21.15.31:0/3388127169 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc33c1480e0 msgr2=0x7fc33c0b8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:10.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.157+0000 7fc33affd640 1 --2- 172.21.15.31:0/3388127169 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc33c1480e0 0x7fc33c0b8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:10.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.157+0000 7fc33affd640 1 -- 172.21.15.31:0/3388127169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc33c14ada0 msgr2=0x7fc33c13d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:10.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.157+0000 7fc33affd640 1 --2- 172.21.15.31:0/3388127169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc33c14ada0 0x7fc33c13d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:10.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.157+0000 7fc33affd640 1 -- 172.21.15.31:0/3388127169 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc33c0704b0 con 0x7fc33c067180 2024-04-15T00:32:10.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.157+0000 7fc33a7fc640 1 --2- 172.21.15.31:0/3388127169 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc33c1480e0 0x7fc33c0b8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:32:10.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.158+0000 7fc33affd640 1 --2- 172.21.15.31:0/3388127169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc33c067180 0x7fc33c1d0b70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc33400e7e0 tx=0x7fc33400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:32:10.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.158+0000 7fc333fff640 1 -- 172.21.15.31:0/3388127169 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33400f040 con 0x7fc33c067180 2024-04-15T00:32:10.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.158+0000 7fc333fff640 1 -- 172.21.15.31:0/3388127169 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc334004030 con 0x7fc33c067180 2024-04-15T00:32:10.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.158+0000 7fc333fff640 1 -- 172.21.15.31:0/3388127169 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334004420 con 0x7fc33c067180 2024-04-15T00:32:10.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.158+0000 7fc3418de640 1 -- 172.21.15.31:0/3388127169 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc33c13e810 con 0x7fc33c067180 2024-04-15T00:32:10.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.158+0000 7fc3418de640 1 -- 172.21.15.31:0/3388127169 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc33c14aa90 con 0x7fc33c067180 2024-04-15T00:32:10.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.159+0000 7fc3418de640 1 -- 172.21.15.31:0/3388127169 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc33c0b5a30 con 0x7fc33c067180 2024-04-15T00:32:10.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.159+0000 7fc333fff640 1 -- 172.21.15.31:0/3388127169 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc33400c6d0 con 0x7fc33c067180 2024-04-15T00:32:10.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.159+0000 7fc333fff640 1 --2- 172.21.15.31:0/3388127169 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc31c06b9c0 0x7fc31c06de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:10.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.160+0000 7fc333fff640 1 -- 172.21.15.31:0/3388127169 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fc33408a8e0 con 0x7fc33c067180 2024-04-15T00:32:10.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.160+0000 7fc33a7fc640 1 --2- 172.21.15.31:0/3388127169 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc31c06b9c0 0x7fc31c06de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:10.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.160+0000 7fc33a7fc640 1 --2- 172.21.15.31:0/3388127169 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc31c06b9c0 0x7fc31c06de80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc324036000 tx=0x7fc32403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:32:10.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.164+0000 7fc333fff640 1 -- 172.21.15.31:0/3388127169 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc334017020 con 0x7fc33c067180 2024-04-15T00:32:10.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.383+0000 7fc3418de640 1 -- 172.21.15.31:0/3388127169 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc33c04f620 con 0x7fc33c067180 2024-04-15T00:32:10.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.385+0000 7fc333fff640 1 -- 172.21.15.31:0/3388127169 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7fc3340045c0 con 0x7fc33c067180 2024-04-15T00:32:10.393 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-15T00:32:10.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.387+0000 7fc3418de640 1 -- 172.21.15.31:0/3388127169 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc31c06b9c0 msgr2=0x7fc31c06de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:10.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.387+0000 7fc3418de640 1 --2- 172.21.15.31:0/3388127169 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc31c06b9c0 0x7fc31c06de80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc324036000 tx=0x7fc32403d040 comp rx=0 tx=0).stop 2024-04-15T00:32:10.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.387+0000 7fc3418de640 1 -- 172.21.15.31:0/3388127169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc33c067180 msgr2=0x7fc33c1d0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:10.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.387+0000 7fc3418de640 1 --2- 172.21.15.31:0/3388127169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc33c067180 0x7fc33c1d0b70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc33400e7e0 tx=0x7fc33400eca0 comp rx=0 tx=0).stop 2024-04-15T00:32:10.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.388+0000 7fc3418de640 1 -- 172.21.15.31:0/3388127169 shutdown_connections 2024-04-15T00:32:10.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.388+0000 7fc3418de640 1 --2- 172.21.15.31:0/3388127169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc33c14ada0 0x7fc33c13d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:10.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.388+0000 7fc3418de640 1 --2- 172.21.15.31:0/3388127169 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc31c06b9c0 0x7fc31c06de80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:10.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.388+0000 7fc3418de640 1 --2- 172.21.15.31:0/3388127169 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc33c1480e0 0x7fc33c0b8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:10.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.388+0000 7fc3418de640 1 --2- 172.21.15.31:0/3388127169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc33c067180 0x7fc33c1d0b70 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:10.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.388+0000 7fc3418de640 1 -- 172.21.15.31:0/3388127169 >> 172.21.15.31:0/3388127169 conn(0x7fc33c06d270 msgr2=0x7fc33c06b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:32:10.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.388+0000 7fc3418de640 1 -- 172.21.15.31:0/3388127169 shutdown_connections 2024-04-15T00:32:10.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.389+0000 7fc3418de640 1 -- 172.21.15.31:0/3388127169 wait complete. 2024-04-15T00:32:10.409 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-15T00:32:10.472 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-04-15T00:32:10.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.506+0000 7fc0e34de640 1 Processor -- start 2024-04-15T00:32:10.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.507+0000 7fc0e34de640 1 -- start start 2024-04-15T00:32:10.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.507+0000 7fc0e34de640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc0dc072750 0x7fc0dc09bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:10.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.507+0000 7fc0e34de640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0dc072b30 con 0x7fc0dc0b91c0 2024-04-15T00:32:10.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.507+0000 7fc0e34de640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0dc0bad90 con 0x7fc0dc09c4d0 2024-04-15T00:32:10.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.507+0000 7fc0e34de640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fc0dc0b0580 con 0x7fc0dc072750 2024-04-15T00:32:10.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.507+0000 7fc0e127a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc0dc072750 0x7fc0dc09bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:10.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.507+0000 7fc0e1a7b640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc0dc0b91c0 0x7fc0dc152190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53716/0 (socket says 172.21.15.31:53716) 2024-04-15T00:32:10.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.507+0000 7fc0e1a7b640 1 -- 172.21.15.31:0/322333576 learned_addr learned my addr 172.21.15.31:0/322333576 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:32:10.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.508+0000 7fc0e127a640 1 -- 172.21.15.31:0/322333576 >> v1:172.21.15.50:6789/0 conn(0x7fc0dc09c4d0 legacy=0x7fc0dc0b8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:10.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.508+0000 7fc0e127a640 1 -- 172.21.15.31:0/322333576 >> v1:172.21.15.31:6789/0 conn(0x7fc0dc0b91c0 legacy=0x7fc0dc152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:10.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.508+0000 7fc0e127a640 1 -- 172.21.15.31:0/322333576 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0dc0bb070 con 0x7fc0dc072750 2024-04-15T00:32:10.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.508+0000 7fc0e127a640 1 --2- 172.21.15.31:0/322333576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0dc072750 0x7fc0dc09bf90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc0097a0 tx=0x7fc0cc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c75f9af18defbb4e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:32:10.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.509+0000 7fc0d3fff640 1 -- 172.21.15.31:0/322333576 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc035020 con 0x7fc0dc072750 2024-04-15T00:32:10.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.509+0000 7fc0d3fff640 1 -- 172.21.15.31:0/322333576 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc0cc031830 con 0x7fc0dc072750 2024-04-15T00:32:10.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.509+0000 7fc0d3fff640 1 -- 172.21.15.31:0/322333576 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc031c20 con 0x7fc0dc072750 2024-04-15T00:32:10.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.509+0000 7fc0e34de640 1 -- 172.21.15.31:0/322333576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0dc072750 msgr2=0x7fc0dc09bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:10.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.509+0000 7fc0e34de640 1 --2- 172.21.15.31:0/322333576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0dc072750 0x7fc0dc09bf90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc0097a0 tx=0x7fc0cc02b8d0 comp rx=0 tx=0).stop 2024-04-15T00:32:10.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.509+0000 7fc0e34de640 1 -- 172.21.15.31:0/322333576 shutdown_connections 2024-04-15T00:32:10.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.509+0000 7fc0e34de640 1 --2- 172.21.15.31:0/322333576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0dc072750 0x7fc0dc09bf90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:10.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.509+0000 7fc0e34de640 1 -- 172.21.15.31:0/322333576 >> 172.21.15.31:0/322333576 conn(0x7fc0dc0bcef0 msgr2=0x7fc0dc0bd300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:32:10.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.509+0000 7fc0e34de640 1 -- 172.21.15.31:0/322333576 shutdown_connections 2024-04-15T00:32:10.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.509+0000 7fc0e34de640 1 -- 172.21.15.31:0/322333576 wait complete. 2024-04-15T00:32:10.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.510+0000 7fc0e34de640 1 Processor -- start 2024-04-15T00:32:10.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.510+0000 7fc0e34de640 1 -- start start 2024-04-15T00:32:10.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.511+0000 7fc0e34de640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0dc072750 0x7fc0dc0b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:10.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.511+0000 7fc0e34de640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc0dc09c4d0 0x7fc0dc1cf320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:10.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.511+0000 7fc0e34de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0dc0b91c0 0x7fc0dc1ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:10.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.511+0000 7fc0e34de640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc0dc074530 con 0x7fc0dc072750 2024-04-15T00:32:10.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.511+0000 7fc0e34de640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc0dc1478f0 con 0x7fc0dc0b91c0 2024-04-15T00:32:10.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.511+0000 7fc0e34de640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fc0dc0b3c80 con 0x7fc0dc09c4d0 2024-04-15T00:32:10.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.511+0000 7fc0e127a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0dc072750 0x7fc0dc0b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:10.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.511+0000 7fc0e127a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0dc072750 0x7fc0dc0b3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55028/0 (socket says 172.21.15.31:55028) 2024-04-15T00:32:10.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.511+0000 7fc0e127a640 1 -- 172.21.15.31:0/1701133282 learned_addr learned my addr 172.21.15.31:0/1701133282 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:32:10.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.511+0000 7fc0e1a7b640 1 --2- 172.21.15.31:0/1701133282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0dc0b91c0 0x7fc0dc1ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:10.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.511+0000 7fc0e0a79640 1 --2- 172.21.15.31:0/1701133282 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc0dc09c4d0 0x7fc0dc1cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:10.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.511+0000 7fc0e127a640 1 -- 172.21.15.31:0/1701133282 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc0dc09c4d0 msgr2=0x7fc0dc1cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:10.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.511+0000 7fc0e127a640 1 --2- 172.21.15.31:0/1701133282 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc0dc09c4d0 0x7fc0dc1cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:10.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.511+0000 7fc0e127a640 1 -- 172.21.15.31:0/1701133282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0dc0b91c0 msgr2=0x7fc0dc1ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:10.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.511+0000 7fc0e127a640 1 --2- 172.21.15.31:0/1701133282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0dc0b91c0 0x7fc0dc1ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:10.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.511+0000 7fc0e127a640 1 -- 172.21.15.31:0/1701133282 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0dc0b09e0 con 0x7fc0dc072750 2024-04-15T00:32:10.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.511+0000 7fc0e127a640 1 --2- 172.21.15.31:0/1701133282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0dc072750 0x7fc0dc0b3360 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc0098c0 tx=0x7fc0cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:32:10.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.512+0000 7fc0d1ffb640 1 -- 172.21.15.31:0/1701133282 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc041070 con 0x7fc0dc072750 2024-04-15T00:32:10.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.512+0000 7fc0d1ffb640 1 -- 172.21.15.31:0/1701133282 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc0cc03ac00 con 0x7fc0dc072750 2024-04-15T00:32:10.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.512+0000 7fc0e34de640 1 -- 172.21.15.31:0/1701133282 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0dc1cda10 con 0x7fc0dc072750 2024-04-15T00:32:10.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.512+0000 7fc0d1ffb640 1 -- 172.21.15.31:0/1701133282 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc035040 con 0x7fc0dc072750 2024-04-15T00:32:10.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.512+0000 7fc0e34de640 1 -- 172.21.15.31:0/1701133282 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0dc0b39f0 con 0x7fc0dc072750 2024-04-15T00:32:10.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.513+0000 7fc0e34de640 1 -- 172.21.15.31:0/1701133282 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0dc04f540 con 0x7fc0dc072750 2024-04-15T00:32:10.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.513+0000 7fc0d1ffb640 1 -- 172.21.15.31:0/1701133282 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc0cc04c060 con 0x7fc0dc072750 2024-04-15T00:32:10.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.514+0000 7fc0d1ffb640 1 --2- 172.21.15.31:0/1701133282 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc0c006b990 0x7fc0c006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:10.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.514+0000 7fc0d1ffb640 1 -- 172.21.15.31:0/1701133282 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7fc0cc0ac870 con 0x7fc0dc072750 2024-04-15T00:32:10.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.514+0000 7fc0e0a79640 1 --2- 172.21.15.31:0/1701133282 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc0c006b990 0x7fc0c006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:10.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.514+0000 7fc0e0a79640 1 --2- 172.21.15.31:0/1701133282 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc0c006b990 0x7fc0c006de50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc0b2a10 tx=0x7fc0d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:32:10.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.518+0000 7fc0d1ffb640 1 -- 172.21.15.31:0/1701133282 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc0dc0b09e0 con 0x7fc0dc072750 2024-04-15T00:32:10.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:10.736+0000 7fc0e34de640 1 -- 172.21.15.31:0/1701133282 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc0dc1ce100 con 0x7fc0dc072750 2024-04-15T00:32:11.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.392+0000 7fc0d1ffb640 1 -- 172.21.15.31:0/1701133282 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7fc0cc07b0b0 con 0x7fc0dc072750 2024-04-15T00:32:11.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.395+0000 7fc0e34de640 1 -- 172.21.15.31:0/1701133282 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc0c006b990 msgr2=0x7fc0c006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:11.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.395+0000 7fc0e34de640 1 --2- 172.21.15.31:0/1701133282 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc0c006b990 0x7fc0c006de50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc0b2a10 tx=0x7fc0d8009040 comp rx=0 tx=0).stop 2024-04-15T00:32:11.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.395+0000 7fc0e34de640 1 -- 172.21.15.31:0/1701133282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0dc072750 msgr2=0x7fc0dc0b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:11.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.395+0000 7fc0e34de640 1 --2- 172.21.15.31:0/1701133282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0dc072750 0x7fc0dc0b3360 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc0098c0 tx=0x7fc0cc0046c0 comp rx=0 tx=0).stop 2024-04-15T00:32:11.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.395+0000 7fc0e34de640 1 -- 172.21.15.31:0/1701133282 shutdown_connections 2024-04-15T00:32:11.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.395+0000 7fc0e34de640 1 --2- 172.21.15.31:0/1701133282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0dc0b91c0 0x7fc0dc1ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:11.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.395+0000 7fc0e34de640 1 --2- 172.21.15.31:0/1701133282 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fc0c006b990 0x7fc0c006de50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:11.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.395+0000 7fc0e34de640 1 --2- 172.21.15.31:0/1701133282 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fc0dc09c4d0 0x7fc0dc1cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:11.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.395+0000 7fc0e34de640 1 --2- 172.21.15.31:0/1701133282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0dc072750 0x7fc0dc0b3360 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:11.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.395+0000 7fc0e34de640 1 -- 172.21.15.31:0/1701133282 >> 172.21.15.31:0/1701133282 conn(0x7fc0dc0bcef0 msgr2=0x7fc0dc09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:32:11.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.395+0000 7fc0e34de640 1 -- 172.21.15.31:0/1701133282 shutdown_connections 2024-04-15T00:32:11.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.395+0000 7fc0e34de640 1 -- 172.21.15.31:0/1701133282 wait complete. 2024-04-15T00:32:11.418 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-15T00:32:11.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.598+0000 7f2f4d9cc640 1 Processor -- start 2024-04-15T00:32:11.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.598+0000 7f2f4d9cc640 1 -- start start 2024-04-15T00:32:11.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.598+0000 7f2f4d9cc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2f480b59b0 0x7f2f4806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:11.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.599+0000 7f2f4d9cc640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f480b5d90 con 0x7f2f480b7090 2024-04-15T00:32:11.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.599+0000 7f2f4d9cc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f4806bcf0 con 0x7f2f4806cfc0 2024-04-15T00:32:11.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.599+0000 7f2f4d9cc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f2f4814ac50 con 0x7f2f480b59b0 2024-04-15T00:32:11.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.599+0000 7f2f477fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f2f480b7090 0x7f2f48151fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53720/0 (socket says 172.21.15.31:53720) 2024-04-15T00:32:11.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.599+0000 7f2f477fe640 1 -- 172.21.15.31:0/2242772518 learned_addr learned my addr 172.21.15.31:0/2242772518 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:32:11.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.599+0000 7f2f46ffd640 1 --2- 172.21.15.31:0/2242772518 >> v2:172.21.15.50:3300/0 conn(0x7f2f480b59b0 0x7f2f4806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:11.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.599+0000 7f2f467fc640 1 -- 172.21.15.31:0/2242772518 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 746560644 0 0) 0x7f2f480b5d90 con 0x7f2f480b7090 2024-04-15T00:32:11.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.599+0000 7f2f467fc640 1 -- 172.21.15.31:0/2242772518 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f34003520 con 0x7f2f480b7090 2024-04-15T00:32:11.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.599+0000 7f2f467fc640 1 -- 172.21.15.31:0/2242772518 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 370536625 0 0) 0x7f2f34003520 con 0x7f2f480b7090 2024-04-15T00:32:11.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.599+0000 7f2f467fc640 1 -- 172.21.15.31:0/2242772518 >> v2:172.21.15.50:3300/0 conn(0x7f2f480b59b0 msgr2=0x7f2f4806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:32:11.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.599+0000 7f2f467fc640 1 --2- 172.21.15.31:0/2242772518 >> v2:172.21.15.50:3300/0 conn(0x7f2f480b59b0 0x7f2f4806c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:11.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.599+0000 7f2f467fc640 1 -- 172.21.15.31:0/2242772518 >> v1:172.21.15.50:6789/0 conn(0x7f2f4806cfc0 legacy=0x7f2f480b6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:11.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.599+0000 7f2f467fc640 1 -- 172.21.15.31:0/2242772518 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f4814aea0 con 0x7f2f480b7090 2024-04-15T00:32:11.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.599+0000 7f2f467fc640 1 -- 172.21.15.31:0/2242772518 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 697057150 0 0) 0x7f2f400019f0 con 0x7f2f480b7090 2024-04-15T00:32:11.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.599+0000 7f2f467fc640 1 -- 172.21.15.31:0/2242772518 >> v1:172.21.15.31:6789/0 conn(0x7f2f480b7090 legacy=0x7f2f48151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:11.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.599+0000 7f2f467fc640 1 --2- 172.21.15.31:0/2242772518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f340039b0 0x7f2f34003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:11.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.599+0000 7f2f467fc640 1 --2- 172.21.15.31:0/2242772518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f34004800 0x7f2f34004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:11.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.599+0000 7f2f467fc640 1 --2- 172.21.15.31:0/2242772518 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f340052e0 0x7f2f3400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:11.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.599+0000 7f2f467fc640 1 -- 172.21.15.31:0/2242772518 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4814ac50 con 0x7f2f34004800 2024-04-15T00:32:11.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.599+0000 7f2f467fc640 1 -- 172.21.15.31:0/2242772518 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2f3400c1b0 con 0x7f2f340039b0 2024-04-15T00:32:11.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.599+0000 7f2f467fc640 1 -- 172.21.15.31:0/2242772518 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f2f3400c3b0 con 0x7f2f340052e0 2024-04-15T00:32:11.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.599+0000 7f2f3ffff640 1 --2- 172.21.15.31:0/2242772518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f34004800 0x7f2f34004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:11.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.599+0000 7f2f46ffd640 1 --2- 172.21.15.31:0/2242772518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f340039b0 0x7f2f34003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:11.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.600+0000 7f2f477fe640 1 --2- 172.21.15.31:0/2242772518 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f340052e0 0x7f2f3400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:11.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.600+0000 7f2f3ffff640 1 -- 172.21.15.31:0/2242772518 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f340052e0 msgr2=0x7f2f3400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:32:11.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.600+0000 7f2f3ffff640 1 --2- 172.21.15.31:0/2242772518 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f340052e0 0x7f2f3400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:11.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.600+0000 7f2f3ffff640 1 -- 172.21.15.31:0/2242772518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f340039b0 msgr2=0x7f2f34003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:32:11.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.600+0000 7f2f3ffff640 1 --2- 172.21.15.31:0/2242772518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f340039b0 0x7f2f34003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:11.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.600+0000 7f2f477fe640 1 -- 172.21.15.31:0/2242772518 reap_dead start 2024-04-15T00:32:11.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.600+0000 7f2f3ffff640 1 -- 172.21.15.31:0/2242772518 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f34003520 con 0x7f2f34004800 2024-04-15T00:32:11.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.600+0000 7f2f46ffd640 1 --2- 172.21.15.31:0/2242772518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f340039b0 0x7f2f34003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:32:11.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.601+0000 7f2f3ffff640 1 --2- 172.21.15.31:0/2242772518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f34004800 0x7f2f34004c80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2f4806cc00 tx=0x7f2f34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2571d009105b674f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:32:11.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.601+0000 7f2f467fc640 1 -- 172.21.15.31:0/2242772518 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f30001370 con 0x7f2f34004800 2024-04-15T00:32:11.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.601+0000 7f2f467fc640 1 -- 172.21.15.31:0/2242772518 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2f300052d0 con 0x7f2f34004800 2024-04-15T00:32:11.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.601+0000 7f2f467fc640 1 -- 172.21.15.31:0/2242772518 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f30003850 con 0x7f2f34004800 2024-04-15T00:32:11.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.601+0000 7f2f4d9cc640 1 -- 172.21.15.31:0/2242772518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f34004800 msgr2=0x7f2f34004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:11.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.601+0000 7f2f4d9cc640 1 --2- 172.21.15.31:0/2242772518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f34004800 0x7f2f34004c80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2f4806cc00 tx=0x7f2f34005830 comp rx=0 tx=0).stop 2024-04-15T00:32:11.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.601+0000 7f2f4d9cc640 1 -- 172.21.15.31:0/2242772518 shutdown_connections 2024-04-15T00:32:11.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.601+0000 7f2f4d9cc640 1 --2- 172.21.15.31:0/2242772518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f34004800 0x7f2f34004c80 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:11.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.601+0000 7f2f4d9cc640 1 -- 172.21.15.31:0/2242772518 >> 172.21.15.31:0/2242772518 conn(0x7f2f480b7840 msgr2=0x7f2f480b7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:32:11.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.601+0000 7f2f4d9cc640 1 -- 172.21.15.31:0/2242772518 shutdown_connections 2024-04-15T00:32:11.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.601+0000 7f2f4d9cc640 1 -- 172.21.15.31:0/2242772518 wait complete. 2024-04-15T00:32:11.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.602+0000 7f2f4d9cc640 1 Processor -- start 2024-04-15T00:32:11.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.602+0000 7f2f4d9cc640 1 -- start start 2024-04-15T00:32:11.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.603+0000 7f2f4d9cc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f34004800 0x7f2f481d2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:11.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.603+0000 7f2f4d9cc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f48143150 0x7f2f4813ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:11.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.603+0000 7f2f4d9cc640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f481404f0 0x7f2f481e03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:11.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.603+0000 7f2f4d9cc640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4814b210 con 0x7f2f48143150 2024-04-15T00:32:11.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.603+0000 7f2f4d9cc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2f480b62f0 con 0x7f2f34004800 2024-04-15T00:32:11.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.603+0000 7f2f4d9cc640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7f2f4806c6c0 con 0x7f2f481404f0 2024-04-15T00:32:11.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.603+0000 7f2f3ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f48143150 0x7f2f4813ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:11.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.603+0000 7f2f3ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f48143150 0x7f2f4813ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55046/0 (socket says 172.21.15.31:55046) 2024-04-15T00:32:11.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.603+0000 7f2f3ffff640 1 -- 172.21.15.31:0/3783645899 learned_addr learned my addr 172.21.15.31:0/3783645899 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:32:11.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.603+0000 7f2f46ffd640 1 --2- 172.21.15.31:0/3783645899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f34004800 0x7f2f481d2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:11.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.603+0000 7f2f477fe640 1 --2- 172.21.15.31:0/3783645899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f481404f0 0x7f2f481e03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:11.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.603+0000 7f2f3ffff640 1 -- 172.21.15.31:0/3783645899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f481404f0 msgr2=0x7f2f481e03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:11.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.603+0000 7f2f3ffff640 1 --2- 172.21.15.31:0/3783645899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f481404f0 0x7f2f481e03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:11.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.603+0000 7f2f3ffff640 1 -- 172.21.15.31:0/3783645899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f34004800 msgr2=0x7f2f481d2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:11.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.603+0000 7f2f3ffff640 1 --2- 172.21.15.31:0/3783645899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f34004800 0x7f2f481d2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:11.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.603+0000 7f2f3ffff640 1 -- 172.21.15.31:0/3783645899 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f481447b0 con 0x7f2f48143150 2024-04-15T00:32:11.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.603+0000 7f2f477fe640 1 --2- 172.21.15.31:0/3783645899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f481404f0 0x7f2f481e03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:32:11.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.604+0000 7f2f3ffff640 1 --2- 172.21.15.31:0/3783645899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f48143150 0x7f2f4813ffb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2f30000c00 tx=0x7f2f30001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:32:11.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.604+0000 7f2f44ff9640 1 -- 172.21.15.31:0/3783645899 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f30041020 con 0x7f2f48143150 2024-04-15T00:32:11.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.604+0000 7f2f44ff9640 1 -- 172.21.15.31:0/3783645899 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2f30005480 con 0x7f2f48143150 2024-04-15T00:32:11.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.604+0000 7f2f4d9cc640 1 -- 172.21.15.31:0/3783645899 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f48145040 con 0x7f2f48143150 2024-04-15T00:32:11.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.604+0000 7f2f44ff9640 1 -- 172.21.15.31:0/3783645899 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f30007a30 con 0x7f2f48143150 2024-04-15T00:32:11.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.604+0000 7f2f4d9cc640 1 -- 172.21.15.31:0/3783645899 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f480b4360 con 0x7f2f48143150 2024-04-15T00:32:11.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.605+0000 7f2f4d9cc640 1 -- 172.21.15.31:0/3783645899 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f480a0ed0 con 0x7f2f48143150 2024-04-15T00:32:11.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.605+0000 7f2f44ff9640 1 -- 172.21.15.31:0/3783645899 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f2f30044020 con 0x7f2f48143150 2024-04-15T00:32:11.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.606+0000 7f2f44ff9640 1 --2- 172.21.15.31:0/3783645899 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f2f2806b990 0x7f2f2806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:11.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.606+0000 7f2f44ff9640 1 -- 172.21.15.31:0/3783645899 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7f2f300ac770 con 0x7f2f48143150 2024-04-15T00:32:11.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.606+0000 7f2f46ffd640 1 --2- 172.21.15.31:0/3783645899 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f2f2806b990 0x7f2f2806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:11.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.606+0000 7f2f46ffd640 1 --2- 172.21.15.31:0/3783645899 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f2f2806b990 0x7f2f2806de50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2f481daa90 tx=0x7f2f38009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:32:11.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.610+0000 7f2f44ff9640 1 -- 172.21.15.31:0/3783645899 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2f3004b030 con 0x7f2f48143150 2024-04-15T00:32:11.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:11.793+0000 7f2f4d9cc640 1 -- 172.21.15.31:0/3783645899 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2f4804f620 con 0x7f2f48143150 2024-04-15T00:32:12.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.395+0000 7f2f44ff9640 1 -- 172.21.15.31:0/3783645899 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) ==== 181+0+0 (secure 0 0 0) 0x7f2f300303c0 con 0x7f2f48143150 2024-04-15T00:32:12.404 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2024-04-15T00:32:12.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.399+0000 7f2f4d9cc640 1 -- 172.21.15.31:0/3783645899 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f2f2806b990 msgr2=0x7f2f2806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:12.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.399+0000 7f2f4d9cc640 1 --2- 172.21.15.31:0/3783645899 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f2f2806b990 0x7f2f2806de50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2f481daa90 tx=0x7f2f38009190 comp rx=0 tx=0).stop 2024-04-15T00:32:12.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.399+0000 7f2f4d9cc640 1 -- 172.21.15.31:0/3783645899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f48143150 msgr2=0x7f2f4813ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:12.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.399+0000 7f2f4d9cc640 1 --2- 172.21.15.31:0/3783645899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f48143150 0x7f2f4813ffb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2f30000c00 tx=0x7f2f30001120 comp rx=0 tx=0).stop 2024-04-15T00:32:12.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.399+0000 7f2f4d9cc640 1 -- 172.21.15.31:0/3783645899 shutdown_connections 2024-04-15T00:32:12.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.399+0000 7f2f4d9cc640 1 --2- 172.21.15.31:0/3783645899 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7f2f2806b990 0x7f2f2806de50 secure :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2f481daa90 tx=0x7f2f38009190 comp rx=0 tx=0).stop 2024-04-15T00:32:12.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.399+0000 7f2f4d9cc640 1 --2- 172.21.15.31:0/3783645899 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7f2f481404f0 0x7f2f481e03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:12.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.399+0000 7f2f4d9cc640 1 --2- 172.21.15.31:0/3783645899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f48143150 0x7f2f4813ffb0 secure :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2f30000c00 tx=0x7f2f30001120 comp rx=0 tx=0).stop 2024-04-15T00:32:12.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.399+0000 7f2f4d9cc640 1 --2- 172.21.15.31:0/3783645899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f34004800 0x7f2f481d2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:12.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.399+0000 7f2f4d9cc640 1 -- 172.21.15.31:0/3783645899 >> 172.21.15.31:0/3783645899 conn(0x7f2f480b7840 msgr2=0x7f2f480b9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:32:12.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.399+0000 7f2f4d9cc640 1 -- 172.21.15.31:0/3783645899 shutdown_connections 2024-04-15T00:32:12.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.399+0000 7f2f4d9cc640 1 -- 172.21.15.31:0/3783645899 wait complete. 2024-04-15T00:32:12.424 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-15T00:32:12.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.527+0000 7fb72811e640 1 Processor -- start 2024-04-15T00:32:12.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.527+0000 7fb72811e640 1 -- start start 2024-04-15T00:32:12.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.527+0000 7fb72811e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb7200b09f0 0x7fb72013f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:12.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.527+0000 7fb72811e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7200b4b90 con 0x7fb7200b47b0 2024-04-15T00:32:12.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.527+0000 7fb72811e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7200b04a0 con 0x7fb720072d00 2024-04-15T00:32:12.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.527+0000 7fb72811e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fb720072500 con 0x7fb7200b09f0 2024-04-15T00:32:12.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.528+0000 7fb725eba640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb7200b47b0 0x7fb7200b50f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56164/0 (socket says 172.21.15.31:56164) 2024-04-15T00:32:12.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.528+0000 7fb725eba640 1 -- 172.21.15.31:0/323235574 learned_addr learned my addr 172.21.15.31:0/323235574 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-15T00:32:12.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.528+0000 7fb724eb8640 1 -- 172.21.15.31:0/323235574 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3217497010 0 0) 0x7fb7200b4b90 con 0x7fb7200b47b0 2024-04-15T00:32:12.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.528+0000 7fb724eb8640 1 -- 172.21.15.31:0/323235574 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb70c003520 con 0x7fb7200b47b0 2024-04-15T00:32:12.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.528+0000 7fb7266bb640 1 --2- 172.21.15.31:0/323235574 >> v2:172.21.15.50:3300/0 conn(0x7fb7200b09f0 0x7fb72013f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:12.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.528+0000 7fb724eb8640 1 -- 172.21.15.31:0/323235574 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3883598286 0 0) 0x7fb70c003520 con 0x7fb7200b47b0 2024-04-15T00:32:12.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.528+0000 7fb724eb8640 1 -- 172.21.15.31:0/323235574 >> v2:172.21.15.50:3300/0 conn(0x7fb7200b09f0 msgr2=0x7fb72013f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:32:12.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.528+0000 7fb724eb8640 1 --2- 172.21.15.31:0/323235574 >> v2:172.21.15.50:3300/0 conn(0x7fb7200b09f0 0x7fb72013f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:12.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.528+0000 7fb724eb8640 1 -- 172.21.15.31:0/323235574 >> v1:172.21.15.50:6789/0 conn(0x7fb720072d00 legacy=0x7fb7200afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:12.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.528+0000 7fb724eb8640 1 -- 172.21.15.31:0/323235574 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7200727e0 con 0x7fb7200b47b0 2024-04-15T00:32:12.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.528+0000 7fb724eb8640 1 -- 172.21.15.31:0/323235574 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 697057150 0 0) 0x7fb71c001670 con 0x7fb7200b47b0 2024-04-15T00:32:12.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.528+0000 7fb724eb8640 1 -- 172.21.15.31:0/323235574 >> v1:172.21.15.31:6789/0 conn(0x7fb7200b47b0 legacy=0x7fb7200b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:12.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.528+0000 7fb724eb8640 1 --2- 172.21.15.31:0/323235574 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb70c0039b0 0x7fb70c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:12.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.528+0000 7fb724eb8640 1 --2- 172.21.15.31:0/323235574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb70c004800 0x7fb70c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:12.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.528+0000 7fb724eb8640 1 --2- 172.21.15.31:0/323235574 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb70c0051c0 0x7fb70c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:12.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.528+0000 7fb724eb8640 1 -- 172.21.15.31:0/323235574 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb720072500 con 0x7fb70c0051c0 2024-04-15T00:32:12.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.528+0000 7fb724eb8640 1 -- 172.21.15.31:0/323235574 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb70c00c160 con 0x7fb70c004800 2024-04-15T00:32:12.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.528+0000 7fb724eb8640 1 -- 172.21.15.31:0/323235574 --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fb70c00c360 con 0x7fb70c0039b0 2024-04-15T00:32:12.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.528+0000 7fb7266bb640 1 --2- 172.21.15.31:0/323235574 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb70c0051c0 0x7fb70c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:12.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.528+0000 7fb7256b9640 1 --2- 172.21.15.31:0/323235574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb70c004800 0x7fb70c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:12.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.528+0000 7fb725eba640 1 --2- 172.21.15.31:0/323235574 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb70c0039b0 0x7fb70c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:12.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.529+0000 7fb7266bb640 1 -- 172.21.15.31:0/323235574 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb70c0039b0 msgr2=0x7fb70c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:32:12.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.529+0000 7fb7266bb640 1 --2- 172.21.15.31:0/323235574 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb70c0039b0 0x7fb70c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:12.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.529+0000 7fb7266bb640 1 -- 172.21.15.31:0/323235574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb70c004800 msgr2=0x7fb70c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:32:12.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.529+0000 7fb7266bb640 1 --2- 172.21.15.31:0/323235574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb70c004800 0x7fb70c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:12.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.529+0000 7fb7266bb640 1 -- 172.21.15.31:0/323235574 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb70c003520 con 0x7fb70c0051c0 2024-04-15T00:32:12.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.529+0000 7fb7256b9640 1 --2- 172.21.15.31:0/323235574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb70c004800 0x7fb70c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:32:12.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.529+0000 7fb7266bb640 1 -- 172.21.15.31:0/323235574 reap_dead start 2024-04-15T00:32:12.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.529+0000 7fb7266bb640 1 --2- 172.21.15.31:0/323235574 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb70c0051c0 0x7fb70c00b9c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb718009fc0 tx=0x7fb70c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f2017086b1270b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:32:12.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.529+0000 7fb724eb8640 1 -- 172.21.15.31:0/323235574 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb718009c10 con 0x7fb70c0051c0 2024-04-15T00:32:12.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.529+0000 7fb724eb8640 1 -- 172.21.15.31:0/323235574 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb71802cca0 con 0x7fb70c0051c0 2024-04-15T00:32:12.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.529+0000 7fb724eb8640 1 -- 172.21.15.31:0/323235574 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb718003bf0 con 0x7fb70c0051c0 2024-04-15T00:32:12.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.530+0000 7fb72811e640 1 -- 172.21.15.31:0/323235574 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb70c0051c0 msgr2=0x7fb70c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:12.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.530+0000 7fb72811e640 1 --2- 172.21.15.31:0/323235574 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb70c0051c0 0x7fb70c00b9c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb718009fc0 tx=0x7fb70c005830 comp rx=0 tx=0).stop 2024-04-15T00:32:12.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.530+0000 7fb72811e640 1 -- 172.21.15.31:0/323235574 shutdown_connections 2024-04-15T00:32:12.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.530+0000 7fb72811e640 1 --2- 172.21.15.31:0/323235574 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb70c0051c0 0x7fb70c00b9c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:12.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.530+0000 7fb72811e640 1 -- 172.21.15.31:0/323235574 >> 172.21.15.31:0/323235574 conn(0x7fb7200b6640 msgr2=0x7fb7200b6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:32:12.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.530+0000 7fb72811e640 1 -- 172.21.15.31:0/323235574 shutdown_connections 2024-04-15T00:32:12.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.530+0000 7fb72811e640 1 -- 172.21.15.31:0/323235574 wait complete. 2024-04-15T00:32:12.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.531+0000 7fb72811e640 1 Processor -- start 2024-04-15T00:32:12.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.531+0000 7fb72811e640 1 -- start start 2024-04-15T00:32:12.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.532+0000 7fb72811e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb70c0051c0 0x7fb72009f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:12.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.532+0000 7fb72811e640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb7201dd140 0x7fb7201dd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:12.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.532+0000 7fb72811e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb720133f30 0x7fb7201343b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:12.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.532+0000 7fb72811e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb7200b5480 con 0x7fb720133f30 2024-04-15T00:32:12.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.532+0000 7fb72811e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb7200b5300 con 0x7fb70c0051c0 2024-04-15T00:32:12.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.532+0000 7fb72811e640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fb7200b5600 con 0x7fb7201dd140 2024-04-15T00:32:12.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.532+0000 7fb7266bb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb720133f30 0x7fb7201343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:12.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.532+0000 7fb7266bb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb720133f30 0x7fb7201343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52468/0 (socket says 172.21.15.31:52468) 2024-04-15T00:32:12.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.532+0000 7fb7266bb640 1 -- 172.21.15.31:0/3180666562 learned_addr learned my addr 172.21.15.31:0/3180666562 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:32:12.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.532+0000 7fb725eba640 1 --2- 172.21.15.31:0/3180666562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb70c0051c0 0x7fb72009f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:12.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.532+0000 7fb7266bb640 1 -- 172.21.15.31:0/3180666562 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb7201dd140 msgr2=0x7fb7201dd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:12.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.532+0000 7fb7266bb640 1 --2- 172.21.15.31:0/3180666562 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb7201dd140 0x7fb7201dd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:12.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.532+0000 7fb7266bb640 1 -- 172.21.15.31:0/3180666562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb70c0051c0 msgr2=0x7fb72009f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:12.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.532+0000 7fb7266bb640 1 --2- 172.21.15.31:0/3180666562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb70c0051c0 0x7fb72009f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:12.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.532+0000 7fb7266bb640 1 -- 172.21.15.31:0/3180666562 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7201e0b00 con 0x7fb720133f30 2024-04-15T00:32:12.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.532+0000 7fb7266bb640 1 --2- 172.21.15.31:0/3180666562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb720133f30 0x7fb7201343b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb71802c6d0 tx=0x7fb718009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:32:12.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.532+0000 7fb7127fc640 1 -- 172.21.15.31:0/3180666562 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb718003990 con 0x7fb720133f30 2024-04-15T00:32:12.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.532+0000 7fb7127fc640 1 -- 172.21.15.31:0/3180666562 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb718044070 con 0x7fb720133f30 2024-04-15T00:32:12.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.532+0000 7fb7127fc640 1 -- 172.21.15.31:0/3180666562 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb718003d90 con 0x7fb720133f30 2024-04-15T00:32:12.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.532+0000 7fb72811e640 1 -- 172.21.15.31:0/3180666562 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7201e0de0 con 0x7fb720133f30 2024-04-15T00:32:12.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.532+0000 7fb72811e640 1 -- 172.21.15.31:0/3180666562 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb72013e090 con 0x7fb720133f30 2024-04-15T00:32:12.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.533+0000 7fb72811e640 1 -- 172.21.15.31:0/3180666562 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb72004f620 con 0x7fb720133f30 2024-04-15T00:32:12.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.534+0000 7fb7127fc640 1 -- 172.21.15.31:0/3180666562 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fb718005d10 con 0x7fb720133f30 2024-04-15T00:32:12.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.534+0000 7fb7127fc640 1 --2- 172.21.15.31:0/3180666562 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb70406b9c0 0x7fb70406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:12.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.534+0000 7fb7127fc640 1 -- 172.21.15.31:0/3180666562 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6383+0+0 (secure 0 0 0) 0x7fb7180ad350 con 0x7fb720133f30 2024-04-15T00:32:12.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.534+0000 7fb725eba640 1 --2- 172.21.15.31:0/3180666562 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb70406b9c0 0x7fb70406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:12.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.535+0000 7fb725eba640 1 --2- 172.21.15.31:0/3180666562 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb70406b9c0 0x7fb70406de80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb71c001730 tx=0x7fb71c000f10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:32:12.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.539+0000 7fb7127fc640 1 -- 172.21.15.31:0/3180666562 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb71807bd40 con 0x7fb720133f30 2024-04-15T00:32:12.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:12.721+0000 7fb72811e640 1 -- 172.21.15.31:0/3180666562 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb7200b3fd0 con 0x7fb720133f30 2024-04-15T00:32:13.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.400+0000 7fb7127fc640 1 -- 172.21.15.31:0/3180666562 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) ==== 169+0+0 (secure 0 0 0) 0x7fb71807b640 con 0x7fb720133f30 2024-04-15T00:32:13.408 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2024-04-15T00:32:13.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.404+0000 7fb72811e640 1 -- 172.21.15.31:0/3180666562 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb70406b9c0 msgr2=0x7fb70406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:13.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.404+0000 7fb72811e640 1 --2- 172.21.15.31:0/3180666562 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb70406b9c0 0x7fb70406de80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb71c001730 tx=0x7fb71c000f10 comp rx=0 tx=0).stop 2024-04-15T00:32:13.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.404+0000 7fb72811e640 1 -- 172.21.15.31:0/3180666562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb720133f30 msgr2=0x7fb7201343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:13.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.404+0000 7fb72811e640 1 --2- 172.21.15.31:0/3180666562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb720133f30 0x7fb7201343b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb71802c6d0 tx=0x7fb718009750 comp rx=0 tx=0).stop 2024-04-15T00:32:13.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.404+0000 7fb72811e640 1 -- 172.21.15.31:0/3180666562 shutdown_connections 2024-04-15T00:32:13.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.404+0000 7fb72811e640 1 --2- 172.21.15.31:0/3180666562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb720133f30 0x7fb7201343b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:13.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.404+0000 7fb72811e640 1 --2- 172.21.15.31:0/3180666562 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fb70406b9c0 0x7fb70406de80 secure :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb71c001730 tx=0x7fb71c000f10 comp rx=0 tx=0).stop 2024-04-15T00:32:13.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.404+0000 7fb72811e640 1 --2- 172.21.15.31:0/3180666562 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fb7201dd140 0x7fb7201dd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:13.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.404+0000 7fb72811e640 1 --2- 172.21.15.31:0/3180666562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb70c0051c0 0x7fb72009f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:13.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.404+0000 7fb72811e640 1 -- 172.21.15.31:0/3180666562 >> 172.21.15.31:0/3180666562 conn(0x7fb7200b6640 msgr2=0x7fb72006b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:32:13.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.405+0000 7fb72811e640 1 -- 172.21.15.31:0/3180666562 shutdown_connections 2024-04-15T00:32:13.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.405+0000 7fb72811e640 1 -- 172.21.15.31:0/3180666562 wait complete. 2024-04-15T00:32:13.428 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:32:13.430 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-15T00:32:13.472 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:32:13.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.574+0000 7fec41dfa640 1 Processor -- start 2024-04-15T00:32:13.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.575+0000 7fec41dfa640 1 -- start start 2024-04-15T00:32:13.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.575+0000 7fec41dfa640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec3c072820 0x7fec3c0b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:13.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.575+0000 7fec41dfa640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fec3c0b77e0 0x7fec3c141690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:13.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.575+0000 7fec41dfa640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fec3c0b8a80 0x7fec3c14acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:13.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.575+0000 7fec41dfa640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fec3c072c00 con 0x7fec3c0b77e0 2024-04-15T00:32:13.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.575+0000 7fec41dfa640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fec3c09c400 con 0x7fec3c0b8a80 2024-04-15T00:32:13.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.575+0000 7fec41dfa640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fec3c0b8560 con 0x7fec3c072820 2024-04-15T00:32:13.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.575+0000 7fec3affd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fec3c0b77e0 0x7fec3c141690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:13.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.575+0000 7fec3affd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fec3c0b77e0 0x7fec3c141690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52470/0 (socket says 172.21.15.31:52470) 2024-04-15T00:32:13.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.575+0000 7fec3affd640 1 -- 172.21.15.31:0/1720945104 learned_addr learned my addr 172.21.15.31:0/1720945104 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:32:13.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.576+0000 7fec3bfff640 1 --2- 172.21.15.31:0/1720945104 >> v2:172.21.15.50:3300/0 conn(0x7fec3c0b8a80 0x7fec3c14acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:13.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.576+0000 7fec3b7fe640 1 --2- 172.21.15.31:0/1720945104 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec3c072820 0x7fec3c0b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:13.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.576+0000 7fec3affd640 1 -- 172.21.15.31:0/1720945104 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec3c072820 msgr2=0x7fec3c0b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:32:13.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.576+0000 7fec3affd640 1 --2- 172.21.15.31:0/1720945104 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec3c072820 0x7fec3c0b2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:13.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.576+0000 7fec3affd640 1 -- 172.21.15.31:0/1720945104 >> v2:172.21.15.50:3300/0 conn(0x7fec3c0b8a80 msgr2=0x7fec3c14acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:32:13.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.576+0000 7fec3affd640 1 --2- 172.21.15.31:0/1720945104 >> v2:172.21.15.50:3300/0 conn(0x7fec3c0b8a80 0x7fec3c14acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:13.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.576+0000 7fec3affd640 1 -- 172.21.15.31:0/1720945104 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec3c0b3b70 con 0x7fec3c0b77e0 2024-04-15T00:32:13.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.576+0000 7fec3bfff640 1 --2- 172.21.15.31:0/1720945104 >> v2:172.21.15.50:3300/0 conn(0x7fec3c0b8a80 0x7fec3c14acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T00:32:13.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.576+0000 7fec3affd640 1 --2- 172.21.15.31:0/1720945104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec3c0b77e0 0x7fec3c141690 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fec3c0b35d0 tx=0x7fec3002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb3c0172d41a1815 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:32:13.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.577+0000 7fec3a7fc640 1 -- 172.21.15.31:0/1720945104 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec30035020 con 0x7fec3c0b77e0 2024-04-15T00:32:13.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.577+0000 7fec3a7fc640 1 -- 172.21.15.31:0/1720945104 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fec30031870 con 0x7fec3c0b77e0 2024-04-15T00:32:13.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.577+0000 7fec3a7fc640 1 -- 172.21.15.31:0/1720945104 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec30031c60 con 0x7fec3c0b77e0 2024-04-15T00:32:13.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.577+0000 7fec41dfa640 1 -- 172.21.15.31:0/1720945104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec3c0b77e0 msgr2=0x7fec3c141690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:13.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.577+0000 7fec41dfa640 1 --2- 172.21.15.31:0/1720945104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec3c0b77e0 0x7fec3c141690 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fec3c0b35d0 tx=0x7fec3002b910 comp rx=0 tx=0).stop 2024-04-15T00:32:13.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.577+0000 7fec41dfa640 1 -- 172.21.15.31:0/1720945104 shutdown_connections 2024-04-15T00:32:13.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.577+0000 7fec41dfa640 1 --2- 172.21.15.31:0/1720945104 >> v2:172.21.15.50:3300/0 conn(0x7fec3c0b8a80 0x7fec3c14acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:13.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.577+0000 7fec41dfa640 1 --2- 172.21.15.31:0/1720945104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec3c0b77e0 0x7fec3c141690 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:13.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.577+0000 7fec41dfa640 1 --2- 172.21.15.31:0/1720945104 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec3c072820 0x7fec3c0b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:13.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.577+0000 7fec41dfa640 1 -- 172.21.15.31:0/1720945104 >> 172.21.15.31:0/1720945104 conn(0x7fec3c0bce60 msgr2=0x7fec3c0bd270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:32:13.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.577+0000 7fec41dfa640 1 -- 172.21.15.31:0/1720945104 shutdown_connections 2024-04-15T00:32:13.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.577+0000 7fec41dfa640 1 -- 172.21.15.31:0/1720945104 wait complete. 2024-04-15T00:32:13.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.578+0000 7fec41dfa640 1 Processor -- start 2024-04-15T00:32:13.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.578+0000 7fec41dfa640 1 -- start start 2024-04-15T00:32:13.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.579+0000 7fec41dfa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec3c072820 0x7fec3c0b65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:13.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.579+0000 7fec41dfa640 1 --2- >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec3c0b77e0 0x7fec3c1dd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:13.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.579+0000 7fec41dfa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec3c0b8a80 0x7fec3c1ddc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:13.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.579+0000 7fec41dfa640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fec3c09c010 con 0x7fec3c0b8a80 2024-04-15T00:32:13.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.579+0000 7fec41dfa640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fec3c09be90 con 0x7fec3c072820 2024-04-15T00:32:13.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.579+0000 7fec41dfa640 1 -- --> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] -- mon_getmap magic: 0 -- 0x7fec3c09c190 con 0x7fec3c0b77e0 2024-04-15T00:32:13.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.579+0000 7fec3bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec3c0b8a80 0x7fec3c1ddc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:13.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.579+0000 7fec3bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec3c0b8a80 0x7fec3c1ddc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52486/0 (socket says 172.21.15.31:52486) 2024-04-15T00:32:13.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.579+0000 7fec3bfff640 1 -- 172.21.15.31:0/3716314469 learned_addr learned my addr 172.21.15.31:0/3716314469 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-15T00:32:13.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.579+0000 7fec3b7fe640 1 --2- 172.21.15.31:0/3716314469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec3c072820 0x7fec3c0b65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:13.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.579+0000 7fec3affd640 1 --2- 172.21.15.31:0/3716314469 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec3c0b77e0 0x7fec3c1dd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:13.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.579+0000 7fec3bfff640 1 -- 172.21.15.31:0/3716314469 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec3c0b77e0 msgr2=0x7fec3c1dd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:13.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.579+0000 7fec3bfff640 1 --2- 172.21.15.31:0/3716314469 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec3c0b77e0 0x7fec3c1dd6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:13.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.579+0000 7fec3bfff640 1 -- 172.21.15.31:0/3716314469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec3c072820 msgr2=0x7fec3c0b65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:13.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.579+0000 7fec3bfff640 1 --2- 172.21.15.31:0/3716314469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec3c072820 0x7fec3c0b65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:13.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.579+0000 7fec3bfff640 1 -- 172.21.15.31:0/3716314469 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec3c09dd60 con 0x7fec3c0b8a80 2024-04-15T00:32:13.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.579+0000 7fec3bfff640 1 --2- 172.21.15.31:0/3716314469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec3c0b8a80 0x7fec3c1ddc30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fec34007e70 tx=0x7fec3400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:32:13.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.580+0000 7fec23fff640 1 -- 172.21.15.31:0/3716314469 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3401a070 con 0x7fec3c0b8a80 2024-04-15T00:32:13.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.580+0000 7fec23fff640 1 -- 172.21.15.31:0/3716314469 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fec34003bb0 con 0x7fec3c0b8a80 2024-04-15T00:32:13.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.580+0000 7fec41dfa640 1 -- 172.21.15.31:0/3716314469 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec3c1d44c0 con 0x7fec3c0b8a80 2024-04-15T00:32:13.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.580+0000 7fec23fff640 1 -- 172.21.15.31:0/3716314469 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3400de20 con 0x7fec3c0b8a80 2024-04-15T00:32:13.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.580+0000 7fec41dfa640 1 -- 172.21.15.31:0/3716314469 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec3c09f1f0 con 0x7fec3c0b8a80 2024-04-15T00:32:13.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.581+0000 7fec41dfa640 1 -- 172.21.15.31:0/3716314469 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec3c0b7190 con 0x7fec3c0b8a80 2024-04-15T00:32:13.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.581+0000 7fec23fff640 1 -- 172.21.15.31:0/3716314469 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fec3401d070 con 0x7fec3c0b8a80 2024-04-15T00:32:13.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.581+0000 7fec23fff640 1 --2- 172.21.15.31:0/3716314469 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fec2806b9c0 0x7fec2806de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:32:13.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.582+0000 7fec23fff640 1 -- 172.21.15.31:0/3716314469 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5853+0+0 (secure 0 0 0) 0x7fec3408a920 con 0x7fec3c0b8a80 2024-04-15T00:32:13.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.582+0000 7fec3b7fe640 1 --2- 172.21.15.31:0/3716314469 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fec2806b9c0 0x7fec2806de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:32:13.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.582+0000 7fec3b7fe640 1 --2- 172.21.15.31:0/3716314469 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fec2806b9c0 0x7fec2806de80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fec2c006fd0 tx=0x7fec2c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:32:13.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.586+0000 7fec23fff640 1 -- 172.21.15.31:0/3716314469 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fec34010070 con 0x7fec3c0b8a80 2024-04-15T00:32:13.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:13.766+0000 7fec41dfa640 1 -- 172.21.15.31:0/3716314469 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fec3c0b1ec0 con 0x7fec3c0b8a80 2024-04-15T00:32:14.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:14.406+0000 7fec23fff640 1 -- 172.21.15.31:0/3716314469 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) ==== 178+0+0 (secure 0 0 0) 0x7fec34058ee0 con 0x7fec3c0b8a80 2024-04-15T00:32:14.414 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data_ec' removed 2024-04-15T00:32:14.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:14.412+0000 7fec41dfa640 1 -- 172.21.15.31:0/3716314469 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fec2806b9c0 msgr2=0x7fec2806de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:14.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:14.412+0000 7fec41dfa640 1 --2- 172.21.15.31:0/3716314469 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fec2806b9c0 0x7fec2806de80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fec2c006fd0 tx=0x7fec2c008040 comp rx=0 tx=0).stop 2024-04-15T00:32:14.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:14.412+0000 7fec41dfa640 1 -- 172.21.15.31:0/3716314469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec3c0b8a80 msgr2=0x7fec3c1ddc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:32:14.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:14.412+0000 7fec41dfa640 1 --2- 172.21.15.31:0/3716314469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec3c0b8a80 0x7fec3c1ddc30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fec34007e70 tx=0x7fec3400d4a0 comp rx=0 tx=0).stop 2024-04-15T00:32:14.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:14.413+0000 7fec41dfa640 1 -- 172.21.15.31:0/3716314469 shutdown_connections 2024-04-15T00:32:14.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:14.413+0000 7fec41dfa640 1 --2- 172.21.15.31:0/3716314469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec3c0b8a80 0x7fec3c1ddc30 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:14.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:14.413+0000 7fec41dfa640 1 --2- 172.21.15.31:0/3716314469 >> [v2:172.21.15.31:6832/915470279,v1:172.21.15.31:6833/915470279] conn(0x7fec2806b9c0 0x7fec2806de80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:14.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:14.413+0000 7fec41dfa640 1 --2- 172.21.15.31:0/3716314469 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x7fec3c0b77e0 0x7fec3c1dd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:14.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:14.413+0000 7fec41dfa640 1 --2- 172.21.15.31:0/3716314469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec3c072820 0x7fec3c0b65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:32:14.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:14.413+0000 7fec41dfa640 1 -- 172.21.15.31:0/3716314469 >> 172.21.15.31:0/3716314469 conn(0x7fec3c0bce60 msgr2=0x7fec3c13bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:32:14.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:14.416+0000 7fec41dfa640 1 -- 172.21.15.31:0/3716314469 shutdown_connections 2024-04-15T00:32:14.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-15T00:32:14.417+0000 7fec41dfa640 1 -- 172.21.15.31:0/3716314469 wait complete. 2024-04-15T00:32:14.444 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-15T00:32:14.445 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-15T00:32:14.445 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T00:32:14.459 INFO:tasks.ceph.mds.a:Stopped 2024-04-15T00:32:14.459 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-15T00:32:14.460 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T00:32:14.474 INFO:tasks.ceph.mds.b:Stopped 2024-04-15T00:32:14.475 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-15T00:32:14.475 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-15T00:32:14.476 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T00:32:14.552 INFO:tasks.ceph.osd.0:Stopped 2024-04-15T00:32:14.553 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-15T00:32:14.553 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T00:32:14.618 INFO:tasks.ceph.osd.1:Stopped 2024-04-15T00:32:14.618 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-15T00:32:14.618 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T00:32:14.670 INFO:tasks.ceph.osd.2:Stopped 2024-04-15T00:32:14.671 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-15T00:32:14.671 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T00:32:14.745 INFO:tasks.ceph.osd.3:Stopped 2024-04-15T00:32:14.746 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-15T00:32:14.746 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T00:32:14.801 INFO:tasks.ceph.osd.4:Stopped 2024-04-15T00:32:14.802 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-15T00:32:14.802 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T00:32:14.858 INFO:tasks.ceph.osd.5:Stopped 2024-04-15T00:32:14.858 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-15T00:32:14.858 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T00:32:14.918 INFO:tasks.ceph.osd.6:Stopped 2024-04-15T00:32:14.918 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-15T00:32:14.918 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T00:32:14.970 INFO:tasks.ceph.osd.7:Stopped 2024-04-15T00:32:14.970 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-15T00:32:14.971 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-15T00:32:14.971 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T00:32:15.000 INFO:tasks.ceph.mgr.y:Stopped 2024-04-15T00:32:15.001 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-15T00:32:15.001 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T00:32:15.025 INFO:tasks.ceph.mgr.x:Stopped 2024-04-15T00:32:15.026 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-15T00:32:15.026 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-15T00:32:15.026 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T00:32:15.053 INFO:tasks.ceph.mon.a:Stopped 2024-04-15T00:32:15.054 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-15T00:32:15.054 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T00:32:15.076 INFO:tasks.ceph.mon.b:Stopped 2024-04-15T00:32:15.077 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-15T00:32:15.077 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T00:32:15.127 INFO:tasks.ceph.mon.c:Stopped 2024-04-15T00:32:15.127 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-15T00:32:15.128 DEBUG:teuthology.orchestra.run.smithi031:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-04-15T00:32:15.525 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi031.front.sepia.ceph.com 2024-04-15T00:32:15.526 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-15T00:32:17.232 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi031.front.sepia.ceph.com 2024-04-15T00:32:17.233 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-15T00:32:17.313 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi031.front.sepia.ceph.com 2024-04-15T00:32:17.313 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-15T00:32:17.376 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi031.front.sepia.ceph.com 2024-04-15T00:32:17.376 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-15T00:32:17.463 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi050.front.sepia.ceph.com 2024-04-15T00:32:17.463 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-15T00:32:22.151 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi050.front.sepia.ceph.com 2024-04-15T00:32:22.151 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-15T00:32:22.242 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi050.front.sepia.ceph.com 2024-04-15T00:32:22.242 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-15T00:32:22.302 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi050.front.sepia.ceph.com 2024-04-15T00:32:22.303 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-15T00:32:22.384 INFO:tasks.ceph:Archiving mon data... 2024-04-15T00:32:22.385 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656634/data/mon.a.tgz 2024-04-15T00:32:22.385 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2024-04-15T00:32:22.410 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.pSsPRTNNha 2024-04-15T00:32:22.411 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.pSsPRTNNha 2024-04-15T00:32:22.545 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.pSsPRTNNha 2024-04-15T00:32:22.643 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.pSsPRTNNha is 269KB 2024-04-15T00:32:22.739 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.pSsPRTNNha 2024-04-15T00:32:22.754 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656634/data/mon.b.tgz 2024-04-15T00:32:22.754 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2024-04-15T00:32:22.771 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.9ynsi9PxZL 2024-04-15T00:32:22.771 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.9ynsi9PxZL 2024-04-15T00:32:22.910 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.9ynsi9PxZL 2024-04-15T00:32:22.997 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.9ynsi9PxZL is 273KB 2024-04-15T00:32:23.092 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.9ynsi9PxZL 2024-04-15T00:32:23.107 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656634/data/mon.c.tgz 2024-04-15T00:32:23.107 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2024-04-15T00:32:23.161 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.kzFCCOmngU 2024-04-15T00:32:23.161 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.kzFCCOmngU 2024-04-15T00:32:23.283 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.kzFCCOmngU 2024-04-15T00:32:23.367 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.kzFCCOmngU is 273KB 2024-04-15T00:32:23.463 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.kzFCCOmngU 2024-04-15T00:32:23.477 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-15T00:32:23.477 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-15T00:32:23.479 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-15T00:32:23.566 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-15T00:32:23.598 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-15T00:32:23.599 INFO:tasks.ceph:Archiving crash dumps... 2024-04-15T00:32:23.601 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656634/remote/smithi031/crash 2024-04-15T00:32:23.602 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-15T00:32:23.637 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656634/remote/smithi050/crash 2024-04-15T00:32:23.638 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-15T00:32:23.664 INFO:tasks.ceph:Shutting down logrotate 2024-04-15T00:32:23.665 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:32:23.682 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:32:23.760 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-15T00:32:23.792 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-15T00:32:23.819 INFO:tasks.ceph:Compressing logs... 2024-04-15T00:32:23.819 DEBUG:teuthology.orchestra.run.smithi031:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-15T00:32:23.836 DEBUG:teuthology.orchestra.run.smithi050:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-15T00:32:23.894 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37480.log 2024-04-15T00:32:23.895 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-15T00:32:23.895 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37520.log 2024-04-15T00:32:23.895 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.6.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37480.log.gz 2024-04-15T00:32:23.895 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37360.log 2024-04-15T00:32:23.895 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37640.log 2024-04-15T00:32:23.895 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37360.log: gzip -5 88.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.37520.log.gz 2024-04-15T00:32:23.896 INFO:teuthology.orchestra.run.smithi050.stderr: /var/log/ceph/ceph.audit.log 2024-04-15T00:32:23.896 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37360.log.gz 2024-04-15T00:32:23.896 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37640.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-15T00:32:23.896 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph.audit.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37640.log.gz 2024-04-15T00:32:23.896 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-15T00:32:23.896 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37600.log 2024-04-15T00:32:23.897 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-15T00:32:23.897 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37600.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-15T00:32:23.897 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.7.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37600.log.gz 2024-04-15T00:32:23.897 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37560.log 2024-04-15T00:32:23.897 INFO:teuthology.orchestra.run.smithi050.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-15T00:32:23.897 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-15T00:32:23.897 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37400.log 2024-04-15T00:32:23.897 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37560.log.gz 2024-04-15T00:32:23.898 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.37400.log: 93.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-15T00:32:23.898 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37400.log.gz 2024-04-15T00:32:23.898 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-15T00:32:23.898 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-15T00:32:23.898 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-15T00:32:23.898 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37440.log 2024-04-15T00:32:23.898 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mon.c.log: 92.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-15T00:32:23.899 INFO:teuthology.orchestra.run.smithi050.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-15T00:32:23.907 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37440.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37440.log.gz 2024-04-15T00:32:23.918 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59276.log 2024-04-15T00:32:23.919 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59568.log 2024-04-15T00:32:23.919 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.59276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43724.log 2024-04-15T00:32:23.919 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.59568.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-15T00:32:23.919 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59276.log.gz 2024-04-15T00:32:23.919 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59568.log.gz 2024-04-15T00:32:23.919 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59526.log 2024-04-15T00:32:23.919 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59442.log 2024-04-15T00:32:23.919 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.59526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47616.log 2024-04-15T00:32:23.920 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.59442.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59526.log.gz 2024-04-15T00:32:23.920 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44790.log 2024-04-15T00:32:23.920 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47616.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59442.log.gz 2024-04-15T00:32:23.920 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46858.log 2024-04-15T00:32:23.920 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46774.log 2024-04-15T00:32:23.920 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43912.log 2024-04-15T00:32:23.920 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59066.log 2024-04-15T00:32:23.920 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58898.log 2024-04-15T00:32:23.920 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.59066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57969.log 2024-04-15T00:32:23.921 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.58898.log: gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59066.log.gz 2024-04-15T00:32:23.921 INFO:teuthology.orchestra.run.smithi031.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46942.log 2024-04-15T00:32:23.921 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58898.log.gz 2024-04-15T00:32:23.921 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.57969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58495.log 2024-04-15T00:32:23.921 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46942.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57969.log.gz 2024-04-15T00:32:23.921 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58321.log 2024-04-15T00:32:23.921 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.58495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46238.log 2024-04-15T00:32:23.921 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.58321.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58495.log.gz 2024-04-15T00:32:23.921 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46816.log 2024-04-15T00:32:23.922 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46238.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58321.log.gz 2024-04-15T00:32:23.922 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57791.log 2024-04-15T00:32:23.922 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58814.log 2024-04-15T00:32:23.922 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.57791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43287.log 2024-04-15T00:32:23.922 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.58814.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57791.log.gz 2024-04-15T00:32:23.922 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45905.log 2024-04-15T00:32:23.922 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43287.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58814.log.gz 2024-04-15T00:32:23.922 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48007.log 2024-04-15T00:32:23.923 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47616.log.gz 2024-04-15T00:32:23.923 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45556.log 2024-04-15T00:32:23.923 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.48007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57623.log 2024-04-15T00:32:23.923 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43329.log 2024-04-15T00:32:23.923 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.57623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47446.log 2024-04-15T00:32:23.923 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43828.log 2024-04-15T00:32:23.923 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57623.log.gz 2024-04-15T00:32:23.923 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57927.log 2024-04-15T00:32:23.923 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58856.log 2024-04-15T00:32:23.924 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.57927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46900.log 2024-04-15T00:32:23.924 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47446.log.gz 2024-04-15T00:32:23.924 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.58856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47194.log 2024-04-15T00:32:23.924 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57927.log.gz 2024-04-15T00:32:23.924 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46900.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.58856.log.gz 2024-04-15T00:32:23.924 INFO:teuthology.orchestra.run.smithi031.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44556.log 2024-04-15T00:32:23.924 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47488.log 2024-04-15T00:32:23.924 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43996.log 2024-04-15T00:32:23.924 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59652.log 2024-04-15T00:32:23.925 INFO:teuthology.orchestra.run.smithi031.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43912.log.gz 2024-04-15T00:32:23.925 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45906.log 2024-04-15T00:32:23.925 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43996.log: /var/log/ceph/ceph-client.admin.59652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57665.log 2024-04-15T00:32:23.925 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45906.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59652.log.gz 2024-04-15T00:32:23.925 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46241.log 2024-04-15T00:32:23.925 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.57665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45901.log 2024-04-15T00:32:23.925 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46578.log 2024-04-15T00:32:23.925 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57665.log.gz 2024-04-15T00:32:23.925 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45901.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45905.log.gz 2024-04-15T00:32:23.926 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45388.log 2024-04-15T00:32:23.926 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46984.log 2024-04-15T00:32:23.926 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46238.log.gz 2024-04-15T00:32:23.926 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-15T00:32:23.926 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45388.log: /var/log/ceph/ceph-client.admin.46984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44080.log 2024-04-15T00:32:23.926 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43828.log.gz 2024-04-15T00:32:23.926 INFO:teuthology.orchestra.run.smithi031.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.47488.log.gz 2024-04-15T00:32:23.926 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43996.log.gz 2024-04-15T00:32:23.926 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46577.log 2024-04-15T00:32:23.927 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45901.log.gz 2024-04-15T00:32:23.927 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45906.log.gz 2024-04-15T00:32:23.927 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46571.log 2024-04-15T00:32:23.927 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44080.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46241.log.gz 2024-04-15T00:32:23.927 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45142.log 2024-04-15T00:32:23.927 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46774.log.gz 2024-04-15T00:32:23.927 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46816.log.gz 2024-04-15T00:32:23.927 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46571.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46858.log.gz 2024-04-15T00:32:23.927 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44958.log 2024-04-15T00:32:23.928 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46900.log.gz 2024-04-15T00:32:23.928 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46942.log.gz 2024-04-15T00:32:23.928 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44748.log 2024-04-15T00:32:23.928 INFO:teuthology.orchestra.run.smithi031.stderr:gzip/var/log/ceph/ceph-client.admin.44958.log: 88.3% -5 --verbose -- 88.5% /var/log/ceph/ceph-client.admin.58586.log 2024-04-15T00:32:23.928 INFO:teuthology.orchestra.run.smithi031.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47194.log.gz 2024-04-15T00:32:23.928 INFO:teuthology.orchestra.run.smithi031.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46578.log.gz 2024-04-15T00:32:23.928 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46984.log.gz 2024-04-15T00:32:23.928 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44748.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46577.log.gz 2024-04-15T00:32:23.928 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46571.log.gz 2024-04-15T00:32:23.929 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46240.log 2024-04-15T00:32:23.929 INFO:teuthology.orchestra.run.smithi031.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.44080.log.gz 2024-04-15T00:32:23.929 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.58586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47110.log 2024-04-15T00:32:23.929 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46240.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58586.log.gz 2024-04-15T00:32:23.929 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57749.log 2024-04-15T00:32:23.929 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45016.log 2024-04-15T00:32:23.929 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.57749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45226.log 2024-04-15T00:32:23.929 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44958.log.gz 2024-04-15T00:32:23.930 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57749.log.gz 2024-04-15T00:32:23.930 INFO:teuthology.orchestra.run.smithi031.stderr:gzip/var/log/ceph/ceph-client.admin.45016.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.57885.log 2024-04-15T00:32:23.930 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45346.log 2024-04-15T00:32:23.930 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.57885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45430.log 2024-04-15T00:32:23.930 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46233.log 2024-04-15T00:32:23.930 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57885.log.gz 2024-04-15T00:32:23.930 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59610.log 2024-04-15T00:32:23.930 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45598.log 2024-04-15T00:32:23.930 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45142.log.gz 2024-04-15T00:32:23.931 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.59610.log: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-15T00:32:23.931 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43455.log 2024-04-15T00:32:23.931 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59610.log.gz 2024-04-15T00:32:23.931 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45598.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46240.log.gz 2024-04-15T00:32:23.931 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46242.log 2024-04-15T00:32:23.931 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47110.log.gz 2024-04-15T00:32:23.931 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45016.log.gz 2024-04-15T00:32:23.931 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43627.log 2024-04-15T00:32:23.931 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45226.log.gz 2024-04-15T00:32:23.932 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59318.log 2024-04-15T00:32:23.932 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58940.log 2024-04-15T00:32:23.932 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43627.log: /var/log/ceph/ceph-client.admin.59318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45682.log 2024-04-15T00:32:23.932 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43724.log.gz 2024-04-15T00:32:23.932 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.58940.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59318.log.gz 2024-04-15T00:32:23.932 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45058.log 2024-04-15T00:32:23.932 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46233.log.gz 2024-04-15T00:32:23.932 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58940.log.gz 2024-04-15T00:32:23.932 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59192.log 2024-04-15T00:32:23.933 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45682.log: /var/log/ceph/ceph-client.admin.45058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58237.log 2024-04-15T00:32:23.933 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46242.log.gz 2024-04-15T00:32:23.933 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.59192.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-15T00:32:23.933 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.58237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57581.log 2024-04-15T00:32:23.933 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59192.log.gz 2024-04-15T00:32:23.933 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-osd.1.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58237.log.gz 2024-04-15T00:32:23.934 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58195.log 2024-04-15T00:32:23.934 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43455.log.gz 2024-04-15T00:32:23.934 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.57581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43148.log 2024-04-15T00:32:23.934 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43627.log.gz 2024-04-15T00:32:23.934 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45682.log.gz 2024-04-15T00:32:23.934 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57581.log.gz/var/log/ceph/ceph-client.admin.58195.log: 2024-04-15T00:32:23.934 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44146.log 2024-04-15T00:32:23.934 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45058.log.gz 2024-04-15T00:32:23.935 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59360.log 2024-04-15T00:32:23.935 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58195.log.gz 2024-04-15T00:32:23.935 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43148.log: /var/log/ceph/ceph-client.admin.44146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44038.log 2024-04-15T00:32:23.935 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.59360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45900.log 2024-04-15T00:32:23.935 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44038.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59360.log.gz 2024-04-15T00:32:23.935 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59815.log 2024-04-15T00:32:23.935 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43413.log 2024-04-15T00:32:23.935 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.59815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43678.log 2024-04-15T00:32:23.935 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43413.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59815.log.gz 2024-04-15T00:32:23.936 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45304.log 2024-04-15T00:32:23.936 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44146.log.gz 2024-04-15T00:32:23.936 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43583.log 2024-04-15T00:32:23.936 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43678.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45900.log.gz 2024-04-15T00:32:23.936 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46438.log 2024-04-15T00:32:23.936 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44038.log.gz 2024-04-15T00:32:23.936 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45895.log 2024-04-15T00:32:23.936 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59024.log 2024-04-15T00:32:23.936 INFO:teuthology.orchestra.run.smithi031.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43678.log.gz 2024-04-15T00:32:23.937 INFO:teuthology.orchestra.run.smithi031.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.44556.log.gz 2024-04-15T00:32:23.937 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45895.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-15T00:32:23.937 INFO:teuthology.orchestra.run.smithi031.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43583.log.gz 2024-04-15T00:32:23.937 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.59024.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46438.log.gz 2024-04-15T00:32:23.937 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58363.log 2024-04-15T00:32:23.937 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58011.log 89.2% 2024-04-15T00:32:23.937 INFO:teuthology.orchestra.run.smithi031.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59024.log.gz 2024-04-15T00:32:23.937 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45895.log.gz 2024-04-15T00:32:23.937 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.58363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47362.log 2024-04-15T00:32:23.938 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58363.log.gz 2024-04-15T00:32:23.938 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.58011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59234.log 2024-04-15T00:32:23.938 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58011.log.gz 2024-04-15T00:32:23.938 INFO:teuthology.orchestra.run.smithi031.stderr:gzip/var/log/ceph/ceph-client.admin.47362.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44832.log 2024-04-15T00:32:23.938 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.59234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46225.log 2024-04-15T00:32:23.938 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44832.log: gzip 87.9% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.59234.log.gz -- 2024-04-15T00:32:23.938 INFO:teuthology.orchestra.run.smithi031.stderr: /var/log/ceph/ceph-mgr.y.log 2024-04-15T00:32:23.938 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45724.log 2024-04-15T00:32:23.938 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45184.log 2024-04-15T00:32:23.939 INFO:teuthology.orchestra.run.smithi031.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47362.log.gz 2024-04-15T00:32:23.939 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57707.log 2024-04-15T00:32:23.939 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58053.log 2024-04-15T00:32:23.939 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.57707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46237.log 2024-04-15T00:32:23.939 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57707.log.gz 2024-04-15T00:32:23.939 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.58053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58772.log 2024-04-15T00:32:23.939 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44874.log 2024-04-15T00:32:23.939 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58053.log.gz 2024-04-15T00:32:23.939 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.58772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36994.log 2024-04-15T00:32:23.940 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58153.log 2024-04-15T00:32:23.940 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58772.log.gz 2024-04-15T00:32:23.940 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47278.log 2024-04-15T00:32:23.940 INFO:teuthology.orchestra.run.smithi031.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.46225.log.gz 2024-04-15T00:32:23.940 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.58153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47320.log 2024-04-15T00:32:23.940 INFO:teuthology.orchestra.run.smithi031.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.58153.log.gz 2024-04-15T00:32:23.940 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47278.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-15T00:32:23.941 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59713.log 2024-04-15T00:32:23.941 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58279.log 2024-04-15T00:32:23.941 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.59713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44916.log 2024-04-15T00:32:23.941 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.58279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43539.log 2024-04-15T00:32:23.941 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59713.log.gz 2024-04-15T00:32:23.941 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59755.log 2024-04-15T00:32:23.941 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58279.log.gz 2024-04-15T00:32:23.942 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43371.log 2024-04-15T00:32:23.942 INFO:teuthology.orchestra.run.smithi031.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45724.log.gz 2024-04-15T00:32:23.942 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.59755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43497.log 2024-04-15T00:32:23.942 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43954.log 2024-04-15T00:32:23.942 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59755.log.gz 2024-04-15T00:32:23.942 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47236.log 2024-04-15T00:32:23.942 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58544.log 2024-04-15T00:32:23.942 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47236.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-15T00:32:23.942 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45184.log.gz 2024-04-15T00:32:23.943 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.58544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58982.log 2024-04-15T00:32:23.943 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58544.log.gz 2024-04-15T00:32:23.943 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-15T00:32:23.943 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.58982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47068.log 2024-04-15T00:32:23.943 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-osd.2.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58982.log.gz 2024-04-15T00:32:23.943 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59150.log 2024-04-15T00:32:23.943 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58628.log 2024-04-15T00:32:23.943 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47068.log: /var/log/ceph/ceph-client.admin.59150.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46237.log.gz 2024-04-15T00:32:23.943 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45472.log 2024-04-15T00:32:23.944 INFO:teuthology.orchestra.run.smithi031.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59150.log.gz 2024-04-15T00:32:23.944 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46567.log 2024-04-15T00:32:23.944 INFO:teuthology.orchestra.run.smithi031.stderr: 86.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-15T00:32:23.944 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.58628.log: /var/log/ceph/ceph-client.admin.45472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46576.log 2024-04-15T00:32:23.944 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58628.log.gz 2024-04-15T00:32:23.944 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46574.log 2024-04-15T00:32:23.944 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37247.log 2024-04-15T00:32:23.944 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46576.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44874.log.gz 2024-04-15T00:32:23.945 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46574.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47278.log.gz 2024-04-15T00:32:23.945 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31182.log 2024-04-15T00:32:23.945 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47320.log.gz 2024-04-15T00:32:23.945 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43225.log 2024-04-15T00:32:23.945 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37247.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44916.log.gz 2024-04-15T00:32:23.945 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph.tmp-client.admin.31182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58730.log 2024-04-15T00:32:23.945 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43539.log.gz 2024-04-15T00:32:23.945 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31182.log.gz 2024-04-15T00:32:23.945 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46239.log 2024-04-15T00:32:23.946 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.58730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45514.log 2024-04-15T00:32:23.946 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46239.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58730.log.gzgzip 2024-04-15T00:32:23.946 INFO:teuthology.orchestra.run.smithi031.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.59108.log 2024-04-15T00:32:23.946 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43056.log 2024-04-15T00:32:23.946 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.59108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45640.log 2024-04-15T00:32:23.946 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37350.log 2024-04-15T00:32:23.946 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59108.log.gz 2024-04-15T00:32:23.946 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45640.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43497.log.gz 2024-04-15T00:32:23.946 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46575.log 2024-04-15T00:32:23.947 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45904.log 2024-04-15T00:32:23.947 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43954.log.gz 2024-04-15T00:32:23.947 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43786.log 2024-04-15T00:32:23.947 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47236.log.gz 2024-04-15T00:32:23.947 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45100.log 2024-04-15T00:32:23.947 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58095.log 2024-04-15T00:32:23.947 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47404.log 2024-04-15T00:32:23.947 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.58095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59402.log 2024-04-15T00:32:23.947 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59484.log 2024-04-15T00:32:23.948 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58095.log.gz 2024-04-15T00:32:23.948 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47404.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47068.log.gz 2024-04-15T00:32:23.948 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45903.log 2024-04-15T00:32:23.948 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.59402.log: /var/log/ceph/ceph-client.admin.59484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45897.log 2024-04-15T00:32:23.948 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59402.log.gz 2024-04-15T00:32:23.948 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45903.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59484.log.gz 2024-04-15T00:32:23.948 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-15T00:32:23.948 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47026.log 2024-04-15T00:32:23.948 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45897.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46567.log.gz 2024-04-15T00:32:23.949 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46574.log.gz 2024-04-15T00:32:23.949 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58688.log 2024-04-15T00:32:23.949 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43870.log 2024-04-15T00:32:23.949 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43148.log.gz 2024-04-15T00:32:23.949 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.58688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47152.log 2024-04-15T00:32:23.949 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43225.log.gz 2024-04-15T00:32:23.949 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46576.log.gz 2024-04-15T00:32:23.949 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43870.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58688.log.gz 2024-04-15T00:32:23.949 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47152.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43287.log.gz 2024-04-15T00:32:23.950 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43329.log.gz 2024-04-15T00:32:23.950 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43371.log.gz 2024-04-15T00:32:23.950 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43413.log.gz 2024-04-15T00:32:23.950 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46239.log.gz 2024-04-15T00:32:23.950 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46575.log.gz 2024-04-15T00:32:23.950 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47404.log.gz 2024-04-15T00:32:23.950 INFO:teuthology.orchestra.run.smithi031.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45100.log.gz 2024-04-15T00:32:23.950 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43786.log.gz 2024-04-15T00:32:23.951 INFO:teuthology.orchestra.run.smithi031.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43870.log.gz 2024-04-15T00:32:23.951 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45640.log.gz 2024-04-15T00:32:23.951 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45897.log.gz 2024-04-15T00:32:23.951 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45903.log.gz 2024-04-15T00:32:23.951 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45904.log.gz 2024-04-15T00:32:23.951 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47026.log.gz 2024-04-15T00:32:23.951 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47152.log.gz 2024-04-15T00:32:23.953 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37350.log.gz 2024-04-15T00:32:23.953 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44748.log.gz 2024-04-15T00:32:23.953 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44790.log.gz 2024-04-15T00:32:23.953 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44832.log.gz 2024-04-15T00:32:23.953 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45304.log.gz 2024-04-15T00:32:23.954 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45346.log.gz 2024-04-15T00:32:23.954 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45388.log.gz 2024-04-15T00:32:23.954 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45430.log.gz 2024-04-15T00:32:23.954 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45472.log.gz 2024-04-15T00:32:23.954 INFO:teuthology.orchestra.run.smithi031.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.45514.log.gz 2024-04-15T00:32:23.954 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45556.log.gz 2024-04-15T00:32:23.954 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45598.log.gz 2024-04-15T00:32:23.954 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37247.log.gz 2024-04-15T00:32:24.031 INFO:teuthology.orchestra.run.smithi050.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-15T00:32:24.066 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43056.log.gz 2024-04-15T00:32:24.086 INFO:teuthology.orchestra.run.smithi050.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-15T00:32:24.313 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36994.log.gz 2024-04-15T00:32:24.844 INFO:teuthology.orchestra.run.smithi031.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-15T00:32:27.798 INFO:teuthology.orchestra.run.smithi031.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-15T00:32:40.729 INFO:teuthology.orchestra.run.smithi050.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-15T00:32:41.850 INFO:teuthology.orchestra.run.smithi050.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-15T00:32:46.257 INFO:teuthology.orchestra.run.smithi050.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-15T00:32:49.284 INFO:teuthology.orchestra.run.smithi050.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-15T00:32:49.286 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-04-15T00:32:49.286 INFO:teuthology.orchestra.run.smithi050.stderr:real 0m25.414s 2024-04-15T00:32:49.287 INFO:teuthology.orchestra.run.smithi050.stderr:user 1m20.552s 2024-04-15T00:32:49.287 INFO:teuthology.orchestra.run.smithi050.stderr:sys 0m2.269s 2024-04-15T00:32:51.454 INFO:teuthology.orchestra.run.smithi031.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-15T00:32:55.971 INFO:teuthology.orchestra.run.smithi031.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-15T00:33:00.616 INFO:teuthology.orchestra.run.smithi031.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-15T00:33:14.529 INFO:teuthology.orchestra.run.smithi031.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-15T00:33:18.458 INFO:teuthology.orchestra.run.smithi031.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-15T00:34:48.133 INFO:teuthology.orchestra.run.smithi031.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.0.48007.log.gz 2024-04-15T00:34:48.135 INFO:teuthology.orchestra.run.smithi031.stderr: 2024-04-15T00:34:48.135 INFO:teuthology.orchestra.run.smithi031.stderr:real 2m24.285s 2024-04-15T00:34:48.136 INFO:teuthology.orchestra.run.smithi031.stderr:user 3m32.641s 2024-04-15T00:34:48.136 INFO:teuthology.orchestra.run.smithi031.stderr:sys 0m7.831s 2024-04-15T00:34:48.136 INFO:tasks.ceph:Archiving logs... 2024-04-15T00:34:48.137 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656634/remote/smithi031/log 2024-04-15T00:34:48.138 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-15T00:35:15.460 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656634/remote/smithi050/log 2024-04-15T00:35:15.461 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-15T00:35:28.428 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-15T00:35:28.438 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-15T00:35:28.439 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-15T00:35:28.442 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-15T00:35:28.522 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-15T00:35:28.532 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-15T00:35:28.533 DEBUG:teuthology.orchestra.run.smithi031:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-15T00:35:28.535 DEBUG:teuthology.orchestra.run.smithi050:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-15T00:35:28.548 INFO:teuthology.orchestra.run.smithi031.stderr:bash: line 1: ntpq: command not found 2024-04-15T00:35:28.551 INFO:teuthology.orchestra.run.smithi050.stderr:bash: line 1: ntpq: command not found 2024-04-15T00:35:28.557 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-15T00:35:28.557 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2024-04-15T00:35:28.557 INFO:teuthology.orchestra.run.smithi050.stdout:^* hv01.front.sepia.ceph.com 3 6 377 1 +1009us[ +981us] +/- 55ms 2024-04-15T00:35:28.558 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 4 -944us[ -972us] +/- 58ms 2024-04-15T00:35:28.558 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 6 -243us[ -271us] +/- 87ms 2024-04-15T00:35:28.558 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T00:35:28.569 INFO:teuthology.orchestra.run.smithi031.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-15T00:35:28.569 INFO:teuthology.orchestra.run.smithi031.stdout:=============================================================================== 2024-04-15T00:35:28.570 INFO:teuthology.orchestra.run.smithi031.stdout:^* hv01.front.sepia.ceph.com 3 6 377 4 +1062us[+1057us] +/- 55ms 2024-04-15T00:35:28.570 INFO:teuthology.orchestra.run.smithi031.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 7 -895us[ -900us] +/- 58ms 2024-04-15T00:35:28.570 INFO:teuthology.orchestra.run.smithi031.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 -190us[ -190us] +/- 87ms 2024-04-15T00:35:28.570 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T00:35:28.571 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-15T00:35:28.581 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-15T00:35:28.581 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-15T00:35:28.590 DEBUG:teuthology.orchestra.run.smithi031:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-15T00:35:28.692 DEBUG:teuthology.orchestra.run.smithi050:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-15T00:35:28.765 DEBUG:teuthology.orchestra.run.smithi031:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-15T00:35:28.796 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T00:35:28.797 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-15T00:35:28.828 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T00:35:28.828 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-15T00:35:28.838 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-15T00:35:28.847 INFO:teuthology.task.internal:Duration was 1321.932449 seconds 2024-04-15T00:35:28.848 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-15T00:35:28.858 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-15T00:35:28.858 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-15T00:35:28.861 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-15T00:35:28.913 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-15T00:35:28.950 INFO:teuthology.orchestra.run.smithi031.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-15T00:35:29.125 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-15T00:35:29.125 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi031.front.sepia.ceph.com 2024-04-15T00:35:29.126 DEBUG:teuthology.orchestra.run.smithi031:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-15T00:35:29.145 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi050.front.sepia.ceph.com 2024-04-15T00:35:29.145 DEBUG:teuthology.orchestra.run.smithi050:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-15T00:35:29.171 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-15T00:35:29.172 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-15T00:35:29.187 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-15T00:35:29.241 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-15T00:35:29.241 DEBUG:teuthology.orchestra.run.smithi031:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-15T00:35:29.255 DEBUG:teuthology.orchestra.run.smithi050:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-15T00:35:29.384 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-15T00:35:29.394 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-15T00:35:29.394 DEBUG:teuthology.orchestra.run.smithi031:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-15T00:35:29.423 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-15T00:35:29.451 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-15T00:35:29.462 DEBUG:teuthology.orchestra.run.smithi031:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-15T00:35:29.466 DEBUG:teuthology.orchestra.run.smithi050:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-15T00:35:29.516 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = core 2024-04-15T00:35:29.524 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = core 2024-04-15T00:35:29.544 DEBUG:teuthology.orchestra.run.smithi031:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-15T00:35:29.557 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T00:35:29.558 DEBUG:teuthology.orchestra.run.smithi050:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-15T00:35:29.598 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T00:35:29.599 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-15T00:35:29.610 INFO:teuthology.task.internal:Transferring archived files... 2024-04-15T00:35:29.611 DEBUG:teuthology.misc:Transferring archived files from smithi031:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656634/remote/smithi031 2024-04-15T00:35:29.611 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-15T00:35:29.645 DEBUG:teuthology.misc:Transferring archived files from smithi050:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656634/remote/smithi050 2024-04-15T00:35:29.646 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-15T00:35:29.681 INFO:teuthology.task.internal:Removing archive directory... 2024-04-15T00:35:29.681 DEBUG:teuthology.orchestra.run.smithi031:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-15T00:35:29.683 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-15T00:35:29.729 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-15T00:35:29.741 INFO:teuthology.task.internal:Not uploading archives. 2024-04-15T00:35:29.741 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-15T00:35:29.752 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-15T00:35:29.752 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-15T00:35:29.754 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-15T00:35:29.766 INFO:teuthology.orchestra.run.smithi031.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 15 00:35 /home/ubuntu/cephtest 2024-04-15T00:35:29.783 INFO:teuthology.orchestra.run.smithi050.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 15 00:35 /home/ubuntu/cephtest 2024-04-15T00:35:29.785 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-15T00:35:29.796 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-15T00:35:29.817 INFO:teuthology.nuke:Checking targets against current locks 2024-04-15T00:35:29.843 DEBUG:teuthology.nuke:shortname: smithi031 2024-04-15T00:35:29.844 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-15T00:35:29.867 DEBUG:teuthology.nuke:shortname: smithi050 2024-04-15T00:35:29.867 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-15T00:35:29.871 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656634', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-15 00:05:02.313498', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNn/78zpNCO1u7aePEvFteOWbNZakRUONk4VBVixpEo1uoDb94JpfpsnF22EsVb3bXpizehxZKpiHaVAf1Ws0ws='} 2024-04-15T00:35:29.894 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656634', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-15 00:05:02.312230', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLWOzY9VzwV1Diat2zO7DNPgVuGriryQsfJfgWGy09MvJqO0dpFD8H69w3WY7BZREN5LA/YhK/MaW5QfYGq4bvQ='} 2024-04-15T00:35:29.923 INFO:teuthology.orchestra.console.smithi031:Power off 2024-04-15T00:35:29.923 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T00:35:29.950 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off 2024-04-15T00:35:29.950 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T00:35:29.969 INFO:teuthology.orchestra.console.smithi050:Power off 2024-04-15T00:35:29.969 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T00:35:29.979 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2024-04-15T00:35:29.992 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off 2024-04-15T00:35:29.993 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T00:35:30.016 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2024-04-15T00:35:33.981 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T00:35:34.017 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T00:35:34.090 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2024-04-15T00:35:34.128 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2024-04-15T00:35:38.092 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T00:35:38.129 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T00:35:38.206 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2024-04-15T00:35:38.240 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2024-04-15T00:35:38.308 INFO:teuthology.orchestra.console.smithi031:Power off completed 2024-04-15T00:35:38.340 INFO:teuthology.orchestra.console.smithi050:Power off completed 2024-04-15T00:35:38.446 INFO:teuthology.run:Summary data: description: fs/traceless/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_ffsb traceless/50pc} duration: 1321.9324488639832 failure_reason: 'Command failed (workunit test suites/ffsb.sh) on smithi031 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a9a752df26c63acad72e1b3569fd79a515ca0765 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh''' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=c428e2498c374387935e4fd65dae4d97 status: fail success: false 2024-04-15T00:35:38.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T00:35:38.535 INFO:teuthology.run:FAIL